2023-10-13T23:47:00.288 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-13T23:47:00.289 DEBUG:teuthology.run:Teuthology command: teuthology --description rbd/cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} data-pool/none features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd_support_module_recovery} --owner scheduled_dis@teuthology --name dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi --verbose --archive /home/teuthworker/archive/dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi/7427261 -- /home/teuthworker/archive/dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi/7427261/orig.config.yaml 2023-10-13T23:47:00.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-13T23:47:00.417 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi/7427261 branch: wip-dis-testing description: rbd/cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} data-pool/none features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd_support_module_recovery} email: idryomov@gmail.com first_in_suite: false job_id: '7427261' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-dis-testing ceph: conf: client: rbd default features: 125 global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 debug rbd: 20 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 01fff6a72a328459c1d153e5dc1de6a34e48a82f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: osd default pool size: 2 install: ceph: flavor: default sha1: 01fff6a72a328459c1d153e5dc1de6a34e48a82f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-dis-testing-qa sha1: 735f68d7bf91d643813a8420fc2b11441f4bd8c4 owner: scheduled_dis@teuthology priority: 74 repo: https://github.com/ceph/ceph-ci roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 2449 sha1: 01fff6a72a328459c1d153e5dc1de6a34e48a82f sleep_before_teardown: 0 subset: 49/99 suite: rbd suite_branch: wip-dis-testing-qa suite_path: /home/teuthworker/src/github.com_idryomov_ceph_735f68d7bf91d643813a8420fc2b11441f4bd8c4/qa suite_relpath: qa suite_repo: https://github.com/idryomov/ceph suite_sha1: 735f68d7bf91d643813a8420fc2b11441f4bd8c4 targets: smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDTJq5pXYPXVKv8Nn2/FrTO6TzhVPDH1QVWF6NYsuEQy0i/oqu7ud7tCXtWBWffCbWG//LTv2bp/u1KekRrIZaE= tasks: - install: null - ceph: null - install: extra_system_packages: - fio - workunit: clients: client.0: - rbd/rbd_support_module_recovery.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_23:35:38 tube: smithi user: dis verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-13T23:47:00.417 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_idryomov_ceph_735f68d7bf91d643813a8420fc2b11441f4bd8c4/qa; will attempt to use it 2023-10-13T23:47:00.418 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_idryomov_ceph_735f68d7bf91d643813a8420fc2b11441f4bd8c4/qa/tasks 2023-10-13T23:47:00.418 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-13T23:47:00.420 INFO:teuthology.task.internal:Checking packages... 2023-10-13T23:47:00.443 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '01fff6a72a328459c1d153e5dc1de6a34e48a82f' 2023-10-13T23:47:00.444 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-13T23:47:00.444 INFO:teuthology.packaging:ref: None 2023-10-13T23:47:00.445 INFO:teuthology.packaging:tag: None 2023-10-13T23:47:00.445 INFO:teuthology.packaging:branch: wip-dis-testing 2023-10-13T23:47:00.445 INFO:teuthology.packaging:sha1: 01fff6a72a328459c1d153e5dc1de6a34e48a82f 2023-10-13T23:47:00.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-dis-testing 2023-10-13T23:47:00.585 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6724-g01fff6a7-1jammy 2023-10-13T23:47:00.586 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-13T23:47:00.591 INFO:teuthology.task.internal:no buildpackages task found 2023-10-13T23:47:00.592 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-13T23:47:00.597 INFO:teuthology.task.internal:Saving configuration 2023-10-13T23:47:00.610 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-13T23:47:00.617 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-13T23:47:00.644 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi/7427261', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-13 23:41:16.555677', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJtnptbwJLm/G+vQY1RILQewslZXJV85DHIAG+8jmCgR'} 2023-10-13T23:47:00.644 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-13T23:47:00.650 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-10-13T23:47:00.651 INFO:teuthology.run_tasks:Running task console_log... 2023-10-13T23:47:00.692 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8e9fdd2940>, signals=[15]) 2023-10-13T23:47:00.693 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-13T23:47:00.699 INFO:teuthology.task.internal:Opening connections... 2023-10-13T23:47:00.700 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2023-10-13T23:47:00.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T23:47:00.781 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-13T23:47:00.787 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-10-13T23:47:00.891 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-10-13T23:47:00.891 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-10-13T23:47:00.938 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-13T23:47:00.938 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Ubuntu" 2023-10-13T23:47:00.938 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="22.04" 2023-10-13T23:47:00.939 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-13T23:47:00.939 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_CODENAME=jammy 2023-10-13T23:47:00.939 INFO:teuthology.orchestra.run.smithi191.stdout:ID=ubuntu 2023-10-13T23:47:00.939 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE=debian 2023-10-13T23:47:00.939 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-13T23:47:00.940 INFO:teuthology.orchestra.run.smithi191.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-13T23:47:00.940 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-13T23:47:00.940 INFO:teuthology.orchestra.run.smithi191.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-13T23:47:00.941 INFO:teuthology.orchestra.run.smithi191.stdout:UBUNTU_CODENAME=jammy 2023-10-13T23:47:00.941 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-10-13T23:47:01.071 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-13T23:47:01.081 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-13T23:47:01.094 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-13T23:47:01.095 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2023-10-13T23:47:01.100 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-13T23:47:01.106 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-13T23:47:01.107 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2023-10-13T23:47:01.148 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-13T23:47:01.177 INFO:teuthology.run_tasks:Running task kernel... 2023-10-13T23:47:01.209 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-13T23:47:01.210 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-13T23:47:01.210 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-13T23:47:01.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-13T23:47:01.216 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2023-10-13T23:47:01.262 INFO:teuthology.orchestra.run.smithi191.stdout:5.15.0-56-generic 2023-10-13T23:47:01.263 INFO:teuthology.task.kernel:Running kernel on smithi191: 5.15.0-56-generic 2023-10-13T23:47:01.263 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get clean 2023-10-13T23:47:01.378 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2023-10-13T23:47:01.517 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-10-13T23:47:01.625 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-13T23:47:01.707 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-10-13T23:47:01.720 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [346 kB] 2023-10-13T23:47:01.782 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [856 kB] 2023-10-13T23:47:01.810 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [175 kB] 2023-10-13T23:47:01.814 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2023-10-13T23:47:01.815 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [953 kB] 2023-10-13T23:47:01.827 INFO:teuthology.orchestra.run.smithi191.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [32.0 kB] 2023-10-13T23:47:01.828 INFO:teuthology.orchestra.run.smithi191.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [154 kB] 2023-10-13T23:47:01.829 INFO:teuthology.orchestra.run.smithi191.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [532 B] 2023-10-13T23:47:01.830 INFO:teuthology.orchestra.run.smithi191.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [560 kB] 2023-10-13T23:47:01.835 INFO:teuthology.orchestra.run.smithi191.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [789 kB] 2023-10-13T23:47:01.842 INFO:teuthology.orchestra.run.smithi191.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [145 kB] 2023-10-13T23:47:01.865 INFO:teuthology.orchestra.run.smithi191.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.7 kB] 2023-10-13T23:47:01.866 INFO:teuthology.orchestra.run.smithi191.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [36.5 kB] 2023-10-13T23:47:01.866 INFO:teuthology.orchestra.run.smithi191.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,032 B] 2023-10-13T23:47:01.867 INFO:teuthology.orchestra.run.smithi191.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,060 B] 2023-10-13T23:47:01.867 INFO:teuthology.orchestra.run.smithi191.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2023-10-13T23:47:02.060 INFO:teuthology.orchestra.run.smithi191.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2023-10-13T23:47:02.199 INFO:teuthology.orchestra.run.smithi191.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [506 kB] 2023-10-13T23:47:02.382 INFO:teuthology.orchestra.run.smithi191.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,062 kB] 2023-10-13T23:47:02.510 INFO:teuthology.orchestra.run.smithi191.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [234 kB] 2023-10-13T23:47:02.524 INFO:teuthology.orchestra.run.smithi191.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.0 kB] 2023-10-13T23:47:02.525 INFO:teuthology.orchestra.run.smithi191.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [32.3 kB] 2023-10-13T23:47:02.527 INFO:teuthology.orchestra.run.smithi191.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [974 kB] 2023-10-13T23:47:02.580 INFO:teuthology.orchestra.run.smithi191.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [157 kB] 2023-10-13T23:47:02.586 INFO:teuthology.orchestra.run.smithi191.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [532 B] 2023-10-13T23:47:02.750 INFO:teuthology.orchestra.run.smithi191.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [991 kB] 2023-10-13T23:47:03.352 INFO:teuthology.orchestra.run.smithi191.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [658 kB] 2023-10-13T23:47:03.390 INFO:teuthology.orchestra.run.smithi191.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [217 kB] 2023-10-13T23:47:03.402 INFO:teuthology.orchestra.run.smithi191.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.0 kB] 2023-10-13T23:47:03.404 INFO:teuthology.orchestra.run.smithi191.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,888 B] 2023-10-13T23:47:03.404 INFO:teuthology.orchestra.run.smithi191.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [41.6 kB] 2023-10-13T23:47:03.406 INFO:teuthology.orchestra.run.smithi191.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [9,768 B] 2023-10-13T23:47:03.407 INFO:teuthology.orchestra.run.smithi191.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2023-10-13T23:47:03.407 INFO:teuthology.orchestra.run.smithi191.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2023-10-13T23:47:03.408 INFO:teuthology.orchestra.run.smithi191.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2023-10-13T23:47:03.434 INFO:teuthology.orchestra.run.smithi191.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2023-10-13T23:47:03.599 INFO:teuthology.orchestra.run.smithi191.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-10-13T23:47:03.681 INFO:teuthology.orchestra.run.smithi191.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2023-10-13T23:47:03.777 INFO:teuthology.orchestra.run.smithi191.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2023-10-13T23:47:03.805 INFO:teuthology.orchestra.run.smithi191.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.4 kB] 2023-10-13T23:47:03.856 INFO:teuthology.orchestra.run.smithi191.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [640 B] 2023-10-13T23:47:08.122 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 9,489 kB in 2s (3,928 kB/s) 2023-10-13T23:47:09.392 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2023-10-13T23:47:09.408 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-13T23:47:09.468 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2023-10-13T23:47:09.651 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2023-10-13T23:47:09.653 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2023-10-13T23:47:09.792 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2023-10-13T23:47:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-13T23:47:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-13T23:47:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-13T23:47:09.793 INFO:teuthology.orchestra.run.smithi191.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-10-13T23:47:09.794 INFO:teuthology.orchestra.run.smithi191.stdout: python2.7-minimal 2023-10-13T23:47:09.795 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-13T23:47:09.795 INFO:teuthology.orchestra.run.smithi191.stdout:The following additional packages will be installed: 2023-10-13T23:47:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: linux-generic linux-headers-5.15.0-86 linux-headers-5.15.0-86-generic 2023-10-13T23:47:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: linux-headers-generic linux-image-5.15.0-86-generic 2023-10-13T23:47:09.795 INFO:teuthology.orchestra.run.smithi191.stdout: linux-modules-5.15.0-86-generic linux-modules-extra-5.15.0-86-generic 2023-10-13T23:47:09.796 INFO:teuthology.orchestra.run.smithi191.stdout:Suggested packages: 2023-10-13T23:47:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-10-13T23:47:09.796 INFO:teuthology.orchestra.run.smithi191.stdout:Recommended packages: 2023-10-13T23:47:09.796 INFO:teuthology.orchestra.run.smithi191.stdout: thermald 2023-10-13T23:47:09.835 INFO:teuthology.orchestra.run.smithi191.stdout:The following NEW packages will be installed: 2023-10-13T23:47:09.835 INFO:teuthology.orchestra.run.smithi191.stdout: linux-headers-5.15.0-86 linux-headers-5.15.0-86-generic 2023-10-13T23:47:09.835 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.15.0-86-generic linux-modules-5.15.0-86-generic 2023-10-13T23:47:09.836 INFO:teuthology.orchestra.run.smithi191.stdout: linux-modules-extra-5.15.0-86-generic 2023-10-13T23:47:09.836 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages will be upgraded: 2023-10-13T23:47:09.837 INFO:teuthology.orchestra.run.smithi191.stdout: linux-generic linux-headers-generic linux-image-generic 2023-10-13T23:47:09.885 INFO:teuthology.orchestra.run.smithi191.stdout:3 upgraded, 5 newly installed, 0 to remove and 268 not upgraded. 2023-10-13T23:47:09.886 INFO:teuthology.orchestra.run.smithi191.stdout:Need to get 113 MB of archives. 2023-10-13T23:47:09.886 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 582 MB of additional disk space will be used. 2023-10-13T23:47:09.886 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-86-generic amd64 5.15.0-86.96 [22.4 MB] 2023-10-13T23:47:10.298 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-86-generic amd64 5.15.0-86.96 [11.5 MB] 2023-10-13T23:47:10.389 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-86-generic amd64 5.15.0-86.96 [63.9 MB] 2023-10-13T23:47:11.160 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.86.83 [1,702 B] 2023-10-13T23:47:11.161 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.86.83 [2,472 B] 2023-10-13T23:47:11.161 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-86 all 5.15.0-86.96 [12.3 MB] 2023-10-13T23:47:11.278 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-86-generic amd64 5.15.0-86.96 [2,882 kB] 2023-10-13T23:47:11.299 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.86.83 [2,328 B] 2023-10-13T23:47:11.764 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 113 MB in 2s (74.0 MB/s) 2023-10-13T23:47:11.943 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-modules-5.15.0-86-generic. 2023-10-13T23:47:14.002 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-10-13T23:47:14.008 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../0-linux-modules-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-13T23:47:14.081 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-modules-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-13T23:47:16.265 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-image-5.15.0-86-generic. 2023-10-13T23:47:16.286 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../1-linux-image-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-13T23:47:16.370 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-13T23:47:16.801 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-86-generic. 2023-10-13T23:47:16.822 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-13T23:47:16.859 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-modules-extra-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-13T23:47:23.588 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../3-linux-generic_5.15.0.86.83_amd64.deb ... 2023-10-13T23:47:23.713 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-13T23:47:24.021 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.86.83_amd64.deb ... 2023-10-13T23:47:24.142 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-image-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-13T23:47:24.438 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-headers-5.15.0-86. 2023-10-13T23:47:24.460 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../5-linux-headers-5.15.0-86_5.15.0-86.96_all.deb ... 2023-10-13T23:47:24.505 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-headers-5.15.0-86 (5.15.0-86.96) ... 2023-10-13T23:47:30.173 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package linux-headers-5.15.0-86-generic. 2023-10-13T23:47:30.210 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../6-linux-headers-5.15.0-86-generic_5.15.0-86.96_amd64.deb ... 2023-10-13T23:47:30.248 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-headers-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-13T23:47:32.963 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.86.83_amd64.deb ... 2023-10-13T23:47:33.111 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking linux-headers-generic (5.15.0.86.83) over (5.15.0.56.54) ... 2023-10-13T23:47:33.436 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-headers-5.15.0-86 (5.15.0-86.96) ... 2023-10-13T23:47:33.557 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-headers-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-13T23:47:33.659 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-headers-generic (5.15.0.86.83) ... 2023-10-13T23:47:33.769 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-13T23:47:35.076 INFO:teuthology.orchestra.run.smithi191.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-10-13T23:47:35.076 INFO:teuthology.orchestra.run.smithi191.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-10-13T23:47:35.077 INFO:teuthology.orchestra.run.smithi191.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-86-generic 2023-10-13T23:47:35.077 INFO:teuthology.orchestra.run.smithi191.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-86-generic 2023-10-13T23:47:35.249 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-modules-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-13T23:47:36.658 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-modules-extra-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-13T23:47:38.026 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-image-generic (5.15.0.86.83) ... 2023-10-13T23:47:38.152 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up linux-generic (5.15.0.86.83) ... 2023-10-13T23:47:38.278 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for linux-image-5.15.0-86-generic (5.15.0-86.96) ... 2023-10-13T23:47:38.357 INFO:teuthology.orchestra.run.smithi191.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-10-13T23:47:38.357 INFO:teuthology.orchestra.run.smithi191.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-86-generic 2023-10-13T23:47:53.033 INFO:teuthology.orchestra.run.smithi191.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-10-13T23:47:53.034 INFO:teuthology.orchestra.run.smithi191.stdout:Sourcing file `/etc/default/grub' 2023-10-13T23:47:53.054 INFO:teuthology.orchestra.run.smithi191.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-13T23:47:53.081 INFO:teuthology.orchestra.run.smithi191.stdout:Generating grub configuration file ... 2023-10-13T23:47:53.353 INFO:teuthology.orchestra.run.smithi191.stdout:Found linux image: /boot/vmlinuz-5.15.0-86-generic 2023-10-13T23:47:53.369 INFO:teuthology.orchestra.run.smithi191.stdout:Found initrd image: /boot/initrd.img-5.15.0-86-generic 2023-10-13T23:47:53.676 INFO:teuthology.orchestra.run.smithi191.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-13T23:47:53.682 INFO:teuthology.orchestra.run.smithi191.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-13T23:47:53.750 INFO:teuthology.orchestra.run.smithi191.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-13T23:47:53.755 INFO:teuthology.orchestra.run.smithi191.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-13T23:47:53.905 INFO:teuthology.orchestra.run.smithi191.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-13T23:47:53.906 INFO:teuthology.orchestra.run.smithi191.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-10-13T23:47:53.906 INFO:teuthology.orchestra.run.smithi191.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-13T23:47:53.946 INFO:teuthology.orchestra.run.smithi191.stdout:done 2023-10-13T23:47:54.410 DEBUG:teuthology.orchestra.run.smithi191:> dpkg -s linux-image-generic 2023-10-13T23:47:54.435 INFO:teuthology.orchestra.run.smithi191.stdout:Package: linux-image-generic 2023-10-13T23:47:54.435 INFO:teuthology.orchestra.run.smithi191.stdout:Status: install ok installed 2023-10-13T23:47:54.435 INFO:teuthology.orchestra.run.smithi191.stdout:Priority: optional 2023-10-13T23:47:54.435 INFO:teuthology.orchestra.run.smithi191.stdout:Section: kernel 2023-10-13T23:47:54.436 INFO:teuthology.orchestra.run.smithi191.stdout:Installed-Size: 20 2023-10-13T23:47:54.436 INFO:teuthology.orchestra.run.smithi191.stdout:Maintainer: Ubuntu Kernel Team 2023-10-13T23:47:54.436 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: amd64 2023-10-13T23:47:54.436 INFO:teuthology.orchestra.run.smithi191.stdout:Source: linux-meta 2023-10-13T23:47:54.437 INFO:teuthology.orchestra.run.smithi191.stdout:Version: 5.15.0.86.83 2023-10-13T23:47:54.437 INFO:teuthology.orchestra.run.smithi191.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-86), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-13T23:47:54.437 INFO:teuthology.orchestra.run.smithi191.stdout:Depends: linux-image-5.15.0-86-generic, linux-modules-extra-5.15.0-86-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-13T23:47:54.437 INFO:teuthology.orchestra.run.smithi191.stdout:Recommends: thermald 2023-10-13T23:47:54.438 INFO:teuthology.orchestra.run.smithi191.stdout:Description: Generic Linux kernel image 2023-10-13T23:47:54.438 INFO:teuthology.orchestra.run.smithi191.stdout: This package will always depend on the latest generic kernel image 2023-10-13T23:47:54.438 INFO:teuthology.orchestra.run.smithi191.stdout: available. 2023-10-13T23:47:54.438 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-86-generic 2023-10-13T23:47:54.439 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-13T23:47:54.439 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-13T23:47:54.439 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-13T23:47:54.440 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi191.front.sepia.ceph.com, path=None, version=distro) 2023-10-13T23:47:54.440 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get clean 2023-10-13T23:47:54.609 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2023-10-13T23:47:54.728 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-13T23:47:54.728 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-13T23:47:54.735 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-13T23:47:54.752 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-13T23:47:56.009 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2023-10-13T23:47:56.026 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-10-13T23:47:56.084 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2023-10-13T23:47:56.262 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2023-10-13T23:47:56.263 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2023-10-13T23:47:56.417 INFO:teuthology.orchestra.run.smithi191.stdout:linux-image-generic is already the newest version (5.15.0.86.83). 2023-10-13T23:47:56.418 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2023-10-13T23:47:56.418 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-13T23:47:56.418 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-13T23:47:56.418 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-13T23:47:56.418 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-13T23:47:56.419 INFO:teuthology.orchestra.run.smithi191.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-13T23:47:56.419 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-13T23:47:56.455 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 0 newly installed, 0 to remove and 268 not upgraded. 2023-10-13T23:47:56.457 DEBUG:teuthology.orchestra.run.smithi191:> dpkg -s linux-image-generic 2023-10-13T23:47:56.472 INFO:teuthology.orchestra.run.smithi191.stdout:Package: linux-image-generic 2023-10-13T23:47:56.472 INFO:teuthology.orchestra.run.smithi191.stdout:Status: install ok installed 2023-10-13T23:47:56.473 INFO:teuthology.orchestra.run.smithi191.stdout:Priority: optional 2023-10-13T23:47:56.473 INFO:teuthology.orchestra.run.smithi191.stdout:Section: kernel 2023-10-13T23:47:56.473 INFO:teuthology.orchestra.run.smithi191.stdout:Installed-Size: 20 2023-10-13T23:47:56.473 INFO:teuthology.orchestra.run.smithi191.stdout:Maintainer: Ubuntu Kernel Team 2023-10-13T23:47:56.473 INFO:teuthology.orchestra.run.smithi191.stdout:Architecture: amd64 2023-10-13T23:47:56.474 INFO:teuthology.orchestra.run.smithi191.stdout:Source: linux-meta 2023-10-13T23:47:56.474 INFO:teuthology.orchestra.run.smithi191.stdout:Version: 5.15.0.86.83 2023-10-13T23:47:56.474 INFO:teuthology.orchestra.run.smithi191.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-86), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-10-13T23:47:56.474 INFO:teuthology.orchestra.run.smithi191.stdout:Depends: linux-image-5.15.0-86-generic, linux-modules-extra-5.15.0-86-generic, linux-firmware, intel-microcode, amd64-microcode 2023-10-13T23:47:56.475 INFO:teuthology.orchestra.run.smithi191.stdout:Recommends: thermald 2023-10-13T23:47:56.475 INFO:teuthology.orchestra.run.smithi191.stdout:Description: Generic Linux kernel image 2023-10-13T23:47:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: This package will always depend on the latest generic kernel image 2023-10-13T23:47:56.475 INFO:teuthology.orchestra.run.smithi191.stdout: available. 2023-10-13T23:47:56.476 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2023-10-13T23:47:56.517 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.dFWnrqGa9z 2023-10-13T23:47:56.518 DEBUG:teuthology.orchestra.run.smithi191:> sudo cp /boot/grub/grub.cfg /tmp/tmp.dFWnrqGa9z 2023-10-13T23:47:56.574 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.dFWnrqGa9z 2023-10-13T23:47:56.696 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.dFWnrqGa9z is 10KB 2023-10-13T23:47:56.710 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.dFWnrqGa9z 2023-10-13T23:47:56.716 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-10-13T23:47:56.770 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:47:56.770 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-10-13T23:47:56.770 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-10-13T23:47:56.843 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-86-generic 2023-10-13T23:47:56.843 DEBUG:teuthology.orchestra.run.smithi191:> sudo update-grub 2023-10-13T23:47:57.999 INFO:teuthology.orchestra.run.smithi191.stderr:Sourcing file `/etc/default/grub' 2023-10-13T23:47:58.000 INFO:teuthology.orchestra.run.smithi191.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-13T23:47:58.001 INFO:teuthology.orchestra.run.smithi191.stderr:Generating grub configuration file ... 2023-10-13T23:47:58.183 INFO:teuthology.orchestra.run.smithi191.stderr:Found linux image: /boot/vmlinuz-5.15.0-86-generic 2023-10-13T23:47:58.189 INFO:teuthology.orchestra.run.smithi191.stderr:Found initrd image: /boot/initrd.img-5.15.0-86-generic 2023-10-13T23:47:58.413 INFO:teuthology.orchestra.run.smithi191.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-10-13T23:47:58.418 INFO:teuthology.orchestra.run.smithi191.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-10-13T23:47:58.459 INFO:teuthology.orchestra.run.smithi191.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-10-13T23:47:58.465 INFO:teuthology.orchestra.run.smithi191.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-10-13T23:47:58.584 INFO:teuthology.orchestra.run.smithi191.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-10-13T23:47:58.585 INFO:teuthology.orchestra.run.smithi191.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-10-13T23:47:58.585 INFO:teuthology.orchestra.run.smithi191.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-10-13T23:47:58.605 INFO:teuthology.orchestra.run.smithi191.stderr:done 2023-10-13T23:47:58.622 DEBUG:teuthology.orchestra.run.smithi191:> sudo shutdown -r now 2023-10-13T23:48:28.654 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-13T23:48:28.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-13T23:48:28.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T23:48:47.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-13T23:48:56.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-13T23:48:56.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T23:48:59.162 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-13T23:49:11.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-13T23:49:11.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T23:49:29.594 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-13T23:49:44.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-13T23:49:44.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T23:49:44.609 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-13T23:50:02.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-13T23:50:02.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T23:50:02.891 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-10-13T23:50:03.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-13T23:50:03.416 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-86-generic"... 2023-10-13T23:50:03.416 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2023-10-13T23:50:03.462 INFO:teuthology.orchestra.run.smithi191.stdout:5.15.0-86-generic 2023-10-13T23:50:03.462 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-86-generic vs 5.15.0-86-generic 2023-10-13T23:50:03.463 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-13T23:50:03.463 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-13T23:50:04.464 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-13T23:50:04.464 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-13T23:50:04.537 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2023-10-13T23:50:04.571 DEBUG:teuthology.parallel:result is None 2023-10-13T23:50:04.572 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-13T23:50:04.583 INFO:teuthology.task.internal:Creating test directory... 2023-10-13T23:50:04.583 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-13T23:50:04.589 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-13T23:50:04.603 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-13T23:50:04.612 INFO:teuthology.task.internal:Creating archive directory... 2023-10-13T23:50:04.613 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-13T23:50:04.661 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-13T23:50:04.669 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-13T23:50:04.670 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-13T23:50:04.724 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-13T23:50:04.731 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-13T23:50:04.733 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-13T23:50:04.740 INFO:teuthology.task.internal:Configuring sudo... 2023-10-13T23:50:04.741 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-13T23:50:04.789 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-13T23:50:04.799 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-13T23:50:04.799 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-13T23:50:04.838 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-13T23:50:04.890 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-13T23:50:04.939 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:50:04.939 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-13T23:50:05.008 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2023-10-13T23:50:05.121 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-13T23:50:05.129 INFO:teuthology.task.internal:Starting timer... 2023-10-13T23:50:05.129 INFO:teuthology.run_tasks:Running task pcp... 2023-10-13T23:50:05.139 INFO:teuthology.run_tasks:Running task selinux... 2023-10-13T23:50:05.147 DEBUG:teuthology.task.selinux:Excluding smithi191: OS 'ubuntu' does not support SELinux 2023-10-13T23:50:05.148 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-13T23:50:05.148 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-13T23:50:05.148 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-13T23:50:05.148 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-13T23:50:05.159 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-13T23:50:05.160 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-13T23:50:05.180 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-13T23:50:05.182 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-13T23:57:46.635 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2023-10-13T23:57:46.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-13T23:57:46.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-13T23:57:46.715 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-10-13T23:57:46.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-13T23:57:46.823 INFO:teuthology.run_tasks:Running task clock... 2023-10-13T23:57:46.833 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-13T23:57:46.834 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-13T23:57:46.835 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-13T23:57:46.889 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-10-13T23:57:46.889 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: Command line: ntpd -gq 2023-10-13T23:57:46.889 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: ---------------------------------------------------- 2023-10-13T23:57:46.889 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: ntp-4 is maintained by Network Time Foundation, 2023-10-13T23:57:46.890 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-10-13T23:57:46.890 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: corporation. Support and training for ntp-4 are 2023-10-13T23:57:46.890 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: available at https://www.nwtime.org/support 2023-10-13T23:57:46.890 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: ---------------------------------------------------- 2023-10-13T23:57:46.891 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: proto: precision = 0.043 usec (-24) 2023-10-13T23:57:46.891 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: basedate set to 2022-02-04 2023-10-13T23:57:46.892 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: gps base set to 2022-02-06 (week 2196) 2023-10-13T23:57:46.892 INFO:teuthology.orchestra.run.smithi191.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-13T23:57:46.892 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-13T23:57:46.893 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: restrict ::: KOD does nothing without LIMITED. 2023-10-13T23:57:46.893 INFO:teuthology.orchestra.run.smithi191.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-13T23:57:46.894 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: Listen and drop on 0 v6wildcard [::]:123 2023-10-13T23:57:46.894 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-13T23:57:46.895 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: Listen normally on 2 lo 127.0.0.1:123 2023-10-13T23:57:46.895 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: Listen normally on 3 enp3s0f1 172.21.15.191:123 2023-10-13T23:57:46.895 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: Listen normally on 4 lo [::1]:123 2023-10-13T23:57:46.895 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7211%5]:123 2023-10-13T23:57:46.896 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:46 ntpd[28016]: Listening on routing socket on fd #22 for interface updates 2023-10-13T23:57:48.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:48 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:48.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:48 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:48.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:48 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:48.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:48 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:48.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:48 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:48.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:48 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:48.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:48 ntpd[28016]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-13T23:57:48.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:48 ntpd[28016]: can't open /var/log/ntpstats/peerstats.20231013: Permission denied 2023-10-13T23:57:49.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:49 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:49.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:49 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:49.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:49 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:49.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:49 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:49.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:49 ntpd[28016]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-13T23:57:49.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:49 ntpd[28016]: can't open /var/log/ntpstats/peerstats.20231013: Permission denied 2023-10-13T23:57:50.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:50 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:50.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:50 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:50.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:50 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:50.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:50 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:50.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:50 ntpd[28016]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-13T23:57:50.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:50 ntpd[28016]: can't open /var/log/ntpstats/peerstats.20231013: Permission denied 2023-10-13T23:57:51.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:51 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:51.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:51 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:51.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:51 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:51.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:51 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:51.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:51 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:51.892 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:51 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:51.892 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:51 ntpd[28016]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-13T23:57:51.892 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:51 ntpd[28016]: can't open /var/log/ntpstats/peerstats.20231013: Permission denied 2023-10-13T23:57:51.892 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:51 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:51.892 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:51 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:51.893 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:51 ntpd[28016]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-13T23:57:51.893 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:51 ntpd[28016]: can't open /var/log/ntpstats/peerstats.20231013: Permission denied 2023-10-13T23:57:52.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:52 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:52.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:52 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:52.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:52 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:52.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:52 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:52.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:52 ntpd[28016]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-13T23:57:52.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:52 ntpd[28016]: can't open /var/log/ntpstats/peerstats.20231013: Permission denied 2023-10-13T23:57:53.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:53 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:53.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:53 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:53.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:53 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:53.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:53 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:53.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:53 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:53.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:53 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:53.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:53 ntpd[28016]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-13T23:57:53.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:53 ntpd[28016]: can't open /var/log/ntpstats/peerstats.20231013: Permission denied 2023-10-13T23:57:53.892 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:53 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:53.892 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:53 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:53.892 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:53 ntpd[28016]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-13T23:57:53.892 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:53 ntpd[28016]: can't open /var/log/ntpstats/peerstats.20231013: Permission denied 2023-10-13T23:57:54.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:54 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:54.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:54 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:54.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:54 ntpd[28016]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-13T23:57:54.890 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:54 ntpd[28016]: can't open /var/log/ntpstats/rawstats.20231013: Permission denied 2023-10-13T23:57:54.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:54 ntpd[28016]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-13T23:57:54.891 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:54 ntpd[28016]: can't open /var/log/ntpstats/peerstats.20231013: Permission denied 2023-10-13T23:57:54.891 INFO:teuthology.orchestra.run.smithi191.stdout:13 Oct 23:57:54 ntpd[28016]: ntpd: time slew -0.000383 s 2023-10-13T23:57:54.891 INFO:teuthology.orchestra.run.smithi191.stdout:ntpd: time slew -0.000383s 2023-10-13T23:57:54.892 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:54 ntpd[28016]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-13T23:57:54.892 INFO:teuthology.orchestra.run.smithi191.stderr:13 Oct 23:57:54 ntpd[28016]: can't open /var/log/ntpstats/loopstats.20231013: Permission denied 2023-10-13T23:57:54.968 INFO:teuthology.orchestra.run.smithi191.stdout: remote refid st t when poll reach delay offset jitter 2023-10-13T23:57:54.968 INFO:teuthology.orchestra.run.smithi191.stdout:============================================================================== 2023-10-13T23:57:54.968 INFO:teuthology.orchestra.run.smithi191.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-13T23:57:54.968 INFO:teuthology.orchestra.run.smithi191.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-13T23:57:54.969 INFO:teuthology.orchestra.run.smithi191.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-13T23:57:54.969 INFO:teuthology.orchestra.run.smithi191.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-10-13T23:57:54.969 INFO:teuthology.run_tasks:Running task install... 2023-10-13T23:57:54.978 DEBUG:teuthology.task.install:project ceph 2023-10-13T23:57:54.979 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '01fff6a72a328459c1d153e5dc1de6a34e48a82f'}} 2023-10-13T23:57:54.979 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '01fff6a72a328459c1d153e5dc1de6a34e48a82f'} 2023-10-13T23:57:54.979 INFO:teuthology.task.install:Using flavor: default 2023-10-13T23:57:54.985 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-13T23:57:54.986 INFO:teuthology.task.install:extra packages: [] 2023-10-13T23:57:54.987 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-key list | grep Ceph 2023-10-13T23:57:55.069 INFO:teuthology.orchestra.run.smithi191.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-13T23:57:55.095 INFO:teuthology.orchestra.run.smithi191.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-13T23:57:55.096 INFO:teuthology.orchestra.run.smithi191.stdout:uid [ unknown] Ceph.com (release key) 2023-10-13T23:57:55.096 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-10-13T23:57:55.097 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=01fff6a72a328459c1d153e5dc1de6a34e48a82f 2023-10-13T23:57:55.236 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default/ 2023-10-13T23:57:55.236 INFO:teuthology.task.install.deb:Package version is 18.0.0-6724-g01fff6a7-1jammy 2023-10-13T23:57:55.345 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:57:55.346 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-13T23:57:55.360 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2023-10-13T23:57:55.529 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-13T23:57:55.542 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-13T23:57:55.562 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-13T23:57:55.580 INFO:teuthology.orchestra.run.smithi191.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy InRelease 2023-10-13T23:57:55.603 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-10-13T23:57:55.624 INFO:teuthology.orchestra.run.smithi191.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-13T23:57:55.645 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,411 B] 2023-10-13T23:57:55.650 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-13T23:57:55.671 INFO:teuthology.orchestra.run.smithi191.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-10-13T23:57:55.861 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 28.5 kB in 0s (87.8 kB/s) 2023-10-13T23:57:56.689 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2023-10-13T23:57:56.706 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6724-g01fff6a7-1jammy cephadm=18.0.0-6724-g01fff6a7-1jammy ceph-mds=18.0.0-6724-g01fff6a7-1jammy ceph-mgr=18.0.0-6724-g01fff6a7-1jammy ceph-common=18.0.0-6724-g01fff6a7-1jammy ceph-fuse=18.0.0-6724-g01fff6a7-1jammy ceph-test=18.0.0-6724-g01fff6a7-1jammy ceph-volume=18.0.0-6724-g01fff6a7-1jammy radosgw=18.0.0-6724-g01fff6a7-1jammy python3-rados=18.0.0-6724-g01fff6a7-1jammy python3-rgw=18.0.0-6724-g01fff6a7-1jammy python3-cephfs=18.0.0-6724-g01fff6a7-1jammy python3-rbd=18.0.0-6724-g01fff6a7-1jammy libcephfs2=18.0.0-6724-g01fff6a7-1jammy libcephfs-dev=18.0.0-6724-g01fff6a7-1jammy librados2=18.0.0-6724-g01fff6a7-1jammy librbd1=18.0.0-6724-g01fff6a7-1jammy rbd-fuse=18.0.0-6724-g01fff6a7-1jammy 2023-10-13T23:57:56.766 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2023-10-13T23:57:56.950 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2023-10-13T23:57:56.951 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2023-10-13T23:57:57.119 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2023-10-13T23:57:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-13T23:57:57.119 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-13T23:57:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-13T23:57:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-13T23:57:57.120 INFO:teuthology.orchestra.run.smithi191.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-13T23:57:57.120 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-13T23:57:57.122 INFO:teuthology.orchestra.run.smithi191.stdout:The following additional packages will be installed: 2023-10-13T23:57:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-13T23:57:57.122 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-10-13T23:57:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-10-13T23:57:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-10-13T23:57:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-10-13T23:57:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-10-13T23:57:57.123 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-10-13T23:57:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-10-13T23:57:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2023-10-13T23:57:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-10-13T23:57:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-10-13T23:57:57.124 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-10-13T23:57:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-10-13T23:57:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-10-13T23:57:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-10-13T23:57:57.125 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2023-10-13T23:57:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2023-10-13T23:57:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-13T23:57:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-13T23:57:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-13T23:57:57.126 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-13T23:57:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat xmlstarlet 2023-10-13T23:57:57.127 INFO:teuthology.orchestra.run.smithi191.stdout:Suggested packages: 2023-10-13T23:57:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-10-13T23:57:57.127 INFO:teuthology.orchestra.run.smithi191.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-10-13T23:57:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-10-13T23:57:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-10-13T23:57:57.128 INFO:teuthology.orchestra.run.smithi191.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-10-13T23:57:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-10-13T23:57:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: python3-watchdog 2023-10-13T23:57:57.129 INFO:teuthology.orchestra.run.smithi191.stdout:Recommended packages: 2023-10-13T23:57:57.129 INFO:teuthology.orchestra.run.smithi191.stdout: btrfs-tools 2023-10-13T23:57:57.221 INFO:teuthology.orchestra.run.smithi191.stdout:The following NEW packages will be installed: 2023-10-13T23:57:57.221 INFO:teuthology.orchestra.run.smithi191.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-13T23:57:57.221 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-13T23:57:57.221 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2023-10-13T23:57:57.222 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 2023-10-13T23:57:57.222 INFO:teuthology.orchestra.run.smithi191.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2023-10-13T23:57:57.222 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-10-13T23:57:57.223 INFO:teuthology.orchestra.run.smithi191.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-10-13T23:57:57.223 INFO:teuthology.orchestra.run.smithi191.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-10-13T23:57:57.224 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-10-13T23:57:57.224 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-google-auth 2023-10-13T23:57:57.224 INFO:teuthology.orchestra.run.smithi191.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-10-13T23:57:57.224 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-10-13T23:57:57.224 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-10-13T23:57:57.225 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-10-13T23:57:57.225 INFO:teuthology.orchestra.run.smithi191.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-13T23:57:57.225 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-10-13T23:57:57.225 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-10-13T23:57:57.225 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-requests 2023-10-13T23:57:57.225 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-13T23:57:57.226 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-10-13T23:57:57.226 INFO:teuthology.orchestra.run.smithi191.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-10-13T23:57:57.226 INFO:teuthology.orchestra.run.smithi191.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-10-13T23:57:57.226 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-10-13T23:57:57.226 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-10-13T23:57:57.227 INFO:teuthology.orchestra.run.smithi191.stdout: socat xmlstarlet 2023-10-13T23:57:57.280 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 109 newly installed, 0 to remove and 256 not upgraded. 2023-10-13T23:57:57.280 INFO:teuthology.orchestra.run.smithi191.stdout:Need to get 184 MB of archives. 2023-10-13T23:57:57.281 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 824 MB of additional disk space will be used. 2023-10-13T23:57:57.281 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-10-13T23:57:57.346 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-10-13T23:57:57.387 INFO:teuthology.orchestra.run.smithi191.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-10-13T23:57:57.390 INFO:teuthology.orchestra.run.smithi191.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-10-13T23:57:57.408 INFO:teuthology.orchestra.run.smithi191.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-10-13T23:57:57.463 INFO:teuthology.orchestra.run.smithi191.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-10-13T23:57:57.468 INFO:teuthology.orchestra.run.smithi191.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-10-13T23:57:57.480 INFO:teuthology.orchestra.run.smithi191.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-10-13T23:57:57.484 INFO:teuthology.orchestra.run.smithi191.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-10-13T23:57:57.484 INFO:teuthology.orchestra.run.smithi191.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-10-13T23:57:57.485 INFO:teuthology.orchestra.run.smithi191.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-10-13T23:57:57.493 INFO:teuthology.orchestra.run.smithi191.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-10-13T23:57:57.494 INFO:teuthology.orchestra.run.smithi191.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-10-13T23:57:57.494 INFO:teuthology.orchestra.run.smithi191.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-10-13T23:57:57.496 INFO:teuthology.orchestra.run.smithi191.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-10-13T23:57:57.506 INFO:teuthology.orchestra.run.smithi191.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-10-13T23:57:57.507 INFO:teuthology.orchestra.run.smithi191.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-10-13T23:57:57.507 INFO:teuthology.orchestra.run.smithi191.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-10-13T23:57:57.526 INFO:teuthology.orchestra.run.smithi191.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-10-13T23:57:57.526 INFO:teuthology.orchestra.run.smithi191.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-10-13T23:57:57.527 INFO:teuthology.orchestra.run.smithi191.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-10-13T23:57:57.530 INFO:teuthology.orchestra.run.smithi191.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-10-13T23:57:57.530 INFO:teuthology.orchestra.run.smithi191.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-10-13T23:57:57.531 INFO:teuthology.orchestra.run.smithi191.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-10-13T23:57:57.531 INFO:teuthology.orchestra.run.smithi191.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-10-13T23:57:57.545 INFO:teuthology.orchestra.run.smithi191.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-13T23:57:57.546 INFO:teuthology.orchestra.run.smithi191.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-10-13T23:57:57.546 INFO:teuthology.orchestra.run.smithi191.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-10-13T23:57:57.565 INFO:teuthology.orchestra.run.smithi191.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-10-13T23:57:57.565 INFO:teuthology.orchestra.run.smithi191.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-10-13T23:57:57.566 INFO:teuthology.orchestra.run.smithi191.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-10-13T23:57:57.574 INFO:teuthology.orchestra.run.smithi191.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-10-13T23:57:57.574 INFO:teuthology.orchestra.run.smithi191.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-10-13T23:57:57.576 INFO:teuthology.orchestra.run.smithi191.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-10-13T23:57:57.576 INFO:teuthology.orchestra.run.smithi191.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-10-13T23:57:57.584 INFO:teuthology.orchestra.run.smithi191.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-10-13T23:57:57.588 INFO:teuthology.orchestra.run.smithi191.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-10-13T23:57:57.589 INFO:teuthology.orchestra.run.smithi191.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-10-13T23:57:57.604 INFO:teuthology.orchestra.run.smithi191.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-10-13T23:57:57.605 INFO:teuthology.orchestra.run.smithi191.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-10-13T23:57:57.610 INFO:teuthology.orchestra.run.smithi191.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-10-13T23:57:57.611 INFO:teuthology.orchestra.run.smithi191.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-10-13T23:57:57.616 INFO:teuthology.orchestra.run.smithi191.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-10-13T23:57:57.657 INFO:teuthology.orchestra.run.smithi191.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-6724-g01fff6a7-1jammy [3,450 kB] 2023-10-13T23:57:57.686 INFO:teuthology.orchestra.run.smithi191.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-10-13T23:57:57.687 INFO:teuthology.orchestra.run.smithi191.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-10-13T23:57:57.688 INFO:teuthology.orchestra.run.smithi191.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-10-13T23:57:57.688 INFO:teuthology.orchestra.run.smithi191.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-13T23:57:57.689 INFO:teuthology.orchestra.run.smithi191.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-10-13T23:57:57.698 INFO:teuthology.orchestra.run.smithi191.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-10-13T23:57:57.717 INFO:teuthology.orchestra.run.smithi191.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-10-13T23:57:57.719 INFO:teuthology.orchestra.run.smithi191.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-10-13T23:57:57.719 INFO:teuthology.orchestra.run.smithi191.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-10-13T23:57:57.735 INFO:teuthology.orchestra.run.smithi191.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-10-13T23:57:57.738 INFO:teuthology.orchestra.run.smithi191.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-10-13T23:57:57.739 INFO:teuthology.orchestra.run.smithi191.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-10-13T23:57:57.739 INFO:teuthology.orchestra.run.smithi191.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-10-13T23:57:57.740 INFO:teuthology.orchestra.run.smithi191.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-10-13T23:57:57.740 INFO:teuthology.orchestra.run.smithi191.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-10-13T23:57:57.758 INFO:teuthology.orchestra.run.smithi191.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-10-13T23:57:57.758 INFO:teuthology.orchestra.run.smithi191.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-10-13T23:57:57.762 INFO:teuthology.orchestra.run.smithi191.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-10-13T23:57:57.763 INFO:teuthology.orchestra.run.smithi191.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-10-13T23:57:57.765 INFO:teuthology.orchestra.run.smithi191.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-10-13T23:57:57.777 INFO:teuthology.orchestra.run.smithi191.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-10-13T23:57:57.781 INFO:teuthology.orchestra.run.smithi191.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-10-13T23:57:57.783 INFO:teuthology.orchestra.run.smithi191.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-10-13T23:57:57.788 INFO:teuthology.orchestra.run.smithi191.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-10-13T23:57:57.791 INFO:teuthology.orchestra.run.smithi191.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-10-13T23:57:57.797 INFO:teuthology.orchestra.run.smithi191.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-13T23:57:57.797 INFO:teuthology.orchestra.run.smithi191.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-10-13T23:57:57.798 INFO:teuthology.orchestra.run.smithi191.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-10-13T23:57:57.799 INFO:teuthology.orchestra.run.smithi191.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-10-13T23:57:57.800 INFO:teuthology.orchestra.run.smithi191.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-10-13T23:57:57.816 INFO:teuthology.orchestra.run.smithi191.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-10-13T23:57:57.817 INFO:teuthology.orchestra.run.smithi191.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-10-13T23:57:57.817 INFO:teuthology.orchestra.run.smithi191.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-10-13T23:57:57.819 INFO:teuthology.orchestra.run.smithi191.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-10-13T23:57:57.820 INFO:teuthology.orchestra.run.smithi191.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-10-13T23:57:58.378 INFO:teuthology.orchestra.run.smithi191.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-6724-g01fff6a7-1jammy [3,130 kB] 2023-10-13T23:57:58.681 INFO:teuthology.orchestra.run.smithi191.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-6724-g01fff6a7-1jammy [688 kB] 2023-10-13T23:57:58.750 INFO:teuthology.orchestra.run.smithi191.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-6724-g01fff6a7-1jammy [356 kB] 2023-10-13T23:57:58.786 INFO:teuthology.orchestra.run.smithi191.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-6724-g01fff6a7-1jammy [32.8 kB] 2023-10-13T23:57:58.789 INFO:teuthology.orchestra.run.smithi191.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-6724-g01fff6a7-1jammy [180 kB] 2023-10-13T23:57:58.809 INFO:teuthology.orchestra.run.smithi191.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-6724-g01fff6a7-1jammy [62.4 kB] 2023-10-13T23:57:58.814 INFO:teuthology.orchestra.run.smithi191.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-6724-g01fff6a7-1jammy [330 kB] 2023-10-13T23:57:58.848 INFO:teuthology.orchestra.run.smithi191.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-6724-g01fff6a7-1jammy [6,222 kB] 2023-10-13T23:57:59.435 INFO:teuthology.orchestra.run.smithi191.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-6724-g01fff6a7-1jammy [112 kB] 2023-10-13T23:57:59.447 INFO:teuthology.orchestra.run.smithi191.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-6724-g01fff6a7-1jammy [439 kB] 2023-10-13T23:57:59.490 INFO:teuthology.orchestra.run.smithi191.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-6724-g01fff6a7-1jammy [22.6 MB] 2023-10-13T23:58:01.765 INFO:teuthology.orchestra.run.smithi191.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-6724-g01fff6a7-1jammy [6,853 kB] 2023-10-13T23:58:02.265 INFO:teuthology.orchestra.run.smithi191.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-6724-g01fff6a7-1jammy [238 kB] 2023-10-13T23:58:02.281 INFO:teuthology.orchestra.run.smithi191.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6724-g01fff6a7-1jammy [128 kB] 2023-10-13T23:58:02.291 INFO:teuthology.orchestra.run.smithi191.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-6724-g01fff6a7-1jammy [1,496 kB] 2023-10-13T23:58:02.433 INFO:teuthology.orchestra.run.smithi191.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-6724-g01fff6a7-1jammy [9,863 kB] 2023-10-13T23:58:03.016 INFO:teuthology.orchestra.run.smithi191.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-6724-g01fff6a7-1jammy [31.7 MB] 2023-10-13T23:58:04.550 INFO:teuthology.orchestra.run.smithi191.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-6724-g01fff6a7-1jammy [14.0 kB] 2023-10-13T23:58:04.551 INFO:teuthology.orchestra.run.smithi191.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-6724-g01fff6a7-1jammy [839 kB] 2023-10-13T23:58:04.567 INFO:teuthology.orchestra.run.smithi191.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-6724-g01fff6a7-1jammy [2,146 kB] 2023-10-13T23:58:04.605 INFO:teuthology.orchestra.run.smithi191.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-6724-g01fff6a7-1jammy [283 kB] 2023-10-13T23:58:04.609 INFO:teuthology.orchestra.run.smithi191.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-6724-g01fff6a7-1jammy [138 kB] 2023-10-13T23:58:04.623 INFO:teuthology.orchestra.run.smithi191.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-6724-g01fff6a7-1jammy [1,906 kB] 2023-10-13T23:58:04.700 INFO:teuthology.orchestra.run.smithi191.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6724-g01fff6a7-1jammy [8,625 kB] 2023-10-13T23:58:05.068 INFO:teuthology.orchestra.run.smithi191.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-6724-g01fff6a7-1jammy [14.2 kB] 2023-10-13T23:58:05.068 INFO:teuthology.orchestra.run.smithi191.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-6724-g01fff6a7-1jammy [47.8 MB] 2023-10-13T23:58:07.675 INFO:teuthology.orchestra.run.smithi191.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-6724-g01fff6a7-1jammy [120 kB] 2023-10-13T23:58:07.677 INFO:teuthology.orchestra.run.smithi191.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-6724-g01fff6a7-1jammy [38.3 kB] 2023-10-13T23:58:07.678 INFO:teuthology.orchestra.run.smithi191.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-6724-g01fff6a7-1jammy [12.3 MB] 2023-10-13T23:58:08.128 INFO:teuthology.orchestra.run.smithi191.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-6724-g01fff6a7-1jammy [91.4 kB] 2023-10-13T23:58:08.680 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 184 MB in 11s (16.9 MB/s) 2023-10-13T23:58:08.794 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libfmt8:amd64. 2023-10-13T23:58:08.890 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2023-10-13T23:58:08.895 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../000-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-10-13T23:58:08.976 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-13T23:58:09.288 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-10-13T23:58:09.314 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../001-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-10-13T23:58:09.354 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-13T23:58:09.700 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-13T23:58:09.726 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../002-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-10-13T23:58:09.766 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-13T23:58:10.102 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-13T23:58:10.129 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../003-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-10-13T23:58:10.169 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-13T23:58:10.881 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-13T23:58:10.908 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../004-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-13T23:58:10.948 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-13T23:58:11.343 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-13T23:58:11.369 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../005-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-13T23:58:11.409 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-13T23:58:11.721 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-13T23:58:11.747 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../006-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-10-13T23:58:11.780 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-13T23:58:12.158 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-10-13T23:58:12.184 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../007-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-10-13T23:58:12.224 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-13T23:58:12.552 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librados2. 2023-10-13T23:58:12.578 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../008-librados2_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:12.619 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librados2 (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:13.072 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librbd1. 2023-10-13T23:58:13.087 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../009-librbd1_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:13.122 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librbd1 (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:13.508 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libcephfs2. 2023-10-13T23:58:13.535 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../010-libcephfs2_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:13.574 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libcephfs2 (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:13.860 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rados. 2023-10-13T23:58:13.887 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../011-python3-rados_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:13.927 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rados (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:14.247 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-13T23:58:14.273 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../012-python3-ceph-argparse_18.0.0-6724-g01fff6a7-1jammy_all.deb ... 2023-10-13T23:58:14.305 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-ceph-argparse (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:14.524 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cephfs. 2023-10-13T23:58:14.551 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../013-python3-cephfs_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:14.591 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cephfs (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:14.902 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-13T23:58:14.929 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../014-python3-ceph-common_18.0.0-6724-g01fff6a7-1jammy_all.deb ... 2023-10-13T23:58:14.968 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-ceph-common (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:15.297 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-13T23:58:15.323 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-10-13T23:58:15.363 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-13T23:58:15.842 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-prettytable. 2023-10-13T23:58:15.868 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2023-10-13T23:58:15.908 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-10-13T23:58:16.169 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rbd. 2023-10-13T23:58:16.184 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../017-python3-rbd_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:16.227 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rbd (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:16.539 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-13T23:58:16.566 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-10-13T23:58:16.605 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-13T23:58:16.933 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package librgw2. 2023-10-13T23:58:16.960 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../019-librgw2_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:17.000 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking librgw2 (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:17.536 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rgw. 2023-10-13T23:58:17.562 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../020-python3-rgw_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:17.610 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rgw (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:17.922 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package liboath0:amd64. 2023-10-13T23:58:17.949 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../021-liboath0_2.6.7-3build1_amd64.deb ... 2023-10-13T23:58:17.989 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-10-13T23:58:18.266 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libradosstriper1. 2023-10-13T23:58:18.293 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../022-libradosstriper1_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:18.333 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libradosstriper1 (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:18.761 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-common. 2023-10-13T23:58:18.788 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../023-ceph-common_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:18.828 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-common (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:20.159 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-base. 2023-10-13T23:58:20.186 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../024-ceph-base_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:20.243 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-base (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:21.031 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-10-13T23:58:21.057 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../025-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-10-13T23:58:21.096 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-10-13T23:58:21.374 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cheroot. 2023-10-13T23:58:21.401 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../026-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-10-13T23:58:21.441 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-13T23:58:21.794 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-10-13T23:58:21.821 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../027-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-10-13T23:58:21.860 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-10-13T23:58:22.147 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.text. 2023-10-13T23:58:22.163 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../028-python3-jaraco.text_3.6.0-2_all.deb ... 2023-10-13T23:58:22.197 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-10-13T23:58:22.458 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-10-13T23:58:22.485 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../029-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-10-13T23:58:22.525 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-10-13T23:58:22.828 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-tempora. 2023-10-13T23:58:22.854 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../030-python3-tempora_4.1.2-1_all.deb ... 2023-10-13T23:58:22.894 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-10-13T23:58:23.197 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-portend. 2023-10-13T23:58:23.224 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../031-python3-portend_3.0.0-1_all.deb ... 2023-10-13T23:58:23.264 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-10-13T23:58:23.517 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-10-13T23:58:23.532 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../032-python3-zc.lockfile_2.0-1_all.deb ... 2023-10-13T23:58:23.566 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-10-13T23:58:23.845 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-13T23:58:23.874 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../033-python3-cherrypy3_18.6.1-4_all.deb ... 2023-10-13T23:58:23.911 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-10-13T23:58:24.282 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-natsort. 2023-10-13T23:58:24.309 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../034-python3-natsort_8.0.2-1_all.deb ... 2023-10-13T23:58:24.348 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-10-13T23:58:24.693 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-logutils. 2023-10-13T23:58:24.720 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-8_all.deb ... 2023-10-13T23:58:24.768 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-10-13T23:58:25.121 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-13T23:58:25.148 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../036-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-10-13T23:58:25.188 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-10-13T23:58:25.491 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-mako. 2023-10-13T23:58:25.518 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../037-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-10-13T23:58:25.557 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-13T23:58:25.894 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-13T23:58:25.923 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-13T23:58:25.960 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-13T23:58:26.466 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-13T23:58:26.492 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-10-13T23:58:26.541 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-10-13T23:58:26.844 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-webob. 2023-10-13T23:58:26.871 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-10-13T23:58:26.911 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-10-13T23:58:27.265 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-waitress. 2023-10-13T23:58:27.292 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../041-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-10-13T23:58:27.335 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-13T23:58:27.669 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-tempita. 2023-10-13T23:58:27.696 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../042-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-10-13T23:58:27.744 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-10-13T23:58:28.039 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-paste. 2023-10-13T23:58:28.066 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../043-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-10-13T23:58:28.114 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-10-13T23:58:28.435 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-13T23:58:28.462 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../044-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-10-13T23:58:28.502 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-10-13T23:58:28.789 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-13T23:58:28.815 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../045-python3-pastedeploy_2.1.1-1_all.deb ... 2023-10-13T23:58:28.855 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-10-13T23:58:29.176 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-webtest. 2023-10-13T23:58:29.203 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../046-python3-webtest_2.0.35-1_all.deb ... 2023-10-13T23:58:29.243 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-10-13T23:58:29.530 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pecan. 2023-10-13T23:58:29.556 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../047-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-10-13T23:58:29.596 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-10-13T23:58:29.919 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-certifi. 2023-10-13T23:58:29.935 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../048-python3-certifi_2020.6.20-1_all.deb ... 2023-10-13T23:58:29.969 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-10-13T23:58:30.290 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-idna. 2023-10-13T23:58:30.317 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../049-python3-idna_3.3-1_all.deb ... 2023-10-13T23:58:30.357 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-idna (3.3-1) ... 2023-10-13T23:58:30.669 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-urllib3. 2023-10-13T23:58:30.696 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../050-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-10-13T23:58:30.821 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-10-13T23:58:31.898 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-requests. 2023-10-13T23:58:31.925 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../051-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-10-13T23:58:31.965 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-13T23:58:32.227 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-13T23:58:32.254 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../052-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-10-13T23:58:32.285 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-13T23:58:32.573 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-13T23:58:32.599 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../053-ceph-mgr-modules-core_18.0.0-6724-g01fff6a7-1jammy_all.deb ... 2023-10-13T23:58:32.639 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:32.996 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-13T23:58:33.022 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../054-libsqlite3-mod-ceph_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:33.062 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:33.383 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-openssl. 2023-10-13T23:58:33.410 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../055-python3-openssl_21.0.0-1_all.deb ... 2023-10-13T23:58:33.449 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-10-13T23:58:33.737 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr. 2023-10-13T23:58:33.763 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../056-ceph-mgr_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:33.795 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:34.216 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mon. 2023-10-13T23:58:34.243 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../057-ceph-mon_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:34.282 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mon (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:35.187 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-osd. 2023-10-13T23:58:35.214 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../058-ceph-osd_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:35.253 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-osd (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:37.158 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph. 2023-10-13T23:58:37.173 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../059-ceph_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:37.216 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:37.545 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-fuse. 2023-10-13T23:58:37.571 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../060-ceph-fuse_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:37.611 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-fuse (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:37.957 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mds. 2023-10-13T23:58:37.984 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../061-ceph-mds_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:38.024 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mds (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:38.395 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package cephadm. 2023-10-13T23:58:38.421 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../062-cephadm_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:38.461 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking cephadm (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:38.731 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-13T23:58:38.758 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../063-python3-asyncssh_2.5.0-1_all.deb ... 2023-10-13T23:58:38.789 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-10-13T23:58:39.143 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python-babel-localedata. 2023-10-13T23:58:39.160 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../064-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-10-13T23:58:39.202 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-13T23:58:40.242 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-babel. 2023-10-13T23:58:40.269 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../065-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-10-13T23:58:40.308 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-10-13T23:58:40.646 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-jinja2. 2023-10-13T23:58:40.673 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../066-python3-jinja2_3.0.3-1_all.deb ... 2023-10-13T23:58:40.712 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-10-13T23:58:41.084 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-13T23:58:41.111 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../067-ceph-mgr-cephadm_18.0.0-6724-g01fff6a7-1jammy_all.deb ... 2023-10-13T23:58:41.150 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:41.455 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-13T23:58:41.482 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../068-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-10-13T23:58:41.521 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-10-13T23:58:41.843 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-13T23:58:41.869 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../069-python3-repoze.lru_0.7-2_all.deb ... 2023-10-13T23:58:41.908 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-13T23:58:42.187 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-routes. 2023-10-13T23:58:42.214 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../070-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-10-13T23:58:42.254 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-10-13T23:58:42.592 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-13T23:58:42.618 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../071-ceph-mgr-dashboard_18.0.0-6724-g01fff6a7-1jammy_all.deb ... 2023-10-13T23:58:42.658 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:43.096 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-10-13T23:58:43.115 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../072-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-10-13T23:58:43.154 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-13T23:58:43.659 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-joblib. 2023-10-13T23:58:43.687 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../073-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-10-13T23:58:43.726 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-10-13T23:58:44.097 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-10-13T23:58:44.124 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../074-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-10-13T23:58:44.155 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-10-13T23:58:44.501 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-sklearn. 2023-10-13T23:58:44.528 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../075-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-10-13T23:58:44.577 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-13T23:58:45.305 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-13T23:58:45.332 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../076-ceph-mgr-diskprediction-local_18.0.0-6724-g01fff6a7-1jammy_all.deb ... 2023-10-13T23:58:45.371 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:46.392 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-cachetools. 2023-10-13T23:58:46.419 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../077-python3-cachetools_5.0.0-1_all.deb ... 2023-10-13T23:58:46.458 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-10-13T23:58:46.720 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-13T23:58:46.747 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../078-python3-pyasn1_0.4.8-1_all.deb ... 2023-10-13T23:58:46.779 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-10-13T23:58:47.108 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-13T23:58:47.135 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../079-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-10-13T23:58:47.175 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-10-13T23:58:47.512 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-rsa. 2023-10-13T23:58:47.539 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../080-python3-rsa_4.8-1_all.deb ... 2023-10-13T23:58:47.579 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-rsa (4.8-1) ... 2023-10-13T23:58:47.842 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-google-auth. 2023-10-13T23:58:47.869 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../081-python3-google-auth_1.5.1-3_all.deb ... 2023-10-13T23:58:47.900 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-10-13T23:58:48.195 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-13T23:58:48.214 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../082-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-10-13T23:58:48.254 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-13T23:58:48.660 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-websocket. 2023-10-13T23:58:48.687 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../083-python3-websocket_1.2.3-1_all.deb ... 2023-10-13T23:58:48.726 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-10-13T23:58:48.998 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-13T23:58:49.025 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../084-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-10-13T23:58:49.064 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-13T23:58:49.739 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-13T23:58:49.766 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../085-ceph-mgr-k8sevents_18.0.0-6724-g01fff6a7-1jammy_all.deb ... 2023-10-13T23:58:49.805 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:50.125 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-13T23:58:50.153 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../086-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-10-13T23:58:50.200 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-13T23:58:50.530 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-13T23:58:50.556 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../087-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-10-13T23:58:50.596 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-13T23:58:50.874 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package jq. 2023-10-13T23:58:50.890 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../088-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-10-13T23:58:50.932 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-10-13T23:58:51.177 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package socat. 2023-10-13T23:58:51.193 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../089-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-10-13T23:58:51.227 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-10-13T23:58:51.618 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package xmlstarlet. 2023-10-13T23:58:51.645 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../090-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-10-13T23:58:51.681 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-10-13T23:58:52.046 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-test. 2023-10-13T23:58:52.074 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../091-ceph-test_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:52.104 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-test (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:54.443 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package ceph-volume. 2023-10-13T23:58:54.470 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../092-ceph-volume_18.0.0-6724-g01fff6a7-1jammy_all.deb ... 2023-10-13T23:58:54.509 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking ceph-volume (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:54.806 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-13T23:58:54.822 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../093-libcephfs-dev_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:58:54.864 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libcephfs-dev (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:58:55.294 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package nvme-cli. 2023-10-13T23:58:55.321 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../094-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-10-13T23:58:55.360 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-10-13T23:58:55.692 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-13T23:58:55.719 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../095-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-10-13T23:58:55.759 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-10-13T23:58:56.196 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-iniconfig. 2023-10-13T23:58:56.223 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../096-python3-iniconfig_1.1.1-2_all.deb ... 2023-10-13T23:58:56.262 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-10-13T23:58:56.608 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pastescript. 2023-10-13T23:58:56.635 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2023-10-13T23:58:56.683 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-13T23:58:57.013 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pluggy. 2023-10-13T23:58:57.040 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-7.1_all.deb ... 2023-10-13T23:58:57.079 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-10-13T23:58:57.408 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-psutil. 2023-10-13T23:58:57.436 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../099-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-10-13T23:58:57.475 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-10-13T23:58:57.879 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-py. 2023-10-13T23:58:57.906 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../100-python3-py_1.10.0-1_all.deb ... 2023-10-13T23:58:57.954 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-py (1.10.0-1) ... 2023-10-13T23:58:58.225 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pygments. 2023-10-13T23:58:58.241 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../101-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-10-13T23:58:58.283 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-10-13T23:58:58.738 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-13T23:58:58.766 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../102-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-10-13T23:58:58.805 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-10-13T23:58:59.083 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-toml. 2023-10-13T23:58:59.111 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../103-python3-toml_0.10.2-1_all.deb ... 2023-10-13T23:58:59.150 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-10-13T23:58:59.454 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-pytest. 2023-10-13T23:58:59.481 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../104-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-10-13T23:58:59.521 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-10-13T23:58:59.825 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package python3-simplejson. 2023-10-13T23:58:59.841 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../105-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-10-13T23:58:59.883 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-10-13T23:59:00.137 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-13T23:59:00.164 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../106-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-10-13T23:59:00.203 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-10-13T23:59:00.984 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package radosgw. 2023-10-13T23:59:01.011 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../107-radosgw_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:59:01.050 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking radosgw (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:01.779 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package rbd-fuse. 2023-10-13T23:59:01.796 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../108-rbd-fuse_18.0.0-6724-g01fff6a7-1jammy_amd64.deb ... 2023-10-13T23:59:01.829 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking rbd-fuse (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:02.118 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-10-13T23:59:02.354 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-10-13T23:59:02.463 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-10-13T23:59:02.694 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-10-13T23:59:03.050 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-10-13T23:59:03.486 INFO:teuthology.orchestra.run.smithi191.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-10-13T23:59:03.598 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up cephadm (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:04.183 INFO:teuthology.orchestra.run.smithi191.stdout:Adding system user cephadm....done 2023-10-13T23:59:04.346 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-10-13T23:59:04.622 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-10-13T23:59:04.865 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-10-13T23:59:04.991 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-10-13T23:59:05.251 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-13T23:59:05.509 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-10-13T23:59:05.611 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-py (1.10.0-1) ... 2023-10-13T23:59:05.912 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-10-13T23:59:06.272 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-10-13T23:59:06.532 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-10-13T23:59:06.916 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-10-13T23:59:07.167 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-10-13T23:59:07.426 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-10-13T23:59:07.911 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-ceph-argparse (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:08.170 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-10-13T23:59:08.296 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-10-13T23:59:08.547 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-10-13T23:59:08.673 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-10-13T23:59:09.041 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-10-13T23:59:09.167 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-10-13T23:59:09.459 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-10-13T23:59:09.711 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-10-13T23:59:10.003 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-10-13T23:59:10.655 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-10-13T23:59:10.939 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-10-13T23:59:11.066 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-10-13T23:59:11.192 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-10-13T23:59:11.492 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-10-13T23:59:11.894 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-10-13T23:59:12.137 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-10-13T23:59:12.488 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-10-13T23:59:12.764 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-10-13T23:59:13.107 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-10-13T23:59:13.358 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-10-13T23:59:13.484 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-ceph-common (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:13.769 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-idna (3.3-1) ... 2023-10-13T23:59:14.095 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-10-13T23:59:15.192 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-13T23:59:15.309 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-toml (0.10.2-1) ... 2023-10-13T23:59:15.569 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-10-13T23:59:15.695 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-10-13T23:59:15.804 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-10-13T23:59:16.114 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-10-13T23:59:16.373 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-10-13T23:59:16.624 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-13T23:59:16.750 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-10-13T23:59:16.859 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-10-13T23:59:17.161 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-10-13T23:59:17.420 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-10-13T23:59:17.679 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-10-13T23:59:17.931 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-13T23:59:18.181 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-10-13T23:59:18.441 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-10-13T23:59:18.567 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-10-13T23:59:18.835 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-10-13T23:59:18.952 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-10-13T23:59:19.245 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-10-13T23:59:19.521 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-10-13T23:59:19.764 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-10-13T23:59:20.141 INFO:teuthology.orchestra.run.smithi191.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-10-13T23:59:20.391 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-10-13T23:59:20.501 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-10-13T23:59:20.877 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-10-13T23:59:21.137 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-portend (3.0.0-1) ... 2023-10-13T23:59:21.388 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-10-13T23:59:21.489 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-10-13T23:59:21.806 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-10-13T23:59:22.107 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-10-13T23:59:22.375 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-10-13T23:59:22.485 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rsa (4.8-1) ... 2023-10-13T23:59:22.744 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-10-13T23:59:23.020 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-10-13T23:59:23.287 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-10-13T23:59:23.664 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-13T23:59:23.948 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-10-13T23:59:24.309 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-10-13T23:59:24.443 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librados2 (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:24.553 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librgw2 (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:24.678 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:24.804 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libcephfs2 (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:24.930 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libradosstriper1 (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:25.142 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-10-13T23:59:25.410 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up librbd1 (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:25.544 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-modules-core (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:25.654 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-fuse (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:25.858 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-13T23:59:25.859 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-13T23:59:26.338 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libcephfs-dev (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:26.464 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rados (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:26.590 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-10-13T23:59:27.844 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rbd (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:27.954 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up rbd-fuse (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:28.055 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-rgw (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:28.172 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up python3-cephfs (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:28.298 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-common (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:28.840 INFO:teuthology.orchestra.run.smithi191.stdout:Adding group ceph....done 2023-10-13T23:59:29.217 INFO:teuthology.orchestra.run.smithi191.stdout:Adding system user ceph....done 2023-10-13T23:59:29.394 INFO:teuthology.orchestra.run.smithi191.stdout:Setting system user ceph properties....done 2023-10-13T23:59:29.408 INFO:teuthology.orchestra.run.smithi191.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-13T23:59:29.545 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-13T23:59:29.942 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-13T23:59:30.490 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-test (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:30.616 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up radosgw (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:31.098 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-13T23:59:31.099 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-13T23:59:31.552 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-base (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:31.882 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-13T23:59:32.387 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mds (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:32.610 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-13T23:59:32.611 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-13T23:59:33.105 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:33.319 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-13T23:59:33.319 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-13T23:59:33.806 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-osd (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:34.140 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-13T23:59:34.140 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-13T23:59:34.691 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:34.809 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:34.952 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mon (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:35.147 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-13T23:59:35.147 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-13T23:59:35.644 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-cephadm (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:35.787 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:35.905 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-mgr-dashboard (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:36.039 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up ceph-volume (18.0.0-6724-g01fff6a7-1jammy) ... 2023-10-13T23:59:36.384 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-13T23:59:37.518 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-13T23:59:37.978 INFO:teuthology.orchestra.run.smithi191.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-13T23:59:37.981 DEBUG:teuthology.parallel:result is None 2023-10-13T23:59:37.981 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=01fff6a72a328459c1d153e5dc1de6a34e48a82f 2023-10-13T23:59:38.121 DEBUG:teuthology.orchestra.run.smithi191:> dpkg-query -W -f '${Version}' ceph 2023-10-13T23:59:38.140 INFO:teuthology.orchestra.run.smithi191.stdout:18.0.0-6724-g01fff6a7-1jammy 2023-10-13T23:59:38.141 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6724-g01fff6a7-1jammy 2023-10-13T23:59:38.141 INFO:teuthology.task.install:The correct ceph version 18.0.0-6724-g01fff6a7-1jammy is installed. 2023-10-13T23:59:38.142 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-13T23:59:38.142 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:38.143 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-13T23:59:38.195 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-13T23:59:38.196 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:38.196 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2023-10-13T23:59:38.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-13T23:59:38.307 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-13T23:59:38.307 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:38.308 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-13T23:59:38.363 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-13T23:59:38.418 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-13T23:59:38.419 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:38.419 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2023-10-13T23:59:38.474 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-13T23:59:38.527 INFO:teuthology.run_tasks:Running task ceph... 2023-10-13T23:59:38.603 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-13T23:59:38.604 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /var/log/ceph 2023-10-13T23:59:38.616 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-13T23:59:38.617 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-13T23:59:38.671 INFO:tasks.ceph:Creating extra log directories... 2023-10-13T23:59:38.672 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-13T23:59:38.738 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-13T23:59:38.739 INFO:tasks.ceph:config {'conf': {'client': {'rbd default features': 125}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'debug rbd': 20}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-13T23:59:38.739 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi/7427261', 'branch': 'wip-dis-testing', 'description': 'rbd/cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} data-pool/none features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd_support_module_recovery}', 'email': 'idryomov@gmail.com', 'first_in_suite': False, 'job_id': '7427261', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-dis-testing'}, 'ceph': {'conf': {'client': {'rbd default features': 125}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'debug rbd': 20}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'sha1': '01fff6a72a328459c1d153e5dc1de6a34e48a82f'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '01fff6a72a328459c1d153e5dc1de6a34e48a82f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-dis-testing-qa', 'sha1': '735f68d7bf91d643813a8420fc2b11441f4bd8c4'}}, 'owner': 'scheduled_dis@teuthology', 'priority': 74, 'repo': 'https://github.com/ceph/ceph-ci', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 2449, 'sha1': '01fff6a72a328459c1d153e5dc1de6a34e48a82f', 'sleep_before_teardown': 0, 'subset': '49/99', 'suite': 'rbd', 'suite_branch': 'wip-dis-testing-qa', 'suite_path': '/home/teuthworker/src/github.com_idryomov_ceph_735f68d7bf91d643813a8420fc2b11441f4bd8c4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/idryomov/ceph', 'suite_sha1': '735f68d7bf91d643813a8420fc2b11441f4bd8c4', 'targets': {'smithi191.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDTJq5pXYPXVKv8Nn2/FrTO6TzhVPDH1QVWF6NYsuEQy0i/oqu7ud7tCXtWBWffCbWG//LTv2bp/u1KekRrIZaE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'install': {'extra_system_packages': ['fio']}}, {'workunit': {'clients': {'client.0': ['rbd/rbd_support_module_recovery.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-13_23:35:38', 'tube': 'smithi', 'user': 'dis', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-13T23:59:38.740 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-13T23:59:38.772 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/run/ceph 2023-10-13T23:59:38.828 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:38.829 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2023-10-13T23:59:38.879 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-13T23:59:38.880 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2023-10-13T23:59:38.929 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-13T23:59:38.929 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-13T23:59:38.929 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 887 Links: 1 2023-10-13T23:59:38.930 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-13T23:59:38.930 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-10-13 23:54:30.003261799 +0000 2023-10-13T23:59:38.930 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-10-13 23:54:29.627265158 +0000 2023-10-13T23:59:38.931 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-10-13 23:54:29.627265158 +0000 2023-10-13T23:59:38.931 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-10-13T23:59:38.931 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-13T23:59:38.983 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-10-13T23:59:38.983 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-10-13T23:59:38.984 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000423875 s, 1.2 MB/s 2023-10-13T23:59:38.985 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-13T23:59:39.034 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2023-10-13T23:59:39.083 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-13T23:59:39.084 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-13T23:59:39.084 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 907 Links: 1 2023-10-13T23:59:39.085 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-13T23:59:39.085 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-10-13 23:54:30.595256511 +0000 2023-10-13T23:59:39.085 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-10-13 23:54:30.243259656 +0000 2023-10-13T23:59:39.086 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-10-13 23:54:30.243259656 +0000 2023-10-13T23:59:39.086 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-10-13T23:59:39.086 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-13T23:59:39.138 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-10-13T23:59:39.138 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-10-13T23:59:39.139 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000313139 s, 1.6 MB/s 2023-10-13T23:59:39.140 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-13T23:59:39.189 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2023-10-13T23:59:39.236 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-13T23:59:39.237 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-13T23:59:39.237 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 927 Links: 1 2023-10-13T23:59:39.237 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-13T23:59:39.237 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-10-13 23:54:31.151251546 +0000 2023-10-13T23:59:39.237 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-10-13 23:54:30.831254403 +0000 2023-10-13T23:59:39.238 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-10-13 23:54:30.831254403 +0000 2023-10-13T23:59:39.238 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-10-13T23:59:39.238 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-13T23:59:39.291 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-10-13T23:59:39.291 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-10-13T23:59:39.291 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000397086 s, 1.3 MB/s 2023-10-13T23:59:39.292 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-13T23:59:39.345 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2023-10-13T23:59:39.392 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-13T23:59:39.392 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-13T23:59:39.392 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 942 Links: 1 2023-10-13T23:59:39.393 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-13T23:59:39.393 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2023-10-13 23:54:31.747246222 +0000 2023-10-13T23:59:39.393 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2023-10-13 23:54:31.395249365 +0000 2023-10-13T23:59:39.393 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2023-10-13 23:54:31.395249365 +0000 2023-10-13T23:59:39.393 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2023-10-13T23:59:39.394 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-13T23:59:39.446 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2023-10-13T23:59:39.446 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2023-10-13T23:59:39.446 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000311177 s, 1.6 MB/s 2023-10-13T23:59:39.447 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-13T23:59:39.500 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-10-13T23:59:39.501 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-10-13T23:59:39.501 INFO:tasks.ceph:Generating config... 2023-10-13T23:59:39.502 INFO:tasks.ceph:[client] rbd default features = 125 2023-10-13T23:59:39.503 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-10-13T23:59:39.503 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-10-13T23:59:39.503 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-10-13T23:59:39.503 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-13T23:59:39.504 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-13T23:59:39.504 INFO:tasks.ceph:[mgr] debug rbd = 20 2023-10-13T23:59:39.504 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-13T23:59:39.505 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-13T23:59:39.505 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-13T23:59:39.505 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-13T23:59:39.505 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2023-10-13T23:59:39.506 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-10-13T23:59:39.506 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-13T23:59:39.506 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-13T23:59:39.506 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-13T23:59:39.507 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-13T23:59:39.507 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-13T23:59:39.507 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-13T23:59:39.508 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-13T23:59:39.508 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-13T23:59:39.508 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-13T23:59:39.508 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-13T23:59:39.509 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-13T23:59:39.509 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-10-13T23:59:39.509 INFO:tasks.ceph:Setting up mon.a... 2023-10-13T23:59:39.510 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-13T23:59:39.575 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.keyring 2023-10-13T23:59:39.587 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-13T23:59:39.664 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-13T23:59:39.719 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.191')] 2023-10-13T23:59:39.719 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.191', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug rbd': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default features': 125}, 'mon.a': {}} 2023-10-13T23:59:39.720 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:39.721 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-13T23:59:39.768 DEBUG:teuthology.orchestra.run.smithi191:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.191 --print /home/ubuntu/cephtest/ceph.monmap 2023-10-13T23:59:39.847 INFO:teuthology.orchestra.run.smithi191.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-13T23:59:39.847 INFO:teuthology.orchestra.run.smithi191.stdout:monmaptool: generated fsid 45aee46f-9711-4acb-8786-feff8e40632d 2023-10-13T23:59:39.847 INFO:teuthology.orchestra.run.smithi191.stdout:setting min_mon_release = pacific 2023-10-13T23:59:39.847 INFO:teuthology.orchestra.run.smithi191.stdout:epoch 0 2023-10-13T23:59:39.848 INFO:teuthology.orchestra.run.smithi191.stdout:fsid 45aee46f-9711-4acb-8786-feff8e40632d 2023-10-13T23:59:39.848 INFO:teuthology.orchestra.run.smithi191.stdout:last_changed 2023-10-13T23:59:39.848203+0000 2023-10-13T23:59:39.848 INFO:teuthology.orchestra.run.smithi191.stdout:created 2023-10-13T23:59:39.848203+0000 2023-10-13T23:59:39.848 INFO:teuthology.orchestra.run.smithi191.stdout:min_mon_release 16 (pacific) 2023-10-13T23:59:39.848 INFO:teuthology.orchestra.run.smithi191.stdout:election_strategy: 1 2023-10-13T23:59:39.849 INFO:teuthology.orchestra.run.smithi191.stdout:0: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.a 2023-10-13T23:59:39.849 INFO:teuthology.orchestra.run.smithi191.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-10-13T23:59:39.850 DEBUG:teuthology.orchestra.run.smithi191:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-13T23:59:39.896 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 45aee46f-9711-4acb-8786-feff8e40632d... 2023-10-13T23:59:39.897 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-13T23:59:39.969 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2023-10-13T23:59:39.970 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2023-10-13T23:59:39.970 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-13T23:59:39.970 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2023-10-13T23:59:39.970 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.970 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2023-10-13T23:59:39.971 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.971 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2023-10-13T23:59:39.971 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.971 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2023-10-13T23:59:39.971 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2023-10-13T23:59:39.972 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.972 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2023-10-13T23:59:39.972 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2023-10-13T23:59:39.972 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.972 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-13T23:59:39.973 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2023-10-13T23:59:39.973 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.973 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2023-10-13T23:59:39.973 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-13T23:59:39.973 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.974 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2023-10-13T23:59:39.974 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.974 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2023-10-13T23:59:39.974 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2023-10-13T23:59:39.974 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2023-10-13T23:59:39.975 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2023-10-13T23:59:39.975 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2023-10-13T23:59:39.975 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2023-10-13T23:59:39.975 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2023-10-13T23:59:39.975 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-13T23:59:39.976 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-13T23:59:39.976 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2023-10-13T23:59:39.976 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.976 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-13T23:59:39.976 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.977 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2023-10-13T23:59:39.977 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.977 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2023-10-13T23:59:39.977 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.977 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2023-10-13T23:59:39.977 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2023-10-13T23:59:39.978 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2023-10-13T23:59:39.978 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = 172.21.15.191 2023-10-13T23:59:39.978 INFO:teuthology.orchestra.run.smithi191.stdout: mon client directed command retry = 5 2023-10-13T23:59:39.978 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on pool no app = False 2023-10-13T23:59:39.979 INFO:teuthology.orchestra.run.smithi191.stdout: ms inject socket failures = 5000 2023-10-13T23:59:39.979 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = 45aee46f-9711-4acb-8786-feff8e40632d 2023-10-13T23:59:39.979 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.979 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2023-10-13T23:59:39.979 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2023-10-13T23:59:39.980 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.980 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2023-10-13T23:59:39.980 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2023-10-13T23:59:39.980 INFO:teuthology.orchestra.run.smithi191.stdout: osd mclock profile = high_recovery_ops 2023-10-13T23:59:39.980 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.981 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2023-10-13T23:59:39.981 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2023-10-13T23:59:39.981 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.981 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2023-10-13T23:59:39.981 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2023-10-13T23:59:39.982 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2023-10-13T23:59:39.982 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.982 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2023-10-13T23:59:39.982 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2023-10-13T23:59:39.982 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.983 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2023-10-13T23:59:39.983 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.983 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2023-10-13T23:59:39.983 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.983 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2023-10-13T23:59:39.984 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.984 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2023-10-13T23:59:39.984 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2023-10-13T23:59:39.984 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.984 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2023-10-13T23:59:39.985 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2023-10-13T23:59:39.985 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2023-10-13T23:59:39.985 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore compression algorithm = lz4 2023-10-13T23:59:39.985 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore compression mode = aggressive 2023-10-13T23:59:39.985 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2023-10-13T23:59:39.985 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 1/20 2023-10-13T23:59:39.986 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 1/20 2023-10-13T23:59:39.986 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-13T23:59:39.986 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2023-10-13T23:59:39.986 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 4/10 2023-10-13T23:59:39.986 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2023-10-13T23:59:39.987 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2023-10-13T23:59:39.987 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2023-10-13T23:59:39.987 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2023-10-13T23:59:39.987 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2023-10-13T23:59:39.987 INFO:teuthology.orchestra.run.smithi191.stdout: osd shutdown pgref assert = True 2023-10-13T23:59:39.988 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.988 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2023-10-13T23:59:39.988 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-13T23:59:39.988 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2023-10-13T23:59:39.988 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-10-13T23:59:39.988 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-10-13T23:59:39.989 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-10-13T23:59:39.989 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-10-13T23:59:39.989 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2023-10-13T23:59:39.989 INFO:teuthology.orchestra.run.smithi191.stdout: debug rbd = 20 2023-10-13T23:59:39.989 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.990 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2023-10-13T23:59:39.990 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2023-10-13T23:59:39.990 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2023-10-13T23:59:39.990 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2023-10-13T23:59:39.990 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2023-10-13T23:59:39.991 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2023-10-13T23:59:39.991 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2023-10-13T23:59:39.991 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2023-10-13T23:59:39.991 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2023-10-13T23:59:39.991 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2023-10-13T23:59:39.991 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2023-10-13T23:59:39.992 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.992 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-13T23:59:39.992 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2023-10-13T23:59:39.992 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2023-10-13T23:59:39.992 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.993 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2023-10-13T23:59:39.993 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-13T23:59:39.993 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-13T23:59:39.993 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.993 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2023-10-13T23:59:39.994 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2023-10-13T23:59:39.994 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.994 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2023-10-13T23:59:39.994 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:39.994 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2023-10-13T23:59:39.994 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2023-10-13T23:59:39.995 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2023-10-13T23:59:39.995 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2023-10-13T23:59:39.995 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-13T23:59:39.995 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-13T23:59:39.995 INFO:teuthology.orchestra.run.smithi191.stdout: rbd default features = 125 2023-10-13T23:59:39.996 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2023-10-13T23:59:39.997 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-13T23:59:39.997 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-13T23:59:40.089 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-13T23:59:40.090 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:40.090 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-13T23:59:40.095 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:40.096 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-13T23:59:40.144 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi191.front.sepia.ceph.com 2023-10-13T23:59:40.145 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:40.145 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-13T23:59:40.146 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-13T23:59:40.206 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:40.207 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-13T23:59:40.251 INFO:tasks.ceph:Setting up mon nodes... 2023-10-13T23:59:40.252 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-13T23:59:40.253 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-13T23:59:40.336 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-13T23:59:40.339 INFO:tasks.ceph:Setting up mds nodes... 2023-10-13T23:59:40.339 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-13T23:59:40.340 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-13T23:59:40.417 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-13T23:59:40.428 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-13T23:59:40.428 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-10-13T23:59:40.429 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-13T23:59:40.487 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-10-13T23:59:40.488 INFO:tasks.ceph:role: osd.0 2023-10-13T23:59:40.488 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-13T23:59:40.488 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-13T23:59:40.555 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-13T23:59:40.555 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-13T23:59:40.555 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-13T23:59:40.555 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-13T23:59:40.556 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-13T23:59:40.556 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-10-13T23:59:40.556 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-13T23:59:40.556 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-13T23:59:40.556 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-13T23:59:40.557 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-13T23:59:41.011 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-10-13T23:59:41.013 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-10-13T23:59:41.013 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-13T23:59:41.123 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-13T23:59:41.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-13T23:59:41.135 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: /sbin/restorecon: command not found 2023-10-13T23:59:41.135 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-13T23:59:41.191 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-10-13T23:59:41.191 INFO:tasks.ceph:role: osd.1 2023-10-13T23:59:41.191 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-13T23:59:41.192 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-13T23:59:41.257 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-13T23:59:41.257 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-13T23:59:41.257 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-13T23:59:41.258 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-13T23:59:41.258 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-13T23:59:41.258 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-10-13T23:59:41.258 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-13T23:59:41.258 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-13T23:59:41.259 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-13T23:59:41.259 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-13T23:59:41.729 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-10-13T23:59:41.731 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-10-13T23:59:41.731 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-13T23:59:41.881 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-13T23:59:41.892 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: /sbin/restorecon: command not found 2023-10-13T23:59:41.893 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-13T23:59:41.894 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-13T23:59:41.947 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-10-13T23:59:41.947 INFO:tasks.ceph:role: osd.2 2023-10-13T23:59:41.947 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-13T23:59:41.948 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-13T23:59:42.008 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-13T23:59:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-13T23:59:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-13T23:59:42.008 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-13T23:59:42.009 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-13T23:59:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2023-10-13T23:59:42.009 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-13T23:59:42.009 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-13T23:59:42.009 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-13T23:59:42.010 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-13T23:59:42.475 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2023-10-13T23:59:42.477 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2023-10-13T23:59:42.478 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-13T23:59:42.625 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-13T23:59:42.637 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: /sbin/restorecon: command not found 2023-10-13T23:59:42.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-13T23:59:42.638 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-13T23:59:42.752 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:42.750+0000 7f23a2be7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-13T23:59:42.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:42.750+0000 7f23a2be7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-13T23:59:42.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:42.750+0000 7f23a2be7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-13T23:59:42.753 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:42.750+0000 7f23a2be7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-13T23:59:42.754 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:42.750+0000 7f23a2be7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-13T23:59:42.754 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:42.750+0000 7f23a2be7640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-13T23:59:45.763 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-13T23:59:45.777 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-13T23:59:45.858 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:45.854+0000 7ff524d6a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-13T23:59:45.859 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:45.854+0000 7ff524d6a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-13T23:59:45.859 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:45.854+0000 7ff524d6a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-13T23:59:45.859 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:45.854+0000 7ff524d6a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-13T23:59:45.859 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:45.854+0000 7ff524d6a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-13T23:59:45.860 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:45.854+0000 7ff524d6a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-13T23:59:48.870 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-13T23:59:48.924 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-13T23:59:49.006 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:49.002+0000 7fbec6422640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-13T23:59:49.007 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:49.002+0000 7fbec6422640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-13T23:59:49.008 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:49.006+0000 7fbec6422640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-13T23:59:49.008 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:49.006+0000 7fbec6422640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-13T23:59:49.008 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:49.006+0000 7fbec6422640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-13T23:59:49.008 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-13T23:59:49.006+0000 7fbec6422640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-13T23:59:52.008 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-13T23:59:52.064 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-13T23:59:52.065 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:52.065 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-13T23:59:52.122 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:52.123 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-13T23:59:52.175 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:52.175 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-13T23:59:52.230 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:52.231 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-13T23:59:52.282 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:52.283 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-13T23:59:52.328 INFO:tasks.ceph:Adding keys to all mons... 2023-10-13T23:59:52.328 DEBUG:teuthology.orchestra.run.smithi191:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-13T23:59:52.382 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.x] 2023-10-13T23:59:52.382 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDs2SllZxkjFBAAY78eImwKVkTBHIdbNaGSnQ== 2023-10-13T23:59:52.382 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.0] 2023-10-13T23:59:52.382 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDu2Sllu1frLBAAu8UL1xfjDF6breD5uqvrgQ== 2023-10-13T23:59:52.383 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.1] 2023-10-13T23:59:52.383 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDx2Sllhks2MxAALJ+DktLo4HxN3hkllZ64yQ== 2023-10-13T23:59:52.383 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.2] 2023-10-13T23:59:52.383 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQD12Sll/GB7ABAAMekRVA0uUouiuGXaM4HurQ== 2023-10-13T23:59:52.383 INFO:teuthology.orchestra.run.smithi191.stdout:[client.0] 2023-10-13T23:59:52.384 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQDs2Sllxs/5GBAAUDGMwW/yokJFNxuqLXz6fw== 2023-10-13T23:59:52.385 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-13T23:59:52.472 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-13T23:59:52.556 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-13T23:59:52.638 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-13T23:59:52.718 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-13T23:59:52.800 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-13T23:59:52.801 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-13T23:59:52.854 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-13T23:59:52.948 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-13T23:59:52.959 DEBUG:teuthology.orchestra.run.smithi191:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-13T23:59:53.011 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-13T23:59:53.011 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-13T23:59:53.012 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-13T23:59:53.057 INFO:tasks.ceph.mon.a:Started 2023-10-13T23:59:53.057 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-13T23:59:53.058 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-13T23:59:53.058 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-13T23:59:53.060 INFO:tasks.ceph.mgr.x:Started 2023-10-13T23:59:53.060 INFO:tasks.ceph:Setting crush tunables to default 2023-10-13T23:59:53.061 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd crush tunables default 2023-10-13T23:59:53.327 INFO:teuthology.orchestra.run.smithi191.stderr:adjusted tunables profile to default 2023-10-13T23:59:53.344 INFO:tasks.ceph:check_enable_crimson: False 2023-10-13T23:59:53.345 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-13T23:59:53.345 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:53.345 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-13T23:59:53.355 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:53.356 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-13T23:59:53.413 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-13T23:59:53.413 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-13T23:59:53.471 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new ad26bebb-f6ee-40e4-8bf6-3231095fe456 0 2023-10-13T23:59:53.491 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:53.486+0000 7f3e2f00a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-13T23:59:53.691 INFO:teuthology.orchestra.run.smithi191.stdout:0 2023-10-13T23:59:53.709 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new fe08648a-14db-41f2-990d-2d94f09e937e 1 2023-10-13T23:59:53.920 INFO:teuthology.orchestra.run.smithi191.stdout:1 2023-10-13T23:59:53.940 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 8fd960bd-52c1-4fa2-9144-79ebbcebc0fd 2 2023-10-13T23:59:54.062 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:54.058+0000 7f3e2f00a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-13T23:59:54.136 INFO:teuthology.orchestra.run.smithi191.stdout:2 2023-10-13T23:59:54.152 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-13T23:59:54.153 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-13T23:59:54.155 INFO:tasks.ceph.osd.0:Started 2023-10-13T23:59:54.156 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-13T23:59:54.156 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-13T23:59:54.158 INFO:tasks.ceph.osd.1:Started 2023-10-13T23:59:54.158 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-13T23:59:54.159 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-13T23:59:54.160 INFO:tasks.ceph.osd.2:Started 2023-10-13T23:59:54.161 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-13T23:59:54.268 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:54.266+0000 7f3e2f00a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-13T23:59:54.337 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-13T23:59:54.338 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":5,"fsid":"45aee46f-9711-4acb-8786-feff8e40632d","created":"2023-10-13T23:59:53.196388+0000","modified":"2023-10-13T23:59:54.136833+0000","last_up_change":"0.000000","last_in_change":"2023-10-13T23:59:54.136833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ad26bebb-f6ee-40e4-8bf6-3231095fe456","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fe08648a-14db-41f2-990d-2d94f09e937e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8fd960bd-52c1-4fa2-9144-79ebbcebc0fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-13T23:59:54.355 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-13T23:59:54.355 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-13T23:59:54.657 DEBUG:teuthology.orchestra.run.smithi191:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-13T23:59:54.760 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-13T23:59:54.758+0000 7f3057e89640 -1 Falling back to public interface 2023-10-13T23:59:54.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-13T23:59:54.770+0000 7f3f47583640 -1 Falling back to public interface 2023-10-13T23:59:54.772 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-13T23:59:54.770+0000 7fa6673a3640 -1 Falling back to public interface 2023-10-13T23:59:54.833 INFO:teuthology.misc.health.smithi191.stdout: 2023-10-13T23:59:54.834 INFO:teuthology.misc.health.smithi191.stdout:{"epoch":5,"fsid":"45aee46f-9711-4acb-8786-feff8e40632d","created":"2023-10-13T23:59:53.196388+0000","modified":"2023-10-13T23:59:54.136833+0000","last_up_change":"0.000000","last_in_change":"2023-10-13T23:59:54.136833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ad26bebb-f6ee-40e4-8bf6-3231095fe456","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fe08648a-14db-41f2-990d-2d94f09e937e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8fd960bd-52c1-4fa2-9144-79ebbcebc0fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-13T23:59:54.848 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-10-13T23:59:54.864 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:54.862+0000 7f3e2f00a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-13T23:59:54.918 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:54.914+0000 7f3e2f00a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-13T23:59:54.969 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:54.966+0000 7f3e2f00a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-13T23:59:55.045 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:55.042+0000 7f3e2f00a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-13T23:59:55.097 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:55.094+0000 7f3e2f00a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-13T23:59:55.172 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:55.170+0000 7f3e2f00a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-13T23:59:55.224 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:55.222+0000 7f3e2f00a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-13T23:59:55.361 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:55.358+0000 7f3e2f00a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-13T23:59:55.420 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:55.418+0000 7f3e2f00a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-13T23:59:56.088 INFO:tasks.ceph.mgr.x.smithi191.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-10-13T23:59:56.089 INFO:tasks.ceph.mgr.x.smithi191.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-10-13T23:59:56.089 INFO:tasks.ceph.mgr.x.smithi191.stderr: from numpy import show_config as show_numpy_config 2023-10-13T23:59:56.163 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:56.158+0000 7f3e2f00a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-13T23:59:56.332 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:56.330+0000 7f3e2f00a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-13T23:59:56.507 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:56.506+0000 7f3e2f00a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-13T23:59:56.577 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:56.574+0000 7f3e2f00a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-13T23:59:56.711 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:56.706+0000 7f3e2f00a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-13T23:59:57.352 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:57.350+0000 7f3e2f00a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-13T23:59:57.426 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:57.422+0000 7f3e2f00a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-13T23:59:57.603 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:57.598+0000 7f3e2f00a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-13T23:59:57.675 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:57.674+0000 7f3e2f00a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-13T23:59:57.997 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:57.994+0000 7f3e2f00a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-13T23:59:58.056 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-13T23:59:58.054+0000 7f3e2f00a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-13T23:59:58.584 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-13T23:59:58.582+0000 7fa6673a3640 -1 osd.2 0 log_to_monitors true 2023-10-13T23:59:58.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-13T23:59:58.682+0000 7f3f47583640 -1 osd.1 0 log_to_monitors true 2023-10-13T23:59:58.690 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-13T23:59:58.686+0000 7f3057e89640 -1 osd.0 0 log_to_monitors true 2023-10-14T00:00:01.110 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:00:01.106+0000 7f3dd6781640 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-14T00:00:01.151 DEBUG:teuthology.orchestra.run.smithi191:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T00:00:01.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:00:01.262+0000 7f3f4352b640 -1 osd.1 0 waiting for initial osdmap 2023-10-14T00:00:01.294 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:00:01.290+0000 7f3053e31640 -1 osd.0 0 waiting for initial osdmap 2023-10-14T00:00:01.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:00:01.302+0000 7f3f3b360640 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T00:00:01.325 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:00:01.322+0000 7fa66334b640 -1 osd.2 0 waiting for initial osdmap 2023-10-14T00:00:01.339 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:00:01.338+0000 7f304bc66640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T00:00:01.359 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:00:01.358+0000 7fa65b180640 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T00:00:01.463 INFO:teuthology.misc.health.smithi191.stdout: 2023-10-14T00:00:01.463 INFO:teuthology.misc.health.smithi191.stdout:{"epoch":7,"fsid":"45aee46f-9711-4acb-8786-feff8e40632d","created":"2023-10-13T23:59:53.196388+0000","modified":"2023-10-14T00:00:00.144583+0000","last_up_change":"0.000000","last_in_change":"2023-10-13T23:59:54.136833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ad26bebb-f6ee-40e4-8bf6-3231095fe456","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fe08648a-14db-41f2-990d-2d94f09e937e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8fd960bd-52c1-4fa2-9144-79ebbcebc0fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T00:00:01.478 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-10-14T00:00:07.781 DEBUG:teuthology.orchestra.run.smithi191:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T00:00:08.072 INFO:teuthology.misc.health.smithi191.stdout: 2023-10-14T00:00:08.072 INFO:teuthology.misc.health.smithi191.stdout:{"epoch":12,"fsid":"45aee46f-9711-4acb-8786-feff8e40632d","created":"2023-10-13T23:59:53.196388+0000","modified":"2023-10-14T00:00:06.346656+0000","last_up_change":"2023-10-14T00:00:02.297223+0000","last_in_change":"2023-10-13T23:59:54.136833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T00:00:04.183601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad26bebb-f6ee-40e4-8bf6-3231095fe456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6801","nonce":2437613027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6803","nonce":2437613027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6807","nonce":2437613027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6805","nonce":2437613027}]},"public_addr":"172.21.15.191:6801/2437613027","cluster_addr":"172.21.15.191:6803/2437613027","heartbeat_back_addr":"172.21.15.191:6807/2437613027","heartbeat_front_addr":"172.21.15.191:6805/2437613027","state":["exists","up"]},{"osd":1,"uuid":"fe08648a-14db-41f2-990d-2d94f09e937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6810","nonce":769566580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6814","nonce":769566580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6822","nonce":769566580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6818","nonce":769566580}]},"public_addr":"172.21.15.191:6810/769566580","cluster_addr":"172.21.15.191:6814/769566580","heartbeat_back_addr":"172.21.15.191:6822/769566580","heartbeat_front_addr":"172.21.15.191:6818/769566580","state":["exists","up"]},{"osd":2,"uuid":"8fd960bd-52c1-4fa2-9144-79ebbcebc0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6811","nonce":26623802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6815","nonce":26623802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6823","nonce":26623802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6819","nonce":26623802}]},"public_addr":"172.21.15.191:6811/26623802","cluster_addr":"172.21.15.191:6815/26623802","heartbeat_back_addr":"172.21.15.191:6823/26623802","heartbeat_front_addr":"172.21.15.191:6819/26623802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-13T23:59:59.739091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-13T23:59:59.682828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-13T23:59:59.560459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T00:00:08.088 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-10-14T00:00:08.089 INFO:tasks.ceph:Creating RBD pool 2023-10-14T00:00:08.089 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-14T00:00:09.142 INFO:teuthology.orchestra.run.smithi191.stderr:pool 'rbd' created 2023-10-14T00:00:09.171 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-14T00:00:10.144 INFO:teuthology.orchestra.run.smithi191.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-14T00:00:10.175 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T00:00:10.176 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T00:00:10.176 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T00:00:10.177 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T00:00:10.177 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T00:00:10.509 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T00:00:10.527 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":1288450167},{"type":"v1","addr":"172.21.15.191:6825","nonce":1288450167}]},"active_addr":"172.21.15.191:6825/1288450167","active_change":"2023-10-14T00:00:00.098938+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":939764850}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":1602462974}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":2953257084}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.191:0","nonce":1742227298}]}]} 2023-10-14T00:00:10.530 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T00:00:10.530 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T00:00:10.530 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T00:00:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T00:00:10.803 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":14,"fsid":"45aee46f-9711-4acb-8786-feff8e40632d","created":"2023-10-13T23:59:53.196388+0000","modified":"2023-10-14T00:00:10.143547+0000","last_up_change":"2023-10-14T00:00:02.297223+0000","last_in_change":"2023-10-13T23:59:54.136833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T00:00:04.183601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-14T00:00:08.397834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad26bebb-f6ee-40e4-8bf6-3231095fe456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6801","nonce":2437613027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6803","nonce":2437613027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6807","nonce":2437613027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6805","nonce":2437613027}]},"public_addr":"172.21.15.191:6801/2437613027","cluster_addr":"172.21.15.191:6803/2437613027","heartbeat_back_addr":"172.21.15.191:6807/2437613027","heartbeat_front_addr":"172.21.15.191:6805/2437613027","state":["exists","up"]},{"osd":1,"uuid":"fe08648a-14db-41f2-990d-2d94f09e937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6810","nonce":769566580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6814","nonce":769566580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6822","nonce":769566580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6818","nonce":769566580}]},"public_addr":"172.21.15.191:6810/769566580","cluster_addr":"172.21.15.191:6814/769566580","heartbeat_back_addr":"172.21.15.191:6822/769566580","heartbeat_front_addr":"172.21.15.191:6818/769566580","state":["exists","up"]},{"osd":2,"uuid":"8fd960bd-52c1-4fa2-9144-79ebbcebc0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6811","nonce":26623802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6815","nonce":26623802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6823","nonce":26623802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6819","nonce":26623802}]},"public_addr":"172.21.15.191:6811/26623802","cluster_addr":"172.21.15.191:6815/26623802","heartbeat_back_addr":"172.21.15.191:6823/26623802","heartbeat_front_addr":"172.21.15.191:6819/26623802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-13T23:59:59.739091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-13T23:59:59.682828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-13T23:59:59.560459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T00:00:10.820 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T00:00:10.820 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T00:00:11.105 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T00:00:11.106 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":14,"fsid":"45aee46f-9711-4acb-8786-feff8e40632d","created":"2023-10-13T23:59:53.196388+0000","modified":"2023-10-14T00:00:10.143547+0000","last_up_change":"2023-10-14T00:00:02.297223+0000","last_in_change":"2023-10-13T23:59:54.136833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T00:00:04.183601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-14T00:00:08.397834+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad26bebb-f6ee-40e4-8bf6-3231095fe456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6801","nonce":2437613027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6803","nonce":2437613027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6807","nonce":2437613027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6805","nonce":2437613027}]},"public_addr":"172.21.15.191:6801/2437613027","cluster_addr":"172.21.15.191:6803/2437613027","heartbeat_back_addr":"172.21.15.191:6807/2437613027","heartbeat_front_addr":"172.21.15.191:6805/2437613027","state":["exists","up"]},{"osd":1,"uuid":"fe08648a-14db-41f2-990d-2d94f09e937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6810","nonce":769566580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6814","nonce":769566580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6822","nonce":769566580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6818","nonce":769566580}]},"public_addr":"172.21.15.191:6810/769566580","cluster_addr":"172.21.15.191:6814/769566580","heartbeat_back_addr":"172.21.15.191:6822/769566580","heartbeat_front_addr":"172.21.15.191:6818/769566580","state":["exists","up"]},{"osd":2,"uuid":"8fd960bd-52c1-4fa2-9144-79ebbcebc0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6811","nonce":26623802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6815","nonce":26623802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6823","nonce":26623802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6819","nonce":26623802}]},"public_addr":"172.21.15.191:6811/26623802","cluster_addr":"172.21.15.191:6815/26623802","heartbeat_back_addr":"172.21.15.191:6823/26623802","heartbeat_front_addr":"172.21.15.191:6819/26623802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-13T23:59:59.739091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-13T23:59:59.682828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-13T23:59:59.560459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T00:00:11.124 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T00:00:11.124 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T00:00:11.125 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T00:00:11.278 INFO:teuthology.orchestra.run.smithi191.stdout:34359738372 2023-10-14T00:00:11.278 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T00:00:11.280 INFO:teuthology.orchestra.run.smithi191.stdout:34359738372 2023-10-14T00:00:11.280 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T00:00:11.287 INFO:teuthology.orchestra.run.smithi191.stdout:34359738372 2023-10-14T00:00:11.288 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T00:00:11.577 INFO:teuthology.orchestra.run.smithi191.stdout:34359738371 2023-10-14T00:00:11.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.2 2023-10-14T00:00:11.604 INFO:teuthology.orchestra.run.smithi191.stdout:34359738371 2023-10-14T00:00:11.618 INFO:teuthology.orchestra.run.smithi191.stdout:34359738371 2023-10-14T00:00:11.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.0 2023-10-14T00:00:11.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.1 2023-10-14T00:00:12.595 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T00:00:12.622 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T00:00:12.635 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T00:00:12.906 INFO:teuthology.orchestra.run.smithi191.stdout:34359738372 2023-10-14T00:00:12.922 INFO:teuthology.orchestra.run.smithi191.stdout:34359738372 2023-10-14T00:00:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.2 2023-10-14T00:00:12.923 DEBUG:teuthology.parallel:result is None 2023-10-14T00:00:12.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.1 2023-10-14T00:00:12.939 DEBUG:teuthology.parallel:result is None 2023-10-14T00:00:12.944 INFO:teuthology.orchestra.run.smithi191.stdout:34359738372 2023-10-14T00:00:12.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.0 2023-10-14T00:00:12.960 DEBUG:teuthology.parallel:result is None 2023-10-14T00:00:12.960 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T00:00:12.961 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T00:00:13.272 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T00:00:13.273 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T00:00:13.289 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-10-14T00:00:12.111835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81532,"kb_used_data":472,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033988,"statfs":{"total":289910292480,"available":289826803712,"internally_reserved":0,"allocated":483328,"data_stored":1281896,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.966868"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T00:00:10.163250+0000","last_change":"2023-10-14T00:00:10.161480+0000","last_active":"2023-10-14T00:00:10.163250+0000","last_peered":"2023-10-14T00:00:10.163250+0000","last_clean":"2023-10-14T00:00:10.163250+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T00:00:10.163250+0000","last_undegraded":"2023-10-14T00:00:10.163250+0000","last_fullsized":"2023-10-14T00:00:10.163250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:56:26.985587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T00:00:10.165333+0000","last_change":"2023-10-14T00:00:10.163233+0000","last_active":"2023-10-14T00:00:10.165333+0000","last_peered":"2023-10-14T00:00:10.165333+0000","last_clean":"2023-10-14T00:00:10.165333+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T00:00:10.165333+0000","last_undegraded":"2023-10-14T00:00:10.165333+0000","last_fullsized":"2023-10-14T00:00:10.165333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T05:51:52.619522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T00:00:10.163888+0000","last_change":"2023-10-14T00:00:10.161471+0000","last_active":"2023-10-14T00:00:10.163888+0000","last_peered":"2023-10-14T00:00:10.163888+0000","last_clean":"2023-10-14T00:00:10.163888+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T00:00:10.163888+0000","last_undegraded":"2023-10-14T00:00:10.163888+0000","last_fullsized":"2023-10-14T00:00:10.163888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:44:42.602498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T00:00:10.165351+0000","last_change":"2023-10-14T00:00:10.162330+0000","last_active":"2023-10-14T00:00:10.165351+0000","last_peered":"2023-10-14T00:00:10.165351+0000","last_clean":"2023-10-14T00:00:10.165351+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T00:00:10.165351+0000","last_undegraded":"2023-10-14T00:00:10.165351+0000","last_fullsized":"2023-10-14T00:00:10.165351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:19:44.270834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T00:00:10.164669+0000","last_change":"2023-10-14T00:00:10.161234+0000","last_active":"2023-10-14T00:00:10.164669+0000","last_peered":"2023-10-14T00:00:10.164669+0000","last_clean":"2023-10-14T00:00:10.164669+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T00:00:10.164669+0000","last_undegraded":"2023-10-14T00:00:10.164669+0000","last_fullsized":"2023-10-14T00:00:10.164669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:57:13.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T00:00:11.148728+0000","last_change":"2023-10-14T00:00:10.163685+0000","last_active":"2023-10-14T00:00:11.148728+0000","last_peered":"2023-10-14T00:00:11.148728+0000","last_clean":"2023-10-14T00:00:11.148728+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T00:00:11.148728+0000","last_undegraded":"2023-10-14T00:00:11.148728+0000","last_fullsized":"2023-10-14T00:00:11.148728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:38:48.376384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T00:00:11.148730+0000","last_change":"2023-10-14T00:00:10.162929+0000","last_active":"2023-10-14T00:00:11.148730+0000","last_peered":"2023-10-14T00:00:11.148730+0000","last_clean":"2023-10-14T00:00:11.148730+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T00:00:11.148730+0000","last_undegraded":"2023-10-14T00:00:11.148730+0000","last_fullsized":"2023-10-14T00:00:11.148730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T00:46:30.108857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T00:00:10.164182+0000","last_change":"2023-10-14T00:00:10.162671+0000","last_active":"2023-10-14T00:00:10.164182+0000","last_peered":"2023-10-14T00:00:10.164182+0000","last_clean":"2023-10-14T00:00:10.164182+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T00:00:10.164182+0000","last_undegraded":"2023-10-14T00:00:10.164182+0000","last_fullsized":"2023-10-14T00:00:10.164182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:37:05.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":140,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T00:00:09.147489+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T00:00:09.147489+0000","last_peered":"2023-10-14T00:00:09.147489+0000","last_clean":"2023-10-14T00:00:09.147489+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T00:00:09.147489+0000","last_undegraded":"2023-10-14T00:00:09.147489+0000","last_fullsized":"2023-10-14T00:00:09.147489+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T04:40:30.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":122880,"data_stored":33720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":624088,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":624088,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T00:00:13.290 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T00:00:13.562 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T00:00:13.562 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T00:00:13.579 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-10-14T00:00:12.111835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81532,"kb_used_data":472,"kb_used_omap":4,"kb_used_meta":81019,"kb_avail":283033988,"statfs":{"total":289910292480,"available":289826803712,"internally_reserved":0,"allocated":483328,"data_stored":1281896,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":82963794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.966868"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T00:00:10.163250+0000","last_change":"2023-10-14T00:00:10.161480+0000","last_active":"2023-10-14T00:00:10.163250+0000","last_peered":"2023-10-14T00:00:10.163250+0000","last_clean":"2023-10-14T00:00:10.163250+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T00:00:10.163250+0000","last_undegraded":"2023-10-14T00:00:10.163250+0000","last_fullsized":"2023-10-14T00:00:10.163250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:56:26.985587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T00:00:10.165333+0000","last_change":"2023-10-14T00:00:10.163233+0000","last_active":"2023-10-14T00:00:10.165333+0000","last_peered":"2023-10-14T00:00:10.165333+0000","last_clean":"2023-10-14T00:00:10.165333+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T00:00:10.165333+0000","last_undegraded":"2023-10-14T00:00:10.165333+0000","last_fullsized":"2023-10-14T00:00:10.165333+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T05:51:52.619522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T00:00:10.163888+0000","last_change":"2023-10-14T00:00:10.161471+0000","last_active":"2023-10-14T00:00:10.163888+0000","last_peered":"2023-10-14T00:00:10.163888+0000","last_clean":"2023-10-14T00:00:10.163888+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T00:00:10.163888+0000","last_undegraded":"2023-10-14T00:00:10.163888+0000","last_fullsized":"2023-10-14T00:00:10.163888+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:44:42.602498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T00:00:10.165351+0000","last_change":"2023-10-14T00:00:10.162330+0000","last_active":"2023-10-14T00:00:10.165351+0000","last_peered":"2023-10-14T00:00:10.165351+0000","last_clean":"2023-10-14T00:00:10.165351+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T00:00:10.165351+0000","last_undegraded":"2023-10-14T00:00:10.165351+0000","last_fullsized":"2023-10-14T00:00:10.165351+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:19:44.270834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T00:00:10.164669+0000","last_change":"2023-10-14T00:00:10.161234+0000","last_active":"2023-10-14T00:00:10.164669+0000","last_peered":"2023-10-14T00:00:10.164669+0000","last_clean":"2023-10-14T00:00:10.164669+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T00:00:10.164669+0000","last_undegraded":"2023-10-14T00:00:10.164669+0000","last_fullsized":"2023-10-14T00:00:10.164669+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:57:13.521862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T00:00:11.148728+0000","last_change":"2023-10-14T00:00:10.163685+0000","last_active":"2023-10-14T00:00:11.148728+0000","last_peered":"2023-10-14T00:00:11.148728+0000","last_clean":"2023-10-14T00:00:11.148728+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T00:00:11.148728+0000","last_undegraded":"2023-10-14T00:00:11.148728+0000","last_fullsized":"2023-10-14T00:00:11.148728+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:38:48.376384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-14T00:00:11.148730+0000","last_change":"2023-10-14T00:00:10.162929+0000","last_active":"2023-10-14T00:00:11.148730+0000","last_peered":"2023-10-14T00:00:11.148730+0000","last_clean":"2023-10-14T00:00:11.148730+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T00:00:11.148730+0000","last_undegraded":"2023-10-14T00:00:11.148730+0000","last_fullsized":"2023-10-14T00:00:11.148730+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T00:46:30.108857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-10-14T00:00:10.164182+0000","last_change":"2023-10-14T00:00:10.162671+0000","last_active":"2023-10-14T00:00:10.164182+0000","last_peered":"2023-10-14T00:00:10.164182+0000","last_clean":"2023-10-14T00:00:10.164182+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T00:00:10.164182+0000","last_undegraded":"2023-10-14T00:00:10.164182+0000","last_fullsized":"2023-10-14T00:00:10.164182+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:37:05.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":140,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-10-14T00:00:09.147489+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T00:00:09.147489+0000","last_peered":"2023-10-14T00:00:09.147489+0000","last_clean":"2023-10-14T00:00:09.147489+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T00:00:09.147489+0000","last_undegraded":"2023-10-14T00:00:09.147489+0000","last_fullsized":"2023-10-14T00:00:09.147489+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T04:40:30.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":122880,"data_stored":33720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":624088,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":624088,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T00:00:13.580 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T00:00:13.580 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T00:00:13.580 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T00:00:13.581 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T00:00:13.885 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T00:00:13.886 INFO:teuthology.orchestra.run.smithi191.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T00:00:13.903 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T00:00:13.903 INFO:teuthology.run_tasks:Running task install... 2023-10-14T00:00:13.911 DEBUG:teuthology.task.install:project ceph 2023-10-14T00:00:13.911 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '01fff6a72a328459c1d153e5dc1de6a34e48a82f'}} 2023-10-14T00:00:13.912 DEBUG:teuthology.task.install:config {'extra_system_packages': ['fio'], 'flavor': 'default', 'sha1': '01fff6a72a328459c1d153e5dc1de6a34e48a82f'} 2023-10-14T00:00:13.912 INFO:teuthology.task.install:Using flavor: default 2023-10-14T00:00:13.918 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T00:00:13.918 INFO:teuthology.task.install:extra packages: [] 2023-10-14T00:00:13.919 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-key list | grep Ceph 2023-10-14T00:00:13.969 INFO:teuthology.orchestra.run.smithi191.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-10-14T00:00:13.992 INFO:teuthology.orchestra.run.smithi191.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-14T00:00:13.992 INFO:teuthology.orchestra.run.smithi191.stdout:uid [ unknown] Ceph.com (release key) 2023-10-14T00:00:13.993 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-10-14T00:00:13.993 INFO:teuthology.task.install.deb:Installing system (non-project) packages: fio on remote deb x86_64 2023-10-14T00:00:13.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=01fff6a72a328459c1d153e5dc1de6a34e48a82f 2023-10-14T00:00:14.134 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default/ 2023-10-14T00:00:14.134 INFO:teuthology.task.install.deb:Package version is 18.0.0-6724-g01fff6a7-1jammy 2023-10-14T00:00:14.246 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-14T00:00:14.247 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-14T00:00:14.261 DEBUG:teuthology.orchestra.run.smithi191:> sudo apt-get update 2023-10-14T00:00:14.470 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-10-14T00:00:14.549 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-10-14T00:00:14.614 INFO:teuthology.orchestra.run.smithi191.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy InRelease 2023-10-14T00:00:14.631 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-10-14T00:00:14.669 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:5 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy Release 2023-10-14T00:00:14.713 INFO:teuthology.orchestra.run.smithi191.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-10-14T00:00:14.723 INFO:teuthology.orchestra.run.smithi191.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-dis-testing/01fff6a72a328459c1d153e5dc1de6a34e48a82f/ubuntu/jammy/flavors/default jammy Release.gpg 2023-10-14T00:00:15.709 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2023-10-14T00:00:15.724 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6724-g01fff6a7-1jammy cephadm=18.0.0-6724-g01fff6a7-1jammy ceph-mds=18.0.0-6724-g01fff6a7-1jammy ceph-mgr=18.0.0-6724-g01fff6a7-1jammy ceph-common=18.0.0-6724-g01fff6a7-1jammy ceph-fuse=18.0.0-6724-g01fff6a7-1jammy ceph-test=18.0.0-6724-g01fff6a7-1jammy ceph-volume=18.0.0-6724-g01fff6a7-1jammy radosgw=18.0.0-6724-g01fff6a7-1jammy python3-rados=18.0.0-6724-g01fff6a7-1jammy python3-rgw=18.0.0-6724-g01fff6a7-1jammy python3-cephfs=18.0.0-6724-g01fff6a7-1jammy python3-rbd=18.0.0-6724-g01fff6a7-1jammy libcephfs2=18.0.0-6724-g01fff6a7-1jammy libcephfs-dev=18.0.0-6724-g01fff6a7-1jammy librados2=18.0.0-6724-g01fff6a7-1jammy librbd1=18.0.0-6724-g01fff6a7-1jammy rbd-fuse=18.0.0-6724-g01fff6a7-1jammy 2023-10-14T00:00:15.784 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2023-10-14T00:00:15.969 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2023-10-14T00:00:15.970 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2023-10-14T00:00:16.135 INFO:teuthology.orchestra.run.smithi191.stdout:ceph is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.135 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-common is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.135 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-fuse is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.135 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-mds is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.136 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-mgr is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.136 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-test is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.136 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-volume is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.136 INFO:teuthology.orchestra.run.smithi191.stdout:cephadm is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.136 INFO:teuthology.orchestra.run.smithi191.stdout:libcephfs-dev is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.137 INFO:teuthology.orchestra.run.smithi191.stdout:libcephfs2 is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.137 INFO:teuthology.orchestra.run.smithi191.stdout:librados2 is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.137 INFO:teuthology.orchestra.run.smithi191.stdout:librbd1 is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.137 INFO:teuthology.orchestra.run.smithi191.stdout:python3-cephfs is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.137 INFO:teuthology.orchestra.run.smithi191.stdout:python3-rados is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.138 INFO:teuthology.orchestra.run.smithi191.stdout:python3-rbd is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.138 INFO:teuthology.orchestra.run.smithi191.stdout:python3-rgw is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.138 INFO:teuthology.orchestra.run.smithi191.stdout:radosgw is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.138 INFO:teuthology.orchestra.run.smithi191.stdout:rbd-fuse is already the newest version (18.0.0-6724-g01fff6a7-1jammy). 2023-10-14T00:00:16.138 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2023-10-14T00:00:16.138 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-10-14T00:00:16.139 INFO:teuthology.orchestra.run.smithi191.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-10-14T00:00:16.139 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-10-14T00:00:16.139 INFO:teuthology.orchestra.run.smithi191.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-10-14T00:00:16.140 INFO:teuthology.orchestra.run.smithi191.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-10-14T00:00:16.140 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-14T00:00:16.175 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 0 newly installed, 0 to remove and 256 not upgraded. 2023-10-14T00:00:16.176 INFO:teuthology.orchestra.run.smithi191.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-14T00:00:16.177 DEBUG:teuthology.orchestra.run.smithi191:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install fio 2023-10-14T00:00:16.235 INFO:teuthology.orchestra.run.smithi191.stdout:Reading package lists... 2023-10-14T00:00:16.423 INFO:teuthology.orchestra.run.smithi191.stdout:Building dependency tree... 2023-10-14T00:00:16.424 INFO:teuthology.orchestra.run.smithi191.stdout:Reading state information... 2023-10-14T00:00:16.581 INFO:teuthology.orchestra.run.smithi191.stdout:The following packages were automatically installed and are no longer required: 2023-10-14T00:00:16.582 INFO:teuthology.orchestra.run.smithi191.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-10-14T00:00:16.582 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2-dev libpython2-stdlib libpython2.7 libpython2.7-dev 2023-10-14T00:00:16.582 INFO:teuthology.orchestra.run.smithi191.stdout: libpython2.7-minimal libpython2.7-stdlib linux-image-5.4.0-135-generic 2023-10-14T00:00:16.582 INFO:teuthology.orchestra.run.smithi191.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2023-10-14T00:00:16.583 INFO:teuthology.orchestra.run.smithi191.stdout: python2.7 python2.7-dev python2.7-minimal 2023-10-14T00:00:16.583 INFO:teuthology.orchestra.run.smithi191.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-14T00:00:16.583 INFO:teuthology.orchestra.run.smithi191.stdout:The following additional packages will be installed: 2023-10-14T00:00:16.584 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemblk1 2023-10-14T00:00:16.585 INFO:teuthology.orchestra.run.smithi191.stdout:Suggested packages: 2023-10-14T00:00:16.585 INFO:teuthology.orchestra.run.smithi191.stdout: gnuplot gfio python-scipy 2023-10-14T00:00:16.607 INFO:teuthology.orchestra.run.smithi191.stdout:The following NEW packages will be installed: 2023-10-14T00:00:16.608 INFO:teuthology.orchestra.run.smithi191.stdout: fio libpmemblk1 2023-10-14T00:00:17.289 INFO:teuthology.orchestra.run.smithi191.stdout:0 upgraded, 2 newly installed, 0 to remove and 256 not upgraded. 2023-10-14T00:00:17.289 INFO:teuthology.orchestra.run.smithi191.stdout:Need to get 4,112 kB of archives. 2023-10-14T00:00:17.289 INFO:teuthology.orchestra.run.smithi191.stdout:After this operation, 7,813 kB of additional disk space will be used. 2023-10-14T00:00:17.290 INFO:teuthology.orchestra.run.smithi191.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-10-14T00:00:17.574 INFO:teuthology.orchestra.run.smithi191.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-10-14T00:00:18.445 INFO:teuthology.orchestra.run.smithi191.stdout:Fetched 4,112 kB in 1s (2,810 kB/s) 2023-10-14T00:00:18.610 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-10-14T00:00:18.714 INFO:teuthology.orchestra.run.smithi191.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172814 files and directories currently installed.) 2023-10-14T00:00:18.719 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-10-14T00:00:18.800 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-10-14T00:00:19.145 INFO:teuthology.orchestra.run.smithi191.stdout:Selecting previously unselected package fio. 2023-10-14T00:00:19.173 INFO:teuthology.orchestra.run.smithi191.stdout:Preparing to unpack .../archives/fio_3.28-1_amd64.deb ... 2023-10-14T00:00:19.211 INFO:teuthology.orchestra.run.smithi191.stdout:Unpacking fio (3.28-1) ... 2023-10-14T00:00:19.713 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-10-14T00:00:19.900 INFO:teuthology.orchestra.run.smithi191.stdout:Setting up fio (3.28-1) ... 2023-10-14T00:00:20.419 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-10-14T00:00:21.486 INFO:teuthology.orchestra.run.smithi191.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-10-14T00:00:21.946 INFO:teuthology.orchestra.run.smithi191.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-14T00:00:21.948 DEBUG:teuthology.parallel:result is None 2023-10-14T00:00:21.949 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=01fff6a72a328459c1d153e5dc1de6a34e48a82f 2023-10-14T00:00:22.163 DEBUG:teuthology.orchestra.run.smithi191:> dpkg-query -W -f '${Version}' ceph 2023-10-14T00:00:22.183 INFO:teuthology.orchestra.run.smithi191.stdout:18.0.0-6724-g01fff6a7-1jammy 2023-10-14T00:00:22.183 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6724-g01fff6a7-1jammy 2023-10-14T00:00:22.184 INFO:teuthology.task.install:The correct ceph version 18.0.0-6724-g01fff6a7-1jammy is installed. 2023-10-14T00:00:22.184 INFO:teuthology.task.install.util:Utilities already shipped, skip it... 2023-10-14T00:00:22.185 INFO:teuthology.run_tasks:Running task workunit... 2023-10-14T00:00:22.204 INFO:tasks.workunit:Pulling workunits from ref 735f68d7bf91d643813a8420fc2b11441f4bd8c4 2023-10-14T00:00:22.205 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-14T00:00:22.205 DEBUG:teuthology.orchestra.run.smithi191:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-14T00:00:22.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T00:00:22.233 INFO:teuthology.orchestra.run.smithi191.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-14T00:00:22.233 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-10-14T00:00:22.280 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-10-14T00:00:22.281 DEBUG:teuthology.orchestra.run.smithi191:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-10-14T00:00:22.328 INFO:tasks.workunit:timeout=3h 2023-10-14T00:00:22.328 INFO:tasks.workunit:cleanup=True 2023-10-14T00:00:22.329 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/idryomov/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 735f68d7bf91d643813a8420fc2b11441f4bd8c4 2023-10-14T00:00:22.377 INFO:tasks.workunit.client.0.smithi191.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-14T00:01:09.049 INFO:tasks.workunit.client.0.smithi191.stderr:Note: switching to '735f68d7bf91d643813a8420fc2b11441f4bd8c4'. 2023-10-14T00:01:09.050 INFO:tasks.workunit.client.0.smithi191.stderr: 2023-10-14T00:01:09.050 INFO:tasks.workunit.client.0.smithi191.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-14T00:01:09.050 INFO:tasks.workunit.client.0.smithi191.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-14T00:01:09.050 INFO:tasks.workunit.client.0.smithi191.stderr:state without impacting any branches by switching back to a branch. 2023-10-14T00:01:09.050 INFO:tasks.workunit.client.0.smithi191.stderr: 2023-10-14T00:01:09.051 INFO:tasks.workunit.client.0.smithi191.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-14T00:01:09.051 INFO:tasks.workunit.client.0.smithi191.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-14T00:01:09.051 INFO:tasks.workunit.client.0.smithi191.stderr: 2023-10-14T00:01:09.051 INFO:tasks.workunit.client.0.smithi191.stderr: git switch -c 2023-10-14T00:01:09.051 INFO:tasks.workunit.client.0.smithi191.stderr: 2023-10-14T00:01:09.052 INFO:tasks.workunit.client.0.smithi191.stderr:Or undo this operation with: 2023-10-14T00:01:09.052 INFO:tasks.workunit.client.0.smithi191.stderr: 2023-10-14T00:01:09.052 INFO:tasks.workunit.client.0.smithi191.stderr: git switch - 2023-10-14T00:01:09.052 INFO:tasks.workunit.client.0.smithi191.stderr: 2023-10-14T00:01:09.052 INFO:tasks.workunit.client.0.smithi191.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-14T00:01:09.052 INFO:tasks.workunit.client.0.smithi191.stderr: 2023-10-14T00:01:09.053 INFO:tasks.workunit.client.0.smithi191.stderr:HEAD is now at 735f68d7bf9 Merge branch 'wip-62891' of https://github.com/ajarr/ceph into HEAD 2023-10-14T00:01:09.055 DEBUG:teuthology.orchestra.run.smithi191:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-14T00:01:09.107 INFO:tasks.workunit.client.0.smithi191.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-14T00:01:09.110 INFO:tasks.workunit.client.0.smithi191.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-14T00:01:09.111 INFO:tasks.workunit.client.0.smithi191.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-14T00:01:09.985 INFO:tasks.workunit.client.0.smithi191.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-14T00:01:10.084 INFO:tasks.workunit.client.0.smithi191.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-14T00:01:10.135 INFO:tasks.workunit.client.0.smithi191.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-14T00:01:10.136 INFO:tasks.workunit.client.0.smithi191.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-14T00:01:10.136 INFO:tasks.workunit.client.0.smithi191.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-14T00:01:10.181 INFO:tasks.workunit.client.0.smithi191.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-14T00:01:10.185 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2023-10-14T00:01:10.185 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-14T00:01:10.231 INFO:tasks.workunit:Running workunits matching rbd/rbd_support_module_recovery.sh on client.0... 2023-10-14T00:01:10.233 INFO:tasks.workunit:Running workunit rbd/rbd_support_module_recovery.sh... 2023-10-14T00:01:10.234 DEBUG:teuthology.orchestra.run.smithi191:workunit test rbd/rbd_support_module_recovery.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=735f68d7bf91d643813a8420fc2b11441f4bd8c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_support_module_recovery.sh 2023-10-14T00:01:10.284 INFO:tasks.workunit.client.0.smithi191.stderr:+ POOL=rbd 2023-10-14T00:01:10.284 INFO:tasks.workunit.client.0.smithi191.stderr:+ IMAGE_PREFIX=image 2023-10-14T00:01:10.284 INFO:tasks.workunit.client.0.smithi191.stderr:+ NUM_IMAGES=20 2023-10-14T00:01:10.285 INFO:tasks.workunit.client.0.smithi191.stderr:+ RUN_TIME=3600 2023-10-14T00:01:10.285 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror pool enable rbd image 2023-10-14T00:01:10.351 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror pool peer add rbd dummy 2023-10-14T00:01:10.388 INFO:tasks.workunit.client.0.smithi191.stdout:4d819337-4295-4f44-a820-4d6ade6931c6 2023-10-14T00:01:10.391 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i = 1 )) 2023-10-14T00:01:10.391 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:10.392 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image1 2023-10-14T00:01:12.283 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image1 snapshot 2023-10-14T00:01:13.296 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:13.310 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 1m 2023-10-14T00:01:13.372 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:13.372 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:13.373 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image2 2023-10-14T00:01:13.419 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image2 snapshot 2023-10-14T00:01:14.303 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:14.319 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image2 1m 2023-10-14T00:01:14.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:14.381 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:14.381 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image3 2023-10-14T00:01:14.427 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image3 snapshot 2023-10-14T00:01:15.316 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:15.327 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image3 1m 2023-10-14T00:01:15.389 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:15.390 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:15.390 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image4 2023-10-14T00:01:15.437 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image4 snapshot 2023-10-14T00:01:16.324 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:16.338 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image4 1m 2023-10-14T00:01:16.400 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:16.401 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:16.401 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image5 2023-10-14T00:01:16.451 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image5 snapshot 2023-10-14T00:01:17.323 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:17.334 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image5 1m 2023-10-14T00:01:17.398 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:17.399 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:17.399 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image6 2023-10-14T00:01:17.447 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image6 snapshot 2023-10-14T00:01:18.196 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:18.208 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image6 1m 2023-10-14T00:01:18.269 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:18.269 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:18.270 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image7 2023-10-14T00:01:18.316 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image7 snapshot 2023-10-14T00:01:19.337 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:19.352 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image7 1m 2023-10-14T00:01:19.412 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:19.412 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:19.412 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image8 2023-10-14T00:01:19.459 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image8 snapshot 2023-10-14T00:01:20.346 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:20.359 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image8 1m 2023-10-14T00:01:20.420 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:20.420 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:20.420 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image9 2023-10-14T00:01:20.469 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image9 snapshot 2023-10-14T00:01:21.361 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:21.374 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image9 1m 2023-10-14T00:01:21.435 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:21.436 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:21.436 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image10 2023-10-14T00:01:21.485 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image10 snapshot 2023-10-14T00:01:22.373 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:22.387 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image10 1m 2023-10-14T00:01:22.450 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:22.450 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:22.450 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image11 2023-10-14T00:01:22.501 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image11 snapshot 2023-10-14T00:01:23.376 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:23.388 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image11 1m 2023-10-14T00:01:23.451 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:23.452 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:23.452 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image12 2023-10-14T00:01:23.499 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image12 snapshot 2023-10-14T00:01:24.388 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:24.403 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image12 1m 2023-10-14T00:01:24.469 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:24.469 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:24.469 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image13 2023-10-14T00:01:24.518 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image13 snapshot 2023-10-14T00:01:25.399 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:25.412 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image13 1m 2023-10-14T00:01:25.478 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:25.478 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:25.479 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image14 2023-10-14T00:01:25.526 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image14 snapshot 2023-10-14T00:01:26.408 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:26.422 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image14 1m 2023-10-14T00:01:26.483 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:26.483 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:26.483 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image15 2023-10-14T00:01:26.531 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image15 snapshot 2023-10-14T00:01:27.411 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:27.423 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image15 1m 2023-10-14T00:01:27.482 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:27.483 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:27.483 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image16 2023-10-14T00:01:27.529 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image16 snapshot 2023-10-14T00:01:28.415 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:28.429 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image16 1m 2023-10-14T00:01:28.489 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:28.489 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:28.489 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image17 2023-10-14T00:01:28.536 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image17 snapshot 2023-10-14T00:01:29.429 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:29.442 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image17 1m 2023-10-14T00:01:29.503 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:29.503 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:29.503 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image18 2023-10-14T00:01:29.550 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image18 snapshot 2023-10-14T00:01:30.438 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:30.451 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image18 1m 2023-10-14T00:01:30.513 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:30.513 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:30.513 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image19 2023-10-14T00:01:30.560 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image19 snapshot 2023-10-14T00:01:31.444 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:31.457 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image19 1m 2023-10-14T00:01:31.519 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:31.519 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:31.520 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd create -s 1G --image-feature exclusive-lock rbd/image20 2023-10-14T00:01:31.567 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror image enable rbd/image20 snapshot 2023-10-14T00:01:32.452 INFO:tasks.workunit.client.0.smithi191.stdout:Mirroring enabled 2023-10-14T00:01:32.465 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image20 1m 2023-10-14T00:01:32.527 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:32.527 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:32.527 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i = 1 )) 2023-10-14T00:01:32.528 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:32.528 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image1 2023-10-14T00:01:32.650 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd0 2023-10-14T00:01:32.650 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:32.651 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:32.651 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd0 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:32.652 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image2 2023-10-14T00:01:32.720 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd1 2023-10-14T00:01:32.721 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:32.721 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:32.721 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd1 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:32.721 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image3 2023-10-14T00:01:32.793 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd2 2023-10-14T00:01:32.793 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:32.793 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:32.793 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd2 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:32.793 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image4 2023-10-14T00:01:32.864 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd3 2023-10-14T00:01:32.865 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:32.865 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:32.865 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd3 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:32.866 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image5 2023-10-14T00:01:32.934 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd4 2023-10-14T00:01:32.934 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:32.934 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:32.935 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd4 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:32.935 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image6 2023-10-14T00:01:33.229 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd5 2023-10-14T00:01:33.230 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:33.230 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:33.230 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd5 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:33.231 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image7 2023-10-14T00:01:33.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:33.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:33.347 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd6 2023-10-14T00:01:33.347 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:33.347 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:33.348 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd6 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:33.348 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image8 2023-10-14T00:01:33.463 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd7 2023-10-14T00:01:33.463 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:33.463 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:33.464 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd7 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:33.464 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image9 2023-10-14T00:01:33.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:33.584+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:33.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:33.584+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:33.593 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd8 2023-10-14T00:01:33.594 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:33.594 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:33.595 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd8 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:33.595 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image10 2023-10-14T00:01:33.724 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd9 2023-10-14T00:01:33.724 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:33.725 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:33.725 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd9 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:33.725 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image11 2023-10-14T00:01:33.881 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd10 2023-10-14T00:01:33.882 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:33.882 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:33.883 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image12 2023-10-14T00:01:33.883 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd10 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:34.042 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd11 2023-10-14T00:01:34.042 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:34.043 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:34.043 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd11 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:34.044 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image13 2023-10-14T00:01:34.228 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd12 2023-10-14T00:01:34.229 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:34.229 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:34.230 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd12 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:34.230 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image14 2023-10-14T00:01:34.374 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd13 2023-10-14T00:01:34.374 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:34.375 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:34.376 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd13 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:34.376 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image15 2023-10-14T00:01:34.623 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd14 2023-10-14T00:01:34.623 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:34.623 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:34.624 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd14 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:34.624 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image16 2023-10-14T00:01:34.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd15 2023-10-14T00:01:34.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:34.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:34.751 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd15 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:34.751 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image17 2023-10-14T00:01:34.961 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd16 2023-10-14T00:01:34.962 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:34.962 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:34.962 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image18 2023-10-14T00:01:34.963 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd16 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:35.141 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd17 2023-10-14T00:01:35.141 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:35.142 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:35.142 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd17 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:35.147 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image19 2023-10-14T00:01:35.293 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd18 2023-10-14T00:01:35.293 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:35.293 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:35.293 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd18 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:35.294 INFO:tasks.workunit.client.0.smithi191.stderr:++ sudo rbd device map rbd/image20 2023-10-14T00:01:35.524 INFO:tasks.workunit.client.0.smithi191.stderr:+ DEVS[$i]=/dev/rbd19 2023-10-14T00:01:35.525 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T00:01:35.525 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 20 )) 2023-10-14T00:01:35.525 INFO:tasks.workunit.client.0.smithi191.stderr:+ fio --name=fiotest --filename=/dev/rbd19 --rw=randrw --bs=4K --direct=1 --ioengine=libaio --iodepth=2 --runtime=43200 --time_based 2023-10-14T00:01:35.526 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:01:35.526 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241695 2023-10-14T00:01:35.527 INFO:tasks.workunit.client.0.smithi191.stderr:+ END_TIME=1697245295 2023-10-14T00:01:35.527 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR= 2023-10-14T00:01:35.527 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR= 2023-10-14T00:01:35.527 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:01:35.528 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n '' ]] 2023-10-14T00:01:35.528 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:01:36.307 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:01:36.304+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:01:36.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:01:36.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:36.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:36.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:36.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:36.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:36.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:36.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.504+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:36.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.504+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:36.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:36.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:36.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:36.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:36.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:36.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.532+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:36.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:36.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.656+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:36.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.660+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:36.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:36.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:36.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:36.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:36.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:36.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:36.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:36.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:36.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:36.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.984+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:36.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:36.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:36.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:37.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:37.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:37.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:37.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:37.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:37.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.092+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:37.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.092+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:37.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.092+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:37.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.092+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:37.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.092+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:37.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:37.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:37.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:37.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:37.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:37.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:37.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:37.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.128+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:37.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:01:37.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:37.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:37.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:37.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:37.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:37.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:37.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:37.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.220+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:37.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:37.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:37.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:37.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:37.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:37.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.480+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:37.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.484+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:37.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:37.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:37.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:01:37.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:37.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:37.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:37.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:37.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:37.484+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:38.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:01:38.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:01:38.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:38.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:38.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:38.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:38.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:38.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:38.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:38.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:38.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.216+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:38.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:38.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:38.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:01:38.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:38.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:38.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:38.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:38.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:38.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:38.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:38.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.420+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:38.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:38.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:38.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:39.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:01:39.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:39.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:39.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:39.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:39.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:39.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:39.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:39.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.280+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:39.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.280+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:39.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.280+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:39.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.280+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:39.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:39.280+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:39.979 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:01:39.976+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:01:40.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:40.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:40.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:40.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:40.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:40.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:40.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:40.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:40.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:40.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:40.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:40.940+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:41.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:41.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:41.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:41.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:41.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:41.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:41.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:41.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:41.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:41.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.348+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:41.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:41.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:41.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:41.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:41.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:41.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:41.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:41.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:41.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:41.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:41.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.472+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:41.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:41.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:41.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:41.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:41.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:41.672+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:42.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:42.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:42.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:42.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:42.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:42.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:01:42.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:01:42.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:42.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:42.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:42.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:42.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:42.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:42.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:42.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:42.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:42.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.768+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:42.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:42.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:42.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:01:42.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:42.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:42.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:42.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:42.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:42.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.860+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:42.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:42.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.868+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:42.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:42.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:42.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:01:42.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:01:42.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:42.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:42.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:42.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:42.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:42.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:42.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:42.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:42.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:42.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.908+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:42.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:42.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:42.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:43.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:01:43.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:01:43.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:01:43.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:43.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:43.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:43.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:43.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:43.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:43.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:43.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:43.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:43.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.236+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:43.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:43.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:43.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:01:43.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:43.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:43.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:43.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:43.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:43.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:43.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:43.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:43.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:43.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:43.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:43.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:43.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:43.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:43.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:43.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:43.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.732+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:43.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:43.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:43.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:43.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:43.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:43.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:43.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:43.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:43.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:44.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:01:44.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:01:44.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:44.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:44.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:44.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:44.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:44.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:44.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:44.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:44.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:44.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.436+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:44.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:44.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:44.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:44.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:44.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:44.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:44.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:44.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:44.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.668+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:44.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:44.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:44.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:44.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:44.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:44.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:44.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:44.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:44.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:44.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:44.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.800+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:44.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:44.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:44.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:45.232 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:01:45.232+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T00:01:45.232 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:01:45.232+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:01:45.233 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:01:45.232+0000 7f30478aa640 -1 reset not still connected to 0x55c894ab09c0 2023-10-14T00:01:45.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:45.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:45.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:45.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:45.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:45.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:45.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:45.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:45.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:45.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:45.530 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:01:45.532 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:01:45.534 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:01:45.537 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:01:46.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:46.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:46.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:46.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:46.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:46.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:46.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:46.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.180+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:46.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:46.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:01:46.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:46.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:46.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:46.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:46.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:46.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:46.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:46.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:46.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.655+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:46.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:46.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:46.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:46.978 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2953257084 2023-10-14T00:01:46.978 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:01:46.978 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241706 2023-10-14T00:01:46.979 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:01:46.979 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2953257084 ]] 2023-10-14T00:01:46.979 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2953257084 != '' ]] 2023-10-14T00:01:46.979 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/2953257084 2023-10-14T00:01:47.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:47.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:47.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:47.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:48.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:47.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:48.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:47.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:48.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:48.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:48.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:48.023+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:48.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:48.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:48.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:48.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:48.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:48.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:48.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:48.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:48.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:48.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:48.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:48.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:48.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:48.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:48.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:48.663+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:48.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:48.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:48.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:48.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:49.215 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/2953257084 until 2023-10-14T01:01:48.540775+0000 (3600 sec) 2023-10-14T00:01:49.257 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:01:49.263 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/2953257084 2023-10-14T00:01:50.321 INFO:tasks.workunit.client.0.smithi191.stderr:listed 1 entries 2023-10-14T00:01:50.382 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/2953257084 2023-10-14T00:01:50.382 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:01:52.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:52.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:52.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:52.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:52.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:01:52.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:52.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:52.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:52.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:52.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:52.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:52.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:52.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:52.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:52.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:52.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:52.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:52.199+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:53.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:53.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:53.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:53.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:53.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:53.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:53.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:53.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.259+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:53.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:53.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:53.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:53.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:53.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:53.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:53.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:53.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:53.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:53.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:53.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:53.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.547+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:53.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:53.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:53.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:53.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:53.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:53.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:53.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:53.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:53.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:53.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:53.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:53.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:53.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:53.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:53.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:53.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:53.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:53.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:53.971+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:54.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:54.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:54.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:54.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:54.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:54.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:54.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:54.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:54.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:54.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:54.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:54.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:54.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:54.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:54.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:54.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.411+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:54.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:54.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:54.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:01:54.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:01:54.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:54.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:54.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:54.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:54.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:54.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:54.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:54.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:54.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:54.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.427+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:54.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:54.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:54.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:55.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:55.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:55.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:55.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:55.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:55.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:55.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:55.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:55.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:55.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:55.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:55.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:55.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:55.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.515+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:55.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:55.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:55.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:55.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:55.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:55.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:55.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:56.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:56.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:56.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:56.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:56.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:56.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:56.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:56.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:56.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:56.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:56.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:56.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:56.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:56.759+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:56.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:56.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:56.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:56.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:57.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:57.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:57.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:57.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:57.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:57.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:57.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:57.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:57.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:57.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:57.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:57.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:57.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:57.907+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:57.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:57.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:57.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:57.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:58.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:58.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:58.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:58.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:58.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:58.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:58.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:58.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.071+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:58.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:58.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:58.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.095+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:58.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:01:58.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:01:58.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:58.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:58.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:58.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:58.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:58.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:58.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:58.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:58.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.223+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:58.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:58.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:58.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:59.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:01:59.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:01:59.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:01:59.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:01:59.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:59.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:59.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:59.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:59.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.479+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:59.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:59.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:01:59.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:01:59.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:01:59.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:01:59.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:01:59.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.907+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:01:59.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:01:59.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:01:59.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:00.393 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:02:00.396 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:02:00.397 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:02:00.431 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:02:00.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:00.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:00.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:00.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:00.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:00.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:00.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:00.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:00.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:00.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.475+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:00.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:00.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:00.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:00.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:00.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:00.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:00.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:00.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:01.885 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2953257084 2023-10-14T00:02:01.897 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:02:01.897 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241721 2023-10-14T00:02:01.898 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:02:01.898 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2953257084 ]] 2023-10-14T00:02:01.898 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2953257084 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\9\5\3\2\5\7\0\8\4 ]] 2023-10-14T00:02:01.898 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:02:03.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:03.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:03.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:03.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:03.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:03.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:03.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:03.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:03.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.063+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:03.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:03.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:03.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:03.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:03.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:03.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:03.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:03.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:03.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:03.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:03.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:03.964 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:03.963+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:02:04.665 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:02:04.663+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:02:05.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:05.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:05.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:05.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:05.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:05.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:05.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:05.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:05.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:05.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:05.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:05.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:05.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:05.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:05.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:05.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:05.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:05.419+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:05.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:05.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:05.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:05.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:07.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:07.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:07.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:07.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:07.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:07.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:07.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:07.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:07.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:07.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:07.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:07.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:07.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.951+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:07.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:07.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:07.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:08.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:08.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:08.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:08.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:08.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:08.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:08.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:08.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.299+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:08.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:08.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:08.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:08.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:08.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:08.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:08.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:08.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.419+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:08.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:08.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:08.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:09.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:09.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:09.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:09.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:09.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:09.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:09.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:09.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:09.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:09.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:09.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:09.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:09.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:09.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:09.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:09.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:09.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:09.747+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:09.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:09.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:09.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:09.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:10.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:10.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:10.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:10.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:10.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:10.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:10.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:10.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:10.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:10.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:10.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:10.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:10.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:10.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:10.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:10.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:10.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:10.095+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:10.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:10.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:10.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:10.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:11.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:11.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:11.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:11.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:11.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:11.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:11.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:11.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:11.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:11.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:11.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:11.223+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:11.899 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:02:11.900 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:02:11.903 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:02:11.904 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:02:13.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:13.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:13.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:13.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:13.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:13.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:13.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:13.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:13.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:13.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:13.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.279+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:13.338 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2207486599 2023-10-14T00:02:13.340 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:02:13.341 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241733 2023-10-14T00:02:13.341 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:02:13.342 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2207486599 ]] 2023-10-14T00:02:13.342 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2207486599 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\9\5\3\2\5\7\0\8\4 ]] 2023-10-14T00:02:13.342 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/2207486599 2023-10-14T00:02:13.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:13.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:13.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:13.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:13.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:13.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:13.420 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:13.415+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:02:13.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:13.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:13.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:13.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.423+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:13.445 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:13.443+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:02:13.625 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:13.623+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:02:13.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:13.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:13.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:13.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:13.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:13.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:13.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:13.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:13.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:13.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.755+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:13.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:13.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:13.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:13.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:13.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:13.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:13.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.819+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:13.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:13.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:13.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:14.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:14.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:14.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:14.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:14.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:14.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:14.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:14.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:14.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:14.323+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:14.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:14.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:14.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:14.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:14.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:14.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:14.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:14.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:14.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:14.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:16.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:16.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:16.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:16.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:16.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:16.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:16.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:16.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:16.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:16.075+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:16.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:16.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:16.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:16.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:16.211 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/2207486599 until 2023-10-14T01:02:15.428865+0000 (3600 sec) 2023-10-14T00:02:16.238 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/2207486599 2023-10-14T00:02:16.239 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:02:17.398 INFO:tasks.workunit.client.0.smithi191.stderr:listed 2 entries 2023-10-14T00:02:17.449 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/2207486599 2023-10-14T00:02:17.449 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:02:17.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:17.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:17.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:17.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:17.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:17.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:17.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:17.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:17.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:17.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:18.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:17.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:18.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:17.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:18.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:17.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:18.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.003+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:18.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.003+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:18.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.003+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:18.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:18.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:18.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:18.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:18.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:18.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:18.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:18.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.311+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:18.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:18.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:18.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:02:18.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:18.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:18.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:18.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:18.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:18.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:18.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:18.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:18.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:18.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:18.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:18.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:18.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:18.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.559+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:18.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:18.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:18.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:18.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:18.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:18.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:18.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:18.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:18.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:18.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:18.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.855+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:18.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:18.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:18.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:02:18.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:18.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:18.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:18.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:18.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:18.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:18.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:18.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:18.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.919+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:18.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:18.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:18.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:19.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:19.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:19.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:19.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:19.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:19.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:19.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:19.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.067+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:19.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:19.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:19.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:19.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:19.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:19.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:19.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:19.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:21.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:21.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:21.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:21.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:21.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:21.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:21.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:21.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:21.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.399+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:21.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:21.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:21.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:21.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:21.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:21.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:21.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:21.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:21.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:21.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:21.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.503+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:21.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.515+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:21.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.515+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:21.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:21.515+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:22.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:22.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:22.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:22.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:22.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:22.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:22.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:22.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:22.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:22.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.259+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:22.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:22.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:22.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:22.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:22.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:22.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:22.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.751+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:22.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.751+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:22.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:22.751+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:23.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:23.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:23.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:23.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:23.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:23.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:23.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:23.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:23.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:23.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.111+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:23.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:23.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:23.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:23.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:23.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.695+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:23.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:23.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:23.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:23.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:23.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:23.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:23.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:23.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:23.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:23.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:23.907+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:24.514 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:24.511+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:02:24.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:24.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:24.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:24.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:24.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:24.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:24.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:24.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:24.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:24.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:24.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:24.819+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:25.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:25.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:25.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:25.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:25.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:25.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:25.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:25.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:25.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:25.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:25.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:25.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:25.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:25.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:25.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:25.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:25.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.795+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:25.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:25.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:25.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:26.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:26.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:02:26.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:26.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:26.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:26.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:26.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:26.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:26.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:26.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:26.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:26.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:26.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:26.191+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:26.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:26.191+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:27.458 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:02:27.463 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:02:27.480 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:02:27.488 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:02:28.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:02:28.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:28.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:28.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:28.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:28.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:28.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:28.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:28.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:28.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:28.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:28.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.286+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:28.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:28.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:28.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:28.841 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2207486599 2023-10-14T00:02:28.841 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:02:28.842 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241748 2023-10-14T00:02:28.842 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:02:28.842 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2207486599 ]] 2023-10-14T00:02:28.843 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2207486599 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\2\0\7\4\8\6\5\9\9 ]] 2023-10-14T00:02:28.843 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:02:28.924 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:28.922+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:02:29.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:29.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:02:29.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:29.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:29.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:29.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:29.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:29.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:29.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:29.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:29.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.678+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:29.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:29.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:29.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:29.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:29.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:29.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:29.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.882+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:29.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:29.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:29.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:29.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:29.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.922+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:29.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.938+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:29.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:29.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:29.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:30.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:30.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:02:30.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:30.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:30.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:30.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:30.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:30.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:30.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:30.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:30.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.430+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:30.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.434+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:30.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:30.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:30.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:02:30.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:30.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:02:30.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:30.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:30.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:30.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:30.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:30.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:30.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:30.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:30.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:30.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.510+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:30.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.510+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:30.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.510+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:30.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:30.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:30.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:30.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:30.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:30.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:30.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.682+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:30.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:30.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:30.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:33.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:02:33.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:33.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:02:33.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:33.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:33.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:33.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:33.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:33.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:33.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:33.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:33.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:33.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.850+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:33.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:33.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:33.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:37.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:37.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:37.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:37.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:37.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:37.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:37.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:37.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:37.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:37.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:37.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:37.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:37.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:37.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:37.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:37.566+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:37.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:37.566+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:37.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:37.566+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:38.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:38.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:38.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:38.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:38.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:38.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:38.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:38.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:38.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:38.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:38.843 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:02:38.844 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:02:38.844 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:02:38.845 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:02:38.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:38.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:38.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:38.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:38.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:38.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:38.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:38.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:38.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:38.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:39.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:39.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:39.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:39.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:39.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:39.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:39.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:39.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:39.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:39.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:39.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:39.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:39.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:39.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:39.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:39.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:39.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:39.942+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:39.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:39.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:39.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:39.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:40.232 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2207486599 2023-10-14T00:02:40.232 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:02:40.232 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241760 2023-10-14T00:02:40.233 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:02:40.233 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2207486599 ]] 2023-10-14T00:02:40.233 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2207486599 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\2\0\7\4\8\6\5\9\9 ]] 2023-10-14T00:02:40.233 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:02:40.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:02:40.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:40.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:40.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:40.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:40.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:40.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:40.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:40.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:40.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:40.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.374+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:40.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:40.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:40.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:42.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:42.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:42.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:42.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:42.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:42.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.190+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:42.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:42.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:42.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:42.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:42.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:42.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:42.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:42.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:42.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:42.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:42.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:42.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.598+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:42.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:42.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:42.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:42.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:42.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:42.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:42.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:42.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:42.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:42.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:42.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:42.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.710+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:42.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:42.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:43.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:43.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:43.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:43.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:43.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:43.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:43.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:43.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:43.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:43.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:43.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:43.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:43.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:43.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:47.382 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:47.378+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:02:47.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:47.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:47.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:47.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:47.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:47.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:47.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:47.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:47.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:47.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.434+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:47.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:47.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:02:47.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:47.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:47.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:47.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:47.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:47.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:47.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:47.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:47.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:47.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:47.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.506+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:47.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:47.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:47.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:47.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:47.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:47.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:47.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:47.630+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:48.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:48.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:48.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:48.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:48.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:48.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:48.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:48.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:48.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:48.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:48.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:48.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:48.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:48.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:48.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:48.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:48.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:48.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:48.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:48.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:48.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:48.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:48.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:48.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:48.387 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:48.382+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:02:49.793 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:49.778+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:02:50.248 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:02:50.249 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:02:50.252 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:02:50.255 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:02:50.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:50.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:50.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:50.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:50.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:50.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:50.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:50.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:50.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:50.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:50.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:50.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:50.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:50.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:50.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:50.394+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:50.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:50.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:50.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:50.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:50.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:50.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:51.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:02:51.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:51.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:51.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:51.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:51.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:51.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:51.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:51.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:51.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.350+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:51.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.354+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:51.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:51.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:51.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:51.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:51.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:51.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:51.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:51.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.502+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:51.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:51.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:51.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:51.682 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2207486599 2023-10-14T00:02:51.683 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:02:51.683 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241771 2023-10-14T00:02:51.683 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:02:51.684 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2207486599 ]] 2023-10-14T00:02:51.684 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2207486599 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\2\0\7\4\8\6\5\9\9 ]] 2023-10-14T00:02:51.684 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:02:52.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:52.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:02:52.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:52.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:52.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:52.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:52.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:52.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:52.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:52.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:52.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:52.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.758+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:52.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:52.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:52.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:54.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:02:54.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:02:54.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:02:54.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:54.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:54.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:54.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:54.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:54.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:54.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:54.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.150+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:54.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:54.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.158+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:54.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:54.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:54.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:54.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:54.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:54.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:54.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:54.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:54.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:54.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:54.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:54.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:54.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:54.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.374+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:54.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:54.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:54.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:54.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:54.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:54.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:54.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:54.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:54.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:54.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.654+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:54.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:54.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:54.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:55.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:02:55.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:02:55.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:55.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:55.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:55.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:55.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:55.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:55.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:55.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:55.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:55.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.442+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:55.449 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:55.442+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:02:55.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:55.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:55.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:55.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:55.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:55.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:55.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:55.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:55.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:55.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.922+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:55.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:55.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.962+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:55.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:55.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:55.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:56.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:56.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:56.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:56.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:56.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:56.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:56.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:56.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:56.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.502+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:56.605 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:56.598+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:02:56.620 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:56.618+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:02:56.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:56.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:56.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:56.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:56.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:56.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:56.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:56.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:56.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:56.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.842+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:56.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:56.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:56.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:02:57.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:57.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:57.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:57.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:57.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:57.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:57.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.650+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:57.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.650+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:57.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.650+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:57.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.650+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:02:57.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:02:57.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:02:57.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:02:57.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:57.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:57.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:57.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:57.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:02:57.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:02:57.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:02:57.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:02:57.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:57.690+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:02:58.128 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:02:58.126+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:02:59.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:59.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:02:59.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:59.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:02:59.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:59.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:02:59.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:59.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:02:59.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:02:59.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:00.014 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.010+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.015 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.010+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74057300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.016 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.010+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.016 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.010+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.016 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.010+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.016 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.010+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.023 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.018+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.024 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.018+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.029 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.026+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.029 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.026+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da747ccb80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.060 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.054+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.061 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.054+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.061 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.054+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.061 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.054+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.074 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.070+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.074 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.070+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.084 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.082+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.085 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.082+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.101 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.098+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.101 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.098+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.102 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.098+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.102 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.098+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74138980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.108 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.106+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.109 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.106+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da747ccb80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.110 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.106+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.110 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.106+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.114 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.110+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.114 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.110+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.119 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.114+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.119 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.114+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.126 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.122+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.126 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.122+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.128 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.122+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.128 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.126+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.142+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.147 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.142+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da747cc980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.153 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.150+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.153 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.150+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.154 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.150+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74138000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.154 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:03:00.150+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74057900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:03:00.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:00.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:00.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:00.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:00.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:00.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:00.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:00.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:00.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:00.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:00.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.222+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:00.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:00.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:00.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:01.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:01.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:01.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:01.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:01.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:01.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:01.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:01.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:01.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:01.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.542+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:01.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:01.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:01.686 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:03:01.688 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:03:01.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:01.689 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:03:01.691 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:03:01.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:01.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:01.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:01.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:01.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.754+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:01.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:01.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:01.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:01.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:01.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:01.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:01.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:01.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:01.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:01.830+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:03.119 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2207486599 2023-10-14T00:03:03.130 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:03:03.134 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241783 2023-10-14T00:03:03.134 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:03:03.134 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2207486599 ]] 2023-10-14T00:03:03.135 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2207486599 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\2\0\7\4\8\6\5\9\9 ]] 2023-10-14T00:03:03.135 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:03:04.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:04.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:04.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:04.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:05.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:05.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:05.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:05.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:05.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:05.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:05.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:05.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:05.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:05.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:05.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:05.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.386+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:05.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:05.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:05.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:06.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:06.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:06.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:06.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:06.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:06.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:06.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:06.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:06.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:06.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:06.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.094+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:06.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:06.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:06.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:08.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:08.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:08.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:08.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:08.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.246+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:08.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.246+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:08.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.246+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:08.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:08.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:08.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:08.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:08.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:08.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:08.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:08.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:08.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:08.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.734+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:08.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:08.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:08.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:09.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:09.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:09.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:09.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:09.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:09.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:09.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:09.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:09.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:09.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:09.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.710+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:09.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:09.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:09.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:10.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:03:10.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:10.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:10.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:10.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:10.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:10.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:10.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:10.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:10.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:10.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.982+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:10.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.986+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:10.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:10.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:10.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:11.000 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:03:10.994+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:03:11.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:11.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:11.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:11.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:11.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:11.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:11.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:11.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:11.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:11.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:11.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:11.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:11.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:11.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:11.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:11.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:11.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:11.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:11.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:11.414+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:11.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:11.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:11.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:11.430+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:12.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:12.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:12.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:12.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:12.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:12.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:12.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:12.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:12.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:12.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:12.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:12.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:12.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:12.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:12.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:12.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:12.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:12.521+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:12.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:12.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:12.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:12.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:13.138 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:03:13.142 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:03:13.144 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:03:13.145 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:03:14.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:14.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:14.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:14.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:14.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:14.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:14.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:14.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:14.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:14.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:14.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.089+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:14.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:14.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:14.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:14.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:14.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:14.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:14.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:14.701 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2207486599 2023-10-14T00:03:14.702 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:03:14.702 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241794 2023-10-14T00:03:14.703 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:03:14.703 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2207486599 ]] 2023-10-14T00:03:14.703 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2207486599 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\2\0\7\4\8\6\5\9\9 ]] 2023-10-14T00:03:14.703 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:03:14.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:14.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:14.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:14.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.721+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:14.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:14.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:14.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:15.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:15.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:15.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:15.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:15.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:15.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:15.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.113+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:15.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.113+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:15.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.113+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:15.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:15.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:15.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:15.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:15.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:15.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:15.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:15.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:15.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:15.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:16.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:16.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:16.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:16.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:16.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:16.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:16.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.017+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:16.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:16.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:16.606 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:03:16.601+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:03:16.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:16.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:16.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:16.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:16.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:16.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:16.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.933+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:16.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.933+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:16.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.933+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:16.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.933+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:16.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:16.933+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:17.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:17.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:17.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:17.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:17.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:17.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:17.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:17.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:17.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.145+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:17.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:17.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:17.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:17.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:17.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:17.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:17.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:17.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:17.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:17.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:17.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:17.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.905+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:17.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:17.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:17.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:18.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:18.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:18.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:18.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:18.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:18.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:18.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:18.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.489+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:18.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:18.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:18.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:18.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:18.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:18.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:18.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:18.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:18.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:18.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:18.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:18.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:18.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:18.977+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:19.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.049+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:19.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:19.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:19.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:03:19.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:19.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:19.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:19.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:19.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:19.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:19.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:19.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:19.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:19.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:19.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:19.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.133+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:19.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:19.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:19.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:21.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:21.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:22.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:22.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:22.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:22.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:22.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:22.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:22.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:22.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:22.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:22.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:22.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:22.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:22.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:22.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:22.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:22.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:22.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:22.925+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:22.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:22.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:22.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:22.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:23.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:03:23.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:23.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:23.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:23.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:23.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:23.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:23.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:23.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:23.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:23.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:23.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:23.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.181+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:23.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:23.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:23.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:23.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:23.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:23.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:23.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.597+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:23.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:23.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:24.608 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:03:24.601+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:03:24.707 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:03:24.707 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:03:24.707 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:03:24.716 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:03:25.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:25.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:25.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:25.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:25.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:25.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:25.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:25.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:25.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:25.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:25.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.305+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:25.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:25.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:25.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:26.023 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/31115242 2023-10-14T00:03:26.024 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:03:26.025 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241806 2023-10-14T00:03:26.025 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:03:26.025 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/31115242 ]] 2023-10-14T00:03:26.025 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/31115242 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\2\0\7\4\8\6\5\9\9 ]] 2023-10-14T00:03:26.026 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/31115242 2023-10-14T00:03:26.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:26.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:26.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:26.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:26.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:26.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:26.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:26.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:26.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.761+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:26.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:26.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:26.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:26.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:26.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:26.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:26.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:27.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:27.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:27.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:27.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:27.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:27.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:27.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:27.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.105+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:27.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:27.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.117+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:27.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.117+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:27.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.117+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:27.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:27.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:27.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:27.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:27.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:27.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:27.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:27.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:27.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.745+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:27.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:27.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:27.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:27.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:27.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:27.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:27.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:27.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:27.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:27.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:27.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.977+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:27.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.977+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:27.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:27.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:28.282 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/31115242 until 2023-10-14T01:03:27.479835+0000 (3600 sec) 2023-10-14T00:03:28.330 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:03:28.339 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/31115242 2023-10-14T00:03:29.520 INFO:tasks.workunit.client.0.smithi191.stderr:listed 3 entries 2023-10-14T00:03:29.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:29.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:29.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:29.580 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/31115242 2023-10-14T00:03:29.580 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:03:29.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:29.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:29.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:29.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:29.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:29.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:29.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:29.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:29.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.673+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:29.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.681+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:29.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.681+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:29.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:03:29.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:29.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:29.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:29.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:29.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:29.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:29.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:29.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:29.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:29.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.797+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:29.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.797+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:29.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:29.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:29.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:30.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:30.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:30.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:30.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:30.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:30.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:30.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:30.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:30.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:30.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:30.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:30.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:30.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:30.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:30.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:30.125+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:30.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:30.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:30.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:30.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:31.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:31.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:31.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:31.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:31.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:31.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:31.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:31.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:31.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:31.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.349+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:31.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:31.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:31.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:31.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:31.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:31.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:31.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:31.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:31.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:31.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.717+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:31.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:31.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:31.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:32.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:32.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:32.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:32.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:32.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:32.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:32.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:32.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:32.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:32.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.181+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:32.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:32.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:32.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:03:32.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:32.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:32.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:32.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:32.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:32.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:32.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:32.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:32.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:32.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:32.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.277+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:32.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:32.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:32.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:32.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:32.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:32.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:32.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:32.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:32.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:32.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:32.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.625+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:32.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:32.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:32.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:33.228 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:03:33.225+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:03:35.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:35.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:35.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:35.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:35.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:35.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:35.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:35.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:35.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:35.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.193+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:35.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:35.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:35.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:35.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:35.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:35.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:35.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:35.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:35.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:35.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.425+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:35.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:35.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:35.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:35.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:35.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:35.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:35.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:35.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:35.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.805+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:35.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:35.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:35.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:37.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:37.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:03:37.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:37.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:37.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:37.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:37.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:37.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:37.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:37.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:37.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:37.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:37.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:37.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:37.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:37.705+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:39.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:39.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:39.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:39.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:39.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:39.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:39.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:39.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:39.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:39.229+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:39.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:39.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:39.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:39.249+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:39.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:39.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:39.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:39.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:39.586 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:03:39.586 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:03:39.587 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:03:39.591 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:03:40.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:40.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:40.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:40.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:40.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:40.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:40.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:40.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:40.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:40.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:40.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:40.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:40.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:40.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:40.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:40.377+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:40.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:40.377+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:40.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:40.377+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:40.986 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/31115242 2023-10-14T00:03:40.987 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:03:40.987 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241820 2023-10-14T00:03:40.988 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:03:40.988 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/31115242 ]] 2023-10-14T00:03:40.988 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/31115242 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\1\1\1\5\2\4\2 ]] 2023-10-14T00:03:40.988 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:03:41.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:41.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:41.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:41.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:41.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:41.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:41.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:41.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:41.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:41.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:41.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:41.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:41.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:41.469+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:41.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:41.469+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:41.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:41.469+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:41.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:41.469+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:41.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:41.469+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:42.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:42.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:42.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:42.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:42.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:42.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:42.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:42.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:42.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:42.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.449+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:42.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:42.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:42.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:42.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:43.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:43.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:43.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:43.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:43.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:43.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:43.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:43.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:43.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:43.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:43.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:43.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:43.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:43.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:43.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:43.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:43.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:43.681+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:43.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:43.685+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:43.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:43.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:43.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:43.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:44.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:44.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:44.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:44.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:44.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:44.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:44.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:44.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:44.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:44.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:44.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.601+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:44.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:44.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:44.889 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:03:44.885+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:03:44.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:44.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:44.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:44.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:44.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:45.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:45.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:45.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:45.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:45.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:45.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:45.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.081+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:45.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:45.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:45.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:45.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:45.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:45.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:45.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:45.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:45.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:45.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:45.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:45.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.697+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:45.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:45.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:45.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:03:45.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:45.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:45.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:45.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:45.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:45.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:45.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:45.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:45.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:45.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:45.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.949+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:45.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:45.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:45.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:46.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:46.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:46.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:46.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:46.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:46.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:46.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:46.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:46.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:46.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:46.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:46.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:46.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:46.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:46.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:46.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:46.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:46.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:46.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:46.273+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:46.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:46.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:46.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:46.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:47.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:47.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:47.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:47.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:47.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:47.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:47.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:47.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:47.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:47.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:47.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:47.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:47.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:47.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:47.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:47.293+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:47.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:47.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:47.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:47.345+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:47.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:47.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:47.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:47.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:47.402 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:03:47.397+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:03:47.683 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:03:47.677+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:03:48.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:48.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:48.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:48.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:48.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:48.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:48.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:48.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.521+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:48.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:48.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:48.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:48.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:48.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:48.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:48.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:48.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:48.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:48.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:48.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:50.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:03:50.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:50.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:50.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:50.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:50.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:50.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:50.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:50.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:50.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:50.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:50.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.421+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:50.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:50.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:50.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:50.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:50.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:50.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:50.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:50.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:50.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:50.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:50.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:50.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:50.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.845+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:50.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:50.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:50.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:50.990 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:03:50.990 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:03:50.991 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:03:50.991 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:03:51.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:03:51.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:51.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:51.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:51.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:51.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:51.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:51.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:51.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:51.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:51.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:51.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.349+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:51.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:51.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:51.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:52.418 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/31115242 2023-10-14T00:03:52.422 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:03:52.440 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241832 2023-10-14T00:03:52.441 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:03:52.441 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/31115242 ]] 2023-10-14T00:03:52.441 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/31115242 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\1\1\1\5\2\4\2 ]] 2023-10-14T00:03:52.441 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:03:53.202 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:03:53.197+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:03:56.112 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:03:56.105+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:03:56.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:56.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:56.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:56.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:56.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:56.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:56.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:56.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:56.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:56.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:56.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:56.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:56.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:56.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:56.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:56.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:56.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:56.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:56.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:56.429+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:56.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:56.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:56.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:56.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:58.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:58.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:03:58.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:58.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:58.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:58.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:58.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:58.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:58.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:58.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:58.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:58.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.785+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:58.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:58.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:58.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:59.271 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:03:59.265+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:03:59.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:59.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:59.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:59.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:59.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:59.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:59.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:59.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:59.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:03:59.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.589+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:03:59.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:03:59.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:03:59.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:03:59.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:03:59.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:03:59.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:03:59.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:03:59.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:03:59.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:03:59.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:03:59.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:03:59.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:03:59.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:03:59.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:00.025 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.021+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.026 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.021+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.026 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.021+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da6f898800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.026 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.021+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da6f898a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.027 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.021+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.027 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.021+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da6f898c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.056 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.053+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.057 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.053+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.057 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.053+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.057 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.053+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da6f899000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.057 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.053+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74139400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.058 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.053+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da6f898e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.082 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.077+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.083 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.077+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.083 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.077+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da747cca80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.083 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.077+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74138d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.096 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.093+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.097 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.093+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da6f898700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.107 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.101+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.107 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.101+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da6f898880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.125 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.121+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.125 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.121+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da747cc880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.126 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.121+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.126 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.121+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.126 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.121+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da747ccc00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.126 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.121+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da6f898900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.143 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.137+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.143 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.137+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.143 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.137+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.143 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.137+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.144 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.137+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74139e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.144 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.137+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da6f898b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.144 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.137+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da6f898f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.141+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74138d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.161 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.157+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.162 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.157+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.162 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.157+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.162 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.157+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da6f898e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.162 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.157+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da6f899300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.163 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:04:00.157+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da74139e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:04:00.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:04:00.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:00.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:00.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:00.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:00.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:00.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:00.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:00.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:00.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:00.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.685+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:00.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:00.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:00.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:01.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:04:01.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:01.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:01.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:01.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:01.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:01.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:01.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:01.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.461+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:01.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.469+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:01.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.473+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:01.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:01.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:01.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:01.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:01.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:01.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:01.517+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:02.454 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:04:02.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:02.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:04:02.455 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:04:02.463 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:04:02.468 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:04:02.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:02.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:02.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:02.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:02.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:02.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:02.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:02.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:02.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:02.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:02.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:02.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:02.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:02.573+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:02.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:02.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:03.927 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/31115242 2023-10-14T00:04:03.928 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:04:03.928 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241843 2023-10-14T00:04:03.928 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:04:03.929 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/31115242 ]] 2023-10-14T00:04:03.929 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/31115242 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\1\1\1\5\2\4\2 ]] 2023-10-14T00:04:03.929 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:04:04.471 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:04:04.465+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:04:06.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:04:06.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:06.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:06.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:06.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:06.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:06.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:06.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:06.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:06.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.333+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:06.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:06.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:06.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:04:06.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:04:06.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:06.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:06.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:06.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:06.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:06.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:06.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:06.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:06.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:06.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.869+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:06.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:06.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:06.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:06.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:07.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:07.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:07.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:07.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:07.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:07.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:07.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:07.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:07.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.033+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:07.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:07.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:07.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:04:07.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:07.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:07.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:07.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:07.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:07.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:07.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:07.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:07.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:07.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.597+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:07.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:07.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:07.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:09.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:04:09.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:09.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:09.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:09.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:09.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:09.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:09.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:09.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:09.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:09.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.061+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:09.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.061+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:09.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.061+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:09.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:09.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:09.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:09.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:09.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:09.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:09.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:09.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:09.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:09.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.237+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:09.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:09.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:09.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:09.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:09.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:09.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:09.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:09.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:09.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.797+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:09.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.797+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:09.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.797+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:09.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.797+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:09.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.797+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:09.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:04:09.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:09.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:09.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:09.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:11.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:11.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:11.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:11.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:11.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:11.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:11.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:11.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:11.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.717+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:11.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:11.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:04:11.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:11.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:11.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:11.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:11.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:11.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:11.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:11.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.813+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:11.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:11.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:12.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:12.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:12.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.081+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:12.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:12.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:12.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:12.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:12.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:12.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:12.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:12.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:12.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:12.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.333+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:12.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:12.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:12.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:04:12.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:12.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:12.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:12.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:12.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:12.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:12.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.537+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:12.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:12.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:13.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:13.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:13.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:13.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:13.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:13.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:13.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:13.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.169+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:13.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:13.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:13.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:04:13.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:04:13.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:13.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:13.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:13.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:13.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:13.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:13.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:13.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:13.935 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:04:13.945 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:04:13.946 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:04:13.963 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:04:14.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:14.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:14.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:14.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:14.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:14.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:14.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:14.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:14.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:14.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:14.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:14.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:14.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:14.537+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:14.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:14.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:15.297 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/31115242 2023-10-14T00:04:15.298 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:04:15.298 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241855 2023-10-14T00:04:15.298 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:04:15.299 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/31115242 ]] 2023-10-14T00:04:15.299 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/31115242 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\1\1\1\5\2\4\2 ]] 2023-10-14T00:04:15.299 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:04:15.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:15.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:15.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:15.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:15.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:15.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:15.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:15.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:15.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:15.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:15.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:15.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:15.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:15.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:15.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:15.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:15.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:15.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:15.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:15.609+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:15.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:15.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:15.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:15.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:16.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:16.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:16.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:16.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:16.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:16.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:16.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:16.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:16.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:16.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:16.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:16.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:16.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:16.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:16.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:16.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:17.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:16.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:17.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:17.009+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:17.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:17.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:17.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:17.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:18.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:18.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:18.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:18.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:18.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:18.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:18.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:18.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:18.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:18.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:18.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:18.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:19.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.013+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:19.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.013+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:19.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.013+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:19.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.013+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:19.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:19.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:19.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:19.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:19.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:19.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:19.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:19.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:19.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:19.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.877+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:19.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:19.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:19.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:20.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:20.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:20.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:20.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:20.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:20.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:20.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:20.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.141+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:20.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:20.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:20.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:20.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:20.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:20.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.905+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:20.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:20.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:20.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:21.840 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:04:21.833+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:04:22.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:22.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:04:22.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:22.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:22.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:22.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:22.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:22.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:22.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:22.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:22.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:22.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:22.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:22.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:22.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:22.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:22.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:22.221+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:22.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:22.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:22.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:22.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:22.314 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:04:22.309+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:04:23.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:23.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:23.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:23.229+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:23.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:23.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:23.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:23.237+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:23.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:23.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:23.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:23.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:24.786 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:04:24.781+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:04:24.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:04:24.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:24.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:24.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:24.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:24.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:24.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:24.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:24.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:24.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:24.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.993+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:24.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:24.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:24.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:25.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:04:25.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:25.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:25.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:25.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:25.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:25.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:25.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:25.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:25.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.077+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:25.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:25.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:25.301 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:04:25.304 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:04:25.304 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:04:25.313 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:04:25.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:25.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:25.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:25.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:25.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:25.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:25.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:25.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:26.525 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/31115242 2023-10-14T00:04:26.525 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:04:26.526 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241866 2023-10-14T00:04:26.526 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:04:26.526 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/31115242 ]] 2023-10-14T00:04:26.527 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/31115242 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\1\1\1\5\2\4\2 ]] 2023-10-14T00:04:26.527 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:04:27.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:27.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:27.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:27.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:27.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:27.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:27.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:27.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:27.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:27.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:27.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:27.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:27.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:27.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:27.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.557+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:27.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:27.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:27.840 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:04:27.837+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:04:27.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:27.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:27.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:27.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:27.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:27.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:27.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:27.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.865+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:27.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:27.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.885+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:27.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:27.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:27.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:28.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:28.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:28.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:28.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:28.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:28.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:28.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:28.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:28.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:28.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:28.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:28.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:29.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:29.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:29.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:29.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:29.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:29.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:29.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:29.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:29.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:29.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:29.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:29.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:29.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:29.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:29.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:29.665+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:29.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:29.665+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:29.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:29.665+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:31.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:31.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:04:31.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:31.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:31.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:31.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:31.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:31.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:31.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:31.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:31.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:31.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:31.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:31.401+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:31.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:31.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:32.330 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:04:32.325+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:04:33.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:33.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:33.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:33.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:33.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:33.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:34.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:34.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:34.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:34.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:34.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:34.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:34.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.173+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:34.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.177+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:34.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:34.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:34.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:34.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:34.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:34.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:34.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:34.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:34.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.437+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:34.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:34.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:34.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:34.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:34.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:34.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:34.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:34.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:34.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:34.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.765+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:34.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:34.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:34.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:35.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:35.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:35.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:35.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:35.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:35.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:35.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:35.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.269+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:35.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:35.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:35.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:35.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:35.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:35.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:35.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:35.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:35.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:35.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:35.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.537+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:35.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:35.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:36.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:04:36.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:36.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:36.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:36.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:36.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:36.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:36.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:36.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:36.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:36.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.129+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:36.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:36.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:36.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:04:36.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:36.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:36.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:36.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:36.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:36.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:36.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:36.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:36.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:36.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.349+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:36.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:36.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:36.548 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:04:36.548 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:04:36.553 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:04:36.559 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:04:36.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:36.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:36.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:36.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:36.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:36.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:36.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:36.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.909+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:36.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:36.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:36.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:37.015 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:04:37.009+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:04:37.694 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2158850323 2023-10-14T00:04:37.695 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:04:37.696 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241877 2023-10-14T00:04:37.696 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:04:37.696 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2158850323 ]] 2023-10-14T00:04:37.696 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2158850323 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\1\1\1\5\2\4\2 ]] 2023-10-14T00:04:37.696 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/2158850323 2023-10-14T00:04:38.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:38.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:38.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:38.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:38.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.209+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:38.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:38.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:38.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:38.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:38.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:38.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:38.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:38.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:38.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:38.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:38.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:38.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.353+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:38.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:38.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:38.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:40.337 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/2158850323 until 2023-10-14T01:04:39.660135+0000 (3600 sec) 2023-10-14T00:04:40.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:04:40.385 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/2158850323 2023-10-14T00:04:41.584 INFO:tasks.workunit.client.0.smithi191.stderr:listed 4 entries 2023-10-14T00:04:41.638 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/2158850323 2023-10-14T00:04:41.638 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:04:44.372 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:04:44.368+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:04:44.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:44.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:04:44.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:44.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:44.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:44.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:44.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:44.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:44.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:44.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:44.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:44.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:44.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:44.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:44.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:44.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:44.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:44.904+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:44.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:44.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:44.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:44.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:45.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:45.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:45.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:45.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:45.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:45.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:45.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:45.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.040+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:45.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:45.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:45.231 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:04:45.224+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:04:45.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:45.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:45.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:45.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:45.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:45.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:45.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:45.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:45.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.796+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:45.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:45.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:45.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:46.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:46.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:46.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:46.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:46.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:46.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:46.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:46.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:46.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:46.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:46.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:46.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:46.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:46.968+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:46.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:46.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:47.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:47.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:47.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:47.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:47.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:47.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:47.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:47.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:47.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:47.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:47.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:47.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:47.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:47.056+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:47.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:47.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:47.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:47.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:47.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:47.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:47.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:47.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:47.727 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:04:47.724+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:04:49.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:49.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:49.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:49.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:49.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:49.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:49.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:49.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:49.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:49.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:49.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:49.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:49.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:49.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:49.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:49.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:49.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:49.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:50.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:49.996+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:50.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:50.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:50.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:50.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:50.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:50.584+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:50.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:50.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:50.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:50.624+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:50.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:50.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:50.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:50.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:51.644 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:04:51.660 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:04:51.675 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:04:51.676 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:04:51.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:51.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:04:51.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:51.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:52.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:52.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:52.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:52.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:52.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:52.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:52.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.064+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:52.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:52.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:52.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:52.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:52.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:52.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:52.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:52.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:52.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:52.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:52.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:52.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:52.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:04:53.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:53.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:53.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:53.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:53.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:53.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:53.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.020+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:53.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.020+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:53.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.020+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:53.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.020+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:53.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.020+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:53.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:53.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:53.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:53.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:53.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:53.140 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2158850323 2023-10-14T00:04:53.140 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:04:53.156 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241893 2023-10-14T00:04:53.156 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:04:53.156 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2158850323 ]] 2023-10-14T00:04:53.156 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2158850323 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\1\5\8\8\5\0\3\2\3 ]] 2023-10-14T00:04:53.157 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:04:53.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:04:53.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:04:53.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:53.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:53.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:53.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:53.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:53.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:53.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:53.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:53.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:53.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.412+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:53.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:53.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:53.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:04:53.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:04:53.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:53.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:53.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:53.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:53.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:53.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:53.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:53.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:53.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:53.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:53.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:54.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:54.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:54.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:54.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:54.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:54.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:54.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:54.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:54.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:54.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:54.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:54.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:54.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:54.144+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:54.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:54.148+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:54.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:54.148+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:55.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:04:55.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:55.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:55.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:55.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:55.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:55.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:55.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:55.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.364+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:55.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:55.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:55.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:04:55.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:55.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:55.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:55.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:55.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:55.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:55.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:55.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:55.412+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:56.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:04:56.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:04:56.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:56.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:56.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:56.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:56.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:56.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:56.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:56.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:56.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:56.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.436+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:56.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:56.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:56.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:57.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:57.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:57.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:57.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:57.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:57.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:57.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:57.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:57.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.464+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:57.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.476+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:57.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:57.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:57.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:57.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:57.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:57.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:57.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:57.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:57.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:57.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:57.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:57.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.620+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:57.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.636+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:57.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.636+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:04:57.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:04:57.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:57.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:04:57.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:04:57.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:57.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:57.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:57.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:57.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:59.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:59.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:04:59.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:59.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:04:59.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:59.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:04:59.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:59.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:04:59.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:59.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:04:59.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:59.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:04:59.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:59.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:04:59.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:59.404+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:04:59.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:59.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:04:59.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:04:59.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:00.008 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.000+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.008 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.000+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c75880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.009 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.000+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.009 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.000+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c75a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.017 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.012+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.017 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.012+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c75c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.026 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.020+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.027 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.020+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c75e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.040 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.036+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.040 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.036+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da6f898e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.045 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.040+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.046 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.040+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da73d6d100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.064 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.060+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.064 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.060+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c27c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.076 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.072+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.076 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.072+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c75d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.077 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.072+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.077 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.072+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c75a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.094 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.088+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.094 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.088+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c75880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.094 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.088+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.094 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.088+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da73ff4500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.123 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.116+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.124 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.116+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c75e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.127 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.120+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.127 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.120+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74cc4100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.143 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.136+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.144 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.136+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74cc4300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.148 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.144+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.149 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.144+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74cc4500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.152 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.148+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.153 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.148+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74cc4700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.157 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.152+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.157 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.152+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74cc4900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.185 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.180+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.186 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.180+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74cc4b00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.186 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.180+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.186 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.180+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74cc4d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.192 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.188+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.193 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:00.188+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74cc4f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:00.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:05:00.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:00.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:00.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:00.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:00.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:00.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:00.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:00.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:00.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:00.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:00.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.320+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:00.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:00.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:00.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:00.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:00.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:00.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:00.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:00.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:00.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:00.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:00.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.424+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:00.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:00.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:00.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:00.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:00.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:00.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:00.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:00.673 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:05:00.668+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:05:00.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:00.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.684+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:00.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:00.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:00.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:00.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:00.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:00.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:00.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:00.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.912+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:00.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:00.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:00.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:00.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:00.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:00.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:00.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:01.010 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:05:01.004+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:05:01.558 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:05:01.552+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:05:01.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:01.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:01.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:01.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:01.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:01.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:01.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:01.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:01.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:01.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:01.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.936+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:01.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:01.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:01.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:03.124 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:05:03.124+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:05:03.163 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:05:03.170 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:05:03.182 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:05:03.183 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:05:04.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:04.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:04.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:04.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:04.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:04.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:04.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:04.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:04.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:04.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:04.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:04.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:04.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:04.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:04.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:04.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:04.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:04.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:04.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:04.380+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:04.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:04.380+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:04.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:04.380+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:04.544 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2158850323 2023-10-14T00:05:04.544 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:05:04.545 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241904 2023-10-14T00:05:04.545 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:05:04.545 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2158850323 ]] 2023-10-14T00:05:04.546 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2158850323 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\1\5\8\8\5\0\3\2\3 ]] 2023-10-14T00:05:04.546 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:05:05.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:05.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:05.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:05.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:05.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:05.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:05.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:05.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:05.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:05.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:05.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:05.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:05.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.796+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:05.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:05.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:05.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:06.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:06.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:06.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:06.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:06.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:06.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:06.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:06.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:06.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:06.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:06.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:06.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:06.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:06.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:06.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:06.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:06.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:06.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:06.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:06.456+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:06.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:06.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:06.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:06.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:10.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:10.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:10.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:10.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:10.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:10.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:10.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:10.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:10.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:10.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:10.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:10.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:10.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:10.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:10.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:10.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:10.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:10.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:10.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:10.696+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:10.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:10.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:10.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:10.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:11.027 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:05:11.024+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:05:11.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:05:11.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:05:11.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:11.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:11.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:11.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:11.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:11.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:11.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:11.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:11.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.940+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:11.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.940+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:11.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.940+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:11.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.940+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:11.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:11.940+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:13.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:13.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:13.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:13.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:13.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:13.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:13.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.300+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:13.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:13.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:13.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:05:13.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:13.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:13.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:13.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:13.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:13.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:13.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:13.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:13.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:13.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.404+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:13.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:13.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:13.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:14.295 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:05:14.292+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:05:14.557 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:05:14.568 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:05:14.568 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:05:14.572 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:05:14.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:14.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:05:14.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:14.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:14.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:14.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:14.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:14.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:14.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:14.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:14.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:14.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:14.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:14.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:14.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:14.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:14.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:14.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:14.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:14.892+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:14.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:14.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:14.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:14.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:15.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:15.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:15.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:15.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:15.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:15.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:15.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:15.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:15.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:15.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.140+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:15.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:15.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:15.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:15.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:15.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:15.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:15.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:15.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:15.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:15.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:15.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.532+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:15.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.532+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:15.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.532+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:15.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.532+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:15.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:15.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:15.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:15.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:15.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:15.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:15.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:15.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:15.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:15.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:15.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:15.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:15.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:16.334 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2158850323 2023-10-14T00:05:16.338 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:05:16.339 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241916 2023-10-14T00:05:16.339 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:05:16.339 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2158850323 ]] 2023-10-14T00:05:16.339 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2158850323 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\1\5\8\8\5\0\3\2\3 ]] 2023-10-14T00:05:16.339 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:05:16.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:16.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:16.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:16.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:16.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:16.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:16.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:16.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:16.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:16.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:16.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.704+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:16.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:16.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:16.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:17.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:17.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:17.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:17.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:17.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:17.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.212+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:17.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:17.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:17.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:17.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:17.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:17.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:17.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:17.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:17.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:05:18.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:18.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:18.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:18.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:18.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:18.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:18.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:18.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:18.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:18.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:18.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:18.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:18.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:18.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:18.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:18.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:18.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:18.096+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:18.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:18.104+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:18.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:18.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:18.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:18.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:21.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:21.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:21.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:21.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:21.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:21.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:21.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:21.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:21.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:21.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:21.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:21.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:21.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:21.452+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:21.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:21.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:21.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:21.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:21.768 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:05:21.768+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:05:22.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:22.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:22.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:22.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:22.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:22.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:22.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:22.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:22.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:22.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:22.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:22.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:22.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:22.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:23.943 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:05:23.940+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:05:24.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:24.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:24.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:24.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:24.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:24.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:24.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:24.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:24.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:24.808+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:26.352 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:05:26.353 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:05:26.357 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:05:26.368 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:05:26.368+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:05:26.373 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:05:26.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:26.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:26.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:26.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:26.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:26.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:26.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:26.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:26.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:26.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:26.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:26.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:26.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:26.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:26.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:26.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:26.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:26.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:26.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:26.996+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:26.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:26.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:26.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:26.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:27.498 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2158850323 2023-10-14T00:05:27.498 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:05:27.499 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241927 2023-10-14T00:05:27.500 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:05:27.500 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2158850323 ]] 2023-10-14T00:05:27.500 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2158850323 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\1\5\8\8\5\0\3\2\3 ]] 2023-10-14T00:05:27.500 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:05:27.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:27.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:27.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:27.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:27.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:27.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:27.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:27.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:27.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:27.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:27.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:27.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:27.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:27.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:28.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:28.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:28.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:28.020+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:28.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:28.028+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:28.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:28.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:28.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:28.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:29.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:29.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:29.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:29.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:29.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:29.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:29.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:29.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:29.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:29.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.232+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:29.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:29.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:29.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:29.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:29.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:29.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:29.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:29.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:29.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:29.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:29.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.396+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:29.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:29.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:29.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:29.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:29.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:29.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:29.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:29.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:29.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:30.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:30.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:30.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:30.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:30.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:30.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:30.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:30.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:30.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:30.084+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:30.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:30.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:30.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:30.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:31.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:31.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:31.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:31.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:31.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:31.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:31.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:31.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.316+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:31.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:31.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:31.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:31.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:31.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:31.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:31.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:31.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:31.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:31.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:31.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:31.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.892+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:31.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:31.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:31.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:31.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:32.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:32.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:32.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:32.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:32.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:32.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:32.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:32.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:32.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:32.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:32.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:32.016+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:32.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:32.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:32.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:32.036+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:32.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:32.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:32.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:32.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:33.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:33.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:33.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:33.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:33.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:33.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:33.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:33.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.212+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:33.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.232+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:33.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:33.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:33.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:33.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:33.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:33.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:33.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:33.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:33.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:33.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:33.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.592+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:33.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:33.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:33.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:34.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:34.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:34.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:34.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:34.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:34.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:34.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:34.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:34.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.232+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:34.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:34.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:34.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:34.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:34.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:34.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:34.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:34.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:34.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:34.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:34.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:05:34.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:05:34.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:34.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:34.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:34.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:34.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:34.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:34.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:34.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:34.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:37.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:05:37.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:37.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:37.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:37.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:37.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:37.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:37.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:37.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:37.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:37.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:37.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.428+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:37.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:37.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:37.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:37.509 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:05:37.511 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:05:37.512 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:05:37.533 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:05:38.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:38.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:38.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:38.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:38.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:38.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:38.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:38.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:38.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:38.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:38.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:38.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:38.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:38.328+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:38.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:38.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:38.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:38.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:38.970 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2158850323 2023-10-14T00:05:38.971 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:05:38.972 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241938 2023-10-14T00:05:38.972 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:05:38.972 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2158850323 ]] 2023-10-14T00:05:38.973 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2158850323 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\1\5\8\8\5\0\3\2\3 ]] 2023-10-14T00:05:38.973 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:05:39.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:39.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:39.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:39.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:39.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:39.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:39.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:39.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:39.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:39.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:39.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:39.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:39.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:39.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:39.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:39.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:39.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:39.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:39.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:39.400+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:39.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:39.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:39.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:39.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:40.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:40.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:40.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:40.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:40.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:40.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:40.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:40.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:40.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:40.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:40.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:40.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:40.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:40.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:40.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:40.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:40.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:40.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:40.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:40.736+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:40.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:40.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:40.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:40.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:41.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:05:41.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:41.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:41.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:41.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:41.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:41.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:41.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:41.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:41.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:41.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:41.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.148+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:41.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.152+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:41.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.152+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:41.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:41.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:41.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:41.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:41.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:41.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:42.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:42.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:42.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:42.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:42.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:42.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:42.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:42.004+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:42.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:42.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:42.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:42.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:43.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:43.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:43.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:43.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:43.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:43.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.148+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:43.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.148+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:43.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.148+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:43.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.148+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:43.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.148+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:43.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:05:43.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:43.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:43.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:43.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:43.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:43.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:43.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:43.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:43.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:43.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.360+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:43.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:43.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:43.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:43.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:43.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:43.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:43.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:43.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:43.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:43.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:43.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:45.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:45.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:45.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:45.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:45.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:45.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:45.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:45.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:45.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:45.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:45.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:45.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:45.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:45.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:45.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:45.248+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:45.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:45.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:45.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:45.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:46.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:46.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:46.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:46.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:46.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:46.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:46.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:46.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:46.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:46.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.348+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:46.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:46.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:46.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:46.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:46.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:46.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:46.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:46.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:46.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:46.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:46.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.532+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:46.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:46.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.544+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:46.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:46.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:46.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:47.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:47.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:47.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:47.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:47.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:47.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:47.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:47.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:47.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:47.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:47.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:47.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:47.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:47.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:48.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:05:48.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:48.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:48.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:48.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:48.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:48.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:48.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:48.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:48.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:48.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:48.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.316+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:48.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:48.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:48.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:05:48.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:48.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:48.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:48.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:48.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:48.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:48.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:48.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:48.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:48.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.780+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:48.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:48.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:48.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:48.979 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:05:48.980 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:05:48.981 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:05:48.990 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:05:49.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:49.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:49.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:49.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:49.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:49.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:49.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:49.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:49.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:49.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:49.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.132+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:49.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:49.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:49.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:05:49.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:49.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:49.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:49.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:49.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:49.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:50.356 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1812105209 2023-10-14T00:05:50.356 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:05:50.357 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241950 2023-10-14T00:05:50.358 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:05:50.358 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1812105209 ]] 2023-10-14T00:05:50.358 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1812105209 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\1\5\8\8\5\0\3\2\3 ]] 2023-10-14T00:05:50.358 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/1812105209 2023-10-14T00:05:50.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:50.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:50.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:50.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:50.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:50.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:50.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:50.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:50.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:50.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:50.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:50.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:50.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:50.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:50.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:50.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:50.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:50.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:50.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:50.548+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:50.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:50.576+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:50.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:50.576+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:51.355 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:51.352+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da74aeaa80 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:51.356 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:51.356+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da74aeb380 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:51.372 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:51.372+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da74aeb500 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:51.397 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:51.396+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da74aeb140 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:51.398 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:51.396+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da74aea600 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:51.399 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:51.396+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da74aeb2c0 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:51.399 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:51.396+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da74aeb440 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:51.400 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:51.400+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da74aea300 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:51.400 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:51.400+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da74aea840 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:51.400 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:51.400+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da74aeb800 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:51.401 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:05:51.400+0000 7f3dc575f640 -1 librbd::api::Mirror: image_info_list: failed to list mirror image statuses: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:05:52.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:05:52.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:05:52.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:52.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:52.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:52.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:52.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:52.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:52.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:52.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:52.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:52.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.144+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:52.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:52.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:52.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:52.360 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/1812105209 until 2023-10-14T01:05:51.777536+0000 (3600 sec) 2023-10-14T00:05:52.420 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:05:52.421 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/1812105209 2023-10-14T00:05:53.447 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:05:53.448+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:05:53.603 INFO:tasks.workunit.client.0.smithi191.stderr:listed 5 entries 2023-10-14T00:05:53.645 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/1812105209 2023-10-14T00:05:53.646 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:05:53.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:53.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:53.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:53.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:53.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:53.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:53.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:53.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:55.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:05:55.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:55.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:55.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:55.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:55.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:55.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:55.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:55.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.072+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:55.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.080+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:55.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.096+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:55.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.096+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:55.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.096+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:55.504 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:05:55.504+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:05:55.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:05:55.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:55.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:55.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:55.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:55.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:55.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:55.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:55.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:55.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.948+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:55.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:55.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:55.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:58.205 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:05:58.204+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:05:58.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:58.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:58.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:58.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:58.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:58.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:58.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:58.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:58.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:58.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.356+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:05:58.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:05:58.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:05:58.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:05:58.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:05:58.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:05:58.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:05:58.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:05:58.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:05:58.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:05:58.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.568+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:05:58.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.568+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:05:58.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:05:58.568+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:00.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:00.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:00.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:00.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:00.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:00.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:00.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:00.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:00.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:00.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:00.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:00.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:00.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:00.532+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:00.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:00.532+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:00.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:00.532+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:03.649 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:06:03.649 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:06:03.650 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:06:03.651 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:06:04.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:04.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:04.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:04.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:04.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:04.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:04.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:04.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:04.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:04.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:04.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:04.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:04.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:04.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:04.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:04.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:04.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:04.076+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:04.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:04.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:04.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:04.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:04.603 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3906586957 2023-10-14T00:06:04.603 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:06:04.604 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241964 2023-10-14T00:06:04.604 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:06:04.605 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3906586957 ]] 2023-10-14T00:06:04.605 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3906586957 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\8\1\2\1\0\5\2\0\9 ]] 2023-10-14T00:06:04.605 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/3906586957 2023-10-14T00:06:05.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:05.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:05.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:05.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:05.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:05.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:05.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:05.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.032+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:05.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:05.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:05.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:05.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:05.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:05.325 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:06:05.324+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da7417a900 image watch failed: 94396628380672, (107) Transport endpoint is not connected 2023-10-14T00:06:05.325 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:06:05.324+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da7417a900 handle_error: handle=94396628380672: (107) Transport endpoint is not connected 2023-10-14T00:06:05.326 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:06:05.324+0000 7f3dc8765640 -1 librbd::watcher::RewatchRequest: 0x55da745ea780 handle_unwatch client blocklisted 2023-10-14T00:06:05.326 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:06:05.324+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da7417a900 handle_rewatch: client blocklisted 2023-10-14T00:06:05.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:05.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:05.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:05.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:05.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.368+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:05.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.368+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:05.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.368+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:05.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.368+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:05.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:06:05.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:05.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:05.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:05.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:05.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:05.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:05.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:06.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:06.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:06.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:06.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:06.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.004+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:06.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:06.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:06.283 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/3906586957 until 2023-10-14T01:06:05.517247+0000 (3600 sec) 2023-10-14T00:06:06.290 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:06:06.288+0000 7f3dc7f64640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:06:06.291 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:06:06.288+0000 7f3dc7f64640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da7457d520 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:06:06.291 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:06:06.288+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da7503f080 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:06:06.291 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:06:06.288+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:06:06.292 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:06:06.288+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da7503e580 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:06:06.292 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:06:06.288+0000 7f3dc7f64640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da74b2b580 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:06:06.292 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:06:06.292+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74a5f6e0 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:06:06.337 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:06:06.347 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/3906586957 2023-10-14T00:06:06.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:06.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:06.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:06.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:06.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:06.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.848+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:06.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:06.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.856+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:06.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:06.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:06.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:07.127 INFO:tasks.workunit.client.0.smithi191.stderr:listed 6 entries 2023-10-14T00:06:07.172 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/3906586957 2023-10-14T00:06:07.173 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:06:08.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:06:08.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:08.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:08.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:08.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:08.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:08.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:08.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:08.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:08.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:08.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.804+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:08.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:08.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:08.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:09.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:09.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:09.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:09.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:09.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:09.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:09.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:09.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:09.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:09.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:09.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:09.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:09.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:09.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:09.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:09.112+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:09.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:09.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:09.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:09.124+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:09.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:09.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:09.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:09.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:10.060 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:06:10.060+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:06:11.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:11.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:11.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:11.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:11.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:11.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:11.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:11.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:11.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:11.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:11.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:11.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:11.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:11.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:11.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:11.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:11.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:11.235+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:11.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:11.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:11.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:11.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:11.851 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:06:11.847+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:06:14.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:14.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:14.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:14.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:14.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:14.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:14.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:14.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:14.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:14.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:14.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:14.363+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:14.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:14.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:14.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:14.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:17.174 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:06:17.178 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:06:17.183 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:06:17.204 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:06:17.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:17.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:17.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:17.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:17.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:17.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:17.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:17.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:17.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:17.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:17.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:17.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:17.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:17.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:17.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:17.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:17.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:17.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:17.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:17.783+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:17.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:17.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:17.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:17.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:18.657 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3906586957 2023-10-14T00:06:18.658 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:06:18.658 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241978 2023-10-14T00:06:18.658 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:06:18.659 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3906586957 ]] 2023-10-14T00:06:18.659 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3906586957 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\9\0\6\5\8\6\9\5\7 ]] 2023-10-14T00:06:18.659 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:06:19.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:19.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:19.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:19.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:19.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:19.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:19.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:19.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:19.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:19.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:19.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:19.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:19.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:19.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:19.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:19.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:19.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:19.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:19.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:19.263+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:19.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:19.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:19.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:19.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:20.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:20.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:20.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:20.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:20.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.843+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:20.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.847+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:20.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:20.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:20.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:20.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:20.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:20.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:20.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:21.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:20.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:21.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:21.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:21.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.035+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:21.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.047+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:21.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:21.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:21.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:21.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.631+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:21.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.639+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:21.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.659+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:21.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:21.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:21.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:21.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:21.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:21.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:21.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:21.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:21.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.883+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:21.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:21.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:21.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:22.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:22.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:22.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:22.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:22.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:22.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:22.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:22.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:22.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:22.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:22.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:22.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:22.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:22.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:22.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:22.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:22.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:22.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:22.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:22.707+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:22.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:22.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:22.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:22.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:25.891 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:06:25.887+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:06:26.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:26.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:26.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:26.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:26.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:26.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:26.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:26.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:26.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:26.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:26.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:26.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:26.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:26.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:26.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:26.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:26.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:26.923+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:27.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:06:27.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:27.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:27.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:27.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:27.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:27.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:27.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:27.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:27.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.231+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:27.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:27.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:27.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:27.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:27.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:27.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:28.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:27.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:28.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:28.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:28.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:28.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:28.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:28.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:28.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:28.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:28.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:28.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:28.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:28.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:28.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:28.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:28.664 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:06:28.664 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:06:28.665 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:06:28.665 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:06:30.088 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3906586957 2023-10-14T00:06:30.088 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:06:30.089 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697241990 2023-10-14T00:06:30.089 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:06:30.089 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3906586957 ]] 2023-10-14T00:06:30.090 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3906586957 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\9\0\6\5\8\6\9\5\7 ]] 2023-10-14T00:06:30.090 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:06:30.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:30.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:30.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:30.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:30.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:30.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:30.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:30.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:30.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:30.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:30.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.311+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:30.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:30.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:30.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:31.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:31.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:31.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:31.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:31.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:31.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:31.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:31.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:31.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:31.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:31.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:31.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:31.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:31.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:31.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:31.871+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:31.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:31.871+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:31.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:31.871+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:31.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:31.871+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:31.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:31.871+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:32.101 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:06:32.099+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:06:33.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:33.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:33.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:33.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:33.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:33.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:33.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:33.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:33.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:33.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:33.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.075+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:33.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:33.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:33.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:33.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:33.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:33.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:33.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.727+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:33.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:33.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:33.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:33.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:33.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:33.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:33.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:33.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:33.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:34.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:34.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:34.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.023+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:34.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:34.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.075+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:34.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:34.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:34.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:34.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:34.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:34.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:34.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:34.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:34.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:34.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.191+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:34.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:34.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.219+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:34.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:34.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:34.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:35.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:35.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:34.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:35.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:35.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.015+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:35.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.023+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:35.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:35.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:35.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:35.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:35.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:35.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.639+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:35.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:35.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.667+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:35.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:35.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:35.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:35.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:35.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:35.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:35.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:35.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:35.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:35.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.955+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:35.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:35.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:35.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:36.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:36.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:36.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:36.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:36.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:36.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:36.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:36.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:36.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:36.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:36.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:36.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:36.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:36.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:36.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:36.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:36.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:36.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:36.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:36.699+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:36.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:36.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:36.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:36.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:37.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:06:37.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:06:37.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:37.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:37.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:37.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:37.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:37.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:37.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:37.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:37.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:37.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:37.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:37.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:37.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:37.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:37.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.719+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:37.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:37.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:37.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:06:37.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:37.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:37.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:37.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:37.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:37.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:37.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:37.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:37.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:37.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:37.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.979+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:37.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:37.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:37.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:39.990 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:06:39.983+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T00:06:39.991 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:06:39.983+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:06:39.991 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:06:39.983+0000 7f30478aa640 -1 reset not still connected to 0x55c894ab09c0 2023-10-14T00:06:40.095 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:06:40.097 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:06:40.102 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:06:40.129 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:06:40.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:40.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:40.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:40.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:40.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.403+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:40.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:40.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:40.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:06:40.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:40.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:40.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:40.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:40.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:40.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:40.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:40.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.771+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:40.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.771+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:40.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.799+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:40.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:40.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:40.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:40.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:40.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:40.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:41.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:41.011+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:41.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:41.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:41.402 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3906586957 2023-10-14T00:06:41.402 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:06:41.403 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242001 2023-10-14T00:06:41.403 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:06:41.403 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3906586957 ]] 2023-10-14T00:06:41.404 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3906586957 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\9\0\6\5\8\6\9\5\7 ]] 2023-10-14T00:06:41.404 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:06:42.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:42.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:42.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:42.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:42.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:42.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:42.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:42.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:42.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:42.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:42.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:42.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:42.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:42.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:42.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:42.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:42.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:42.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:42.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:42.315+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:42.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:42.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:42.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:42.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:44.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:44.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:44.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:44.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:44.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:44.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:44.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:44.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:44.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:44.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:44.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:44.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:44.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:44.511+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:44.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:44.527+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:45.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:45.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:45.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:45.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:45.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:45.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:45.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:45.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:45.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:45.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:45.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.671+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:45.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:45.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:45.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:46.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:06:46.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:46.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:46.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:46.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:46.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:46.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:46.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:46.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:46.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.139+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:46.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.143+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:46.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:46.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:46.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:46.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:46.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:46.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:46.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:47.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:47.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:47.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:47.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:47.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:47.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:47.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:47.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:47.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:47.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:47.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:47.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:47.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:47.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:47.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:47.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:47.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:47.431+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:47.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:47.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:47.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:47.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:48.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:48.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:48.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:48.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:48.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:48.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:48.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:48.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:48.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.547+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:48.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:48.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:48.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:48.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:48.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:48.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:48.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:48.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:48.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.767+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:48.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.771+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:48.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.771+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:48.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:48.771+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:49.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:49.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:49.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:49.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:49.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:49.515+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:49.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:49.527+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:49.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:49.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:49.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:49.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:49.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:49.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:49.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:49.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:49.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:49.867+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:49.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:49.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:49.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:49.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:51.404 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:06:51.405 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:06:51.405 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:06:51.410 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:06:51.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:51.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:51.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:51.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:51.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:51.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:51.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:51.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:51.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.615+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:51.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:51.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.623+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:51.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:51.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:51.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:06:51.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:51.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:51.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:51.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:51.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:51.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:51.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:51.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:51.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:51.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:51.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.983+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:51.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:51.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:51.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:52.590 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3906586957 2023-10-14T00:06:52.591 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:06:52.591 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242012 2023-10-14T00:06:52.592 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:06:52.592 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3906586957 ]] 2023-10-14T00:06:52.592 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3906586957 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\9\0\6\5\8\6\9\5\7 ]] 2023-10-14T00:06:52.592 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:06:53.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:53.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:53.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:53.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:53.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:53.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:53.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:53.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.171+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:53.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:53.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.183+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:53.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:53.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:53.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:53.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:53.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:53.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:53.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:53.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:53.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:53.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.323+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:53.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:53.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:53.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:06:53.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:06:53.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:53.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:53.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:53.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:53.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:53.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:53.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:53.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:53.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:53.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.563+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:53.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:53.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:53.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:54.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:54.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:54.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:54.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:54.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:54.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:54.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:54.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:54.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:54.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:54.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.707+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:54.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:54.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:54.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:06:54.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:06:54.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:54.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:54.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:54.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:54.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:54.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:54.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:54.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:54.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:54.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.803+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:54.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.807+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:54.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:54.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:54.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:54.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:54.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:55.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:55.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:55.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:55.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:55.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:55.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:55.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:55.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:55.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:55.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:55.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:55.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:55.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:55.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:55.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:55.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:55.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:55.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:55.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:55.559+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:55.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:55.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:55.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:55.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:57.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:57.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:57.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:57.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:57.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:57.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:57.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:57.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:57.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:57.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:57.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:57.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:57.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:57.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:57.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:57.723+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:57.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:57.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:57.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:57.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:59.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:59.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:59.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:59.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:59.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:59.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:59.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:59.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:59.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.871+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:59.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.871+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:59.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.871+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:59.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:06:59.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:06:59.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:06:59.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:06:59.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:06:59.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:06:59.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:06:59.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:06:59.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:06:59.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:06:59.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:06:59.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.963+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:06:59.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:06:59.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:06:59.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:06:59.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:07:00.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:00.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:00.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:00.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:00.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:00.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.347+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:00.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:00.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:00.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:07:00.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:00.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:00.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:00.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:00.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:00.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:00.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:00.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:00.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:00.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.607+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:00.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:00.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:00.611+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:01.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:07:01.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:01.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:01.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:01.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:01.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:01.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:01.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:01.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:01.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:01.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.891+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:01.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:01.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:01.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:02.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:02.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:02.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:02.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:02.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:02.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:02.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:02.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.267+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:02.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:02.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:02.595 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:07:02.596 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:07:02.596 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:07:02.597 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:07:02.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:02.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:02.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:02.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:02.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:02.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.843+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:02.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:02.843+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:03.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:03.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:03.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:03.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:03.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:03.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:03.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:03.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.203+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:03.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:03.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:03.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:03.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:03.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:03.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:03.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:03.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:03.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:03.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.431+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:03.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:03.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:03.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:07:03.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:03.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:03.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:03.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:03.857 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1445207090 2023-10-14T00:07:03.857 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:07:03.858 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242023 2023-10-14T00:07:03.858 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:07:03.859 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1445207090 ]] 2023-10-14T00:07:03.859 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1445207090 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\9\0\6\5\8\6\9\5\7 ]] 2023-10-14T00:07:03.859 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/1445207090 2023-10-14T00:07:03.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:03.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:03.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:03.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:03.855+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:05.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:05.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:05.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:05.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:05.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:05.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:05.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:05.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:05.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:05.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.247+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:05.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:05.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:05.625 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:07:05.623+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:07:05.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:07:05.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:07:05.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:07:05.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:05.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:05.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:05.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:05.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:05.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:05.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:05.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:05.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:05.971+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:06.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.011+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:06.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:06.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:06.309 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/1445207090 until 2023-10-14T01:07:05.670036+0000 (3600 sec) 2023-10-14T00:07:06.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:06.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:06.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:06.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:06.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:06.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:06.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:06.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:06.375 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/1445207090 2023-10-14T00:07:06.376 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:07:06.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:06.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.387+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:06.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:06.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:06.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:07.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:07.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:07.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:07.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:07.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:07.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:07.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:07.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:07.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:07.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.175+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:07.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:07.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:07.506 INFO:tasks.workunit.client.0.smithi191.stderr:listed 7 entries 2023-10-14T00:07:07.568 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/1445207090 2023-10-14T00:07:07.569 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:07:07.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:07.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:07.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:07.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:07.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:07.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:07.751+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:10.835 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:07:10.835+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:07:10.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:10.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:10.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:10.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:10.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:10.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:10.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:10.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:11.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:11.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:11.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:11.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:11.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.007+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:11.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:11.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:11.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:11.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:11.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:11.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:11.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:11.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:11.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:11.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:11.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:11.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.307+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:11.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:11.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:11.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:13.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:13.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:13.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:13.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:13.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:13.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:13.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:13.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:13.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:13.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.415+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:13.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:13.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:13.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:07:13.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:13.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:13.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:13.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:14.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:13.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:14.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:14.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:14.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:14.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:14.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:14.031+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:14.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:14.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:14.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:14.067+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:14.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:14.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:14.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:14.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:15.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:15.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:15.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:15.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:15.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:15.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:15.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:15.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:15.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:15.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.087+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:15.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:15.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:15.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:15.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:15.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:15.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:15.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:15.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:15.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:15.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.211+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:15.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:15.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:15.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:16.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:16.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:07:16.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:16.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:16.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:16.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:16.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:16.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:16.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:16.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:16.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:16.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:16.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:16.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:16.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:16.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:16.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:16.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:16.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:16.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:16.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:16.267+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:16.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:16.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:17.578 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:07:17.585 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:07:17.586 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:07:17.586 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:07:18.928 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1445207090 2023-10-14T00:07:18.929 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:07:18.931 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242038 2023-10-14T00:07:18.931 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:07:18.931 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1445207090 ]] 2023-10-14T00:07:18.931 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1445207090 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\4\5\2\0\7\0\9\0 ]] 2023-10-14T00:07:18.931 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:07:18.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:18.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:18.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:18.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:18.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:18.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:18.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:18.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:19.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:19.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:19.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:19.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:19.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:19.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.075+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:19.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:19.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:19.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:19.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:19.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:19.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:19.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:19.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:19.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:19.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:19.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:19.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.387+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:19.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:19.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:19.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:20.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:20.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:20.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:20.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:20.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:20.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:20.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:20.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:21.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:21.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:21.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:21.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.031+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:21.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:21.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.059+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:21.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:21.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:21.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:07:21.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:07:21.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:07:21.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:21.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:21.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:21.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:21.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:21.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:21.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:21.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:21.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:21.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.175+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:21.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:21.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:21.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:07:21.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:21.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:21.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:21.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:21.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:21.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:21.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:21.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:21.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:21.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.755+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:21.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:21.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:21.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:22.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:22.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:07:22.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:22.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:22.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:22.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:22.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:22.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:22.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:22.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:22.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:22.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:22.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:22.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:22.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:22.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:22.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:22.703+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:22.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:22.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:22.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:22.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:23.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:23.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:23.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:23.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:23.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:23.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:23.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:23.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:23.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:23.667+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:23.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:23.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:24.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:24.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:24.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:24.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:24.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:24.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:24.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:24.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:24.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:24.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:24.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:24.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:24.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:24.195+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:24.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:24.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:25.122 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:07:25.119+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:07:25.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:25.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:25.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:25.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:25.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:25.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:25.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:25.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:25.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:25.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.575+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:25.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:25.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:25.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:25.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:25.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:25.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:25.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:25.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:25.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:25.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.835+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:25.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:25.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:25.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:26.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:07:26.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:26.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:26.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:26.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:26.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:26.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:26.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:26.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:26.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:26.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.251+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:26.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:26.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:26.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:28.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:28.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:28.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:28.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:28.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:28.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:28.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:28.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:28.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:28.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:28.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:28.383+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:28.943 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:07:28.948 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:07:28.955 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:07:28.971 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:07:29.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:29.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:29.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:29.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:29.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:29.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:29.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:29.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:29.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:29.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:29.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:29.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:29.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:29.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:29.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:29.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:29.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:29.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:29.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:29.567+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:29.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:29.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:29.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:29.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:30.327 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1445207090 2023-10-14T00:07:30.328 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:07:30.328 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242050 2023-10-14T00:07:30.329 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:07:30.329 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1445207090 ]] 2023-10-14T00:07:30.329 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1445207090 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\4\5\2\0\7\0\9\0 ]] 2023-10-14T00:07:30.330 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:07:30.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:30.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:30.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:30.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:30.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:30.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:30.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:30.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:30.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:30.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:30.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:30.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:30.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:30.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:30.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:30.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:30.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:30.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:30.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:30.783+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:30.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:30.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:30.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:30.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:35.420 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:07:35.418+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:07:38.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:38.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:38.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:38.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:38.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:38.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:38.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:38.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:38.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:38.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:38.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:38.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:38.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:38.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:38.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:38.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:38.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:38.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:38.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:38.378+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:38.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:38.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:38.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:38.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:39.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:39.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:39.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:39.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:39.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:39.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:39.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:39.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.390+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:39.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:39.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:39.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:39.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:39.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:39.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:39.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:39.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:39.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:39.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:39.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:39.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.742+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:39.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.742+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:39.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:39.742+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:40.349 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:07:40.354 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:07:40.362 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:07:40.363 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:07:41.718 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1445207090 2023-10-14T00:07:41.718 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:07:41.719 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242061 2023-10-14T00:07:41.720 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:07:41.720 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1445207090 ]] 2023-10-14T00:07:41.721 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1445207090 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\4\5\2\0\7\0\9\0 ]] 2023-10-14T00:07:41.721 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:07:43.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:43.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:07:43.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:43.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:43.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:43.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:43.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:43.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:43.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:43.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:43.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:43.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:43.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:43.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:43.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:43.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:43.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:43.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:43.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:43.174+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:43.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:43.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:43.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:43.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:46.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:46.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:46.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:46.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:46.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:46.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:46.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:46.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.226+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:46.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:46.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:46.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:07:46.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:46.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:46.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:46.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:46.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:46.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:46.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:46.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:46.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:46.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.466+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:46.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:46.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:46.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:47.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:47.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:47.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:47.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:47.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:47.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:47.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:47.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:47.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:47.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:47.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:47.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:47.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:47.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:47.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:47.590+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:47.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:47.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:47.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:47.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:48.263 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:07:48.262+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:07:48.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:07:48.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:48.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:48.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:48.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:48.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:48.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:48.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:48.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:48.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:48.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.978+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:48.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:48.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:48.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:49.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:49.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:49.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:49.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:49.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:49.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:49.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:49.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:49.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.594+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:49.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.594+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:49.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.594+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:49.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:49.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:49.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:49.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:49.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:49.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:49.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:49.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.918+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:49.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:49.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.926+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:49.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:49.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:49.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:50.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:50.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:50.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:50.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:50.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:50.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:50.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:50.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:50.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:50.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:50.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:50.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:50.310 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:07:50.306+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:07:51.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:51.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:51.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:51.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:51.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:51.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:51.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:51.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:51.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:51.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:51.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:51.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:51.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:51.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:51.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:51.342+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:51.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:51.342+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:51.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:51.342+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:51.740 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:07:51.744 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:07:51.759 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:07:51.765 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:07:52.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:52.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:52.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:52.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:52.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:52.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:52.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:52.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:52.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:52.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:52.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:52.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:52.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:52.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:52.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:52.546+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:52.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:52.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:52.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:52.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:52.989 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1445207090 2023-10-14T00:07:52.991 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:07:52.992 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242072 2023-10-14T00:07:52.993 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:07:52.993 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1445207090 ]] 2023-10-14T00:07:52.993 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1445207090 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\4\5\2\0\7\0\9\0 ]] 2023-10-14T00:07:52.993 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:07:54.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:07:54.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:54.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:54.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:54.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:54.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:54.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:54.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:54.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.566+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:54.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:54.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.606+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:54.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.606+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:54.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:54.606+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:56.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:56.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:56.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:56.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:56.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:56.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:56.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:56.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:56.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:56.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:56.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:56.246+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:56.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:56.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:56.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:56.270+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:56.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:56.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:07:56.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:56.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:07:57.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:57.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:57.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:57.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:57.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:57.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:57.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:57.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:57.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:57.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:57.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:57.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:57.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:57.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:57.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.450+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:57.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:07:57.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:07:57.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:57.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:57.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:57.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:57.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:07:57.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.526+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:07:57.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:57.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:57.538+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:07:57.682 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:07:57.678+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:07:58.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:58.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:58.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:58.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:58.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:58.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:58.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:58.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:58.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:58.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:58.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:58.038+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:58.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:58.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:58.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:58.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:58.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:58.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:58.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:58.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:59.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:58.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:07:59.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:59.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:07:59.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:59.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:07:59.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:59.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:07:59.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:59.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:07:59.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:59.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:07:59.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:59.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:07:59.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:07:59.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:00.023 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.018+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.023 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.018+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c26300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.023 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.018+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.024 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.018+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.024 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.018+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da73fd8b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.024 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.018+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da73ff4700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.052 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.052 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.052 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da73fd8c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.054 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da73ff5880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.054 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c74f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.054 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ce4300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.054 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ce4400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.054 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da73ff4780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.055 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.050+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ce5a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.094 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.090+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.094 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.090+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ce5000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.114 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.110+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.114 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.110+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.115 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.110+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ce5080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.115 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.110+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74f83000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.116 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.114+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.116 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.114+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.116 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.114+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74f82e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.116 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.114+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74f82300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.138+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.168 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.138+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74f83200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.169 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.162+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.170 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.162+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.170 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.162+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74f83400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.170 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.162+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74f83600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.170 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.162+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.171 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.162+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74f83800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.171 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.166+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.171 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:00.166+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74f83a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:00.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:08:00.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:00.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:00.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:00.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:00.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:00.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:00.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:00.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:00.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:00.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:00.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:00.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.698+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:00.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:00.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:00.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:01.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:01.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:01.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:01.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:01.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:01.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:01.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:01.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:01.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:01.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:01.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.546+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:01.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:01.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:01.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:03.006 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:08:03.007 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:08:03.015 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:08:03.018 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:08:03.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:03.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:03.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:03.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:03.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:03.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:03.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:03.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:03.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:03.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:03.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:03.546+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:03.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:03.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:03.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:03.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:04.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:04.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:04.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:04.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:04.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:04.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:04.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:04.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:04.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:04.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:04.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:04.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:04.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:04.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:04.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:04.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:04.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:04.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:04.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:04.130+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:04.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:04.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:04.467 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1445207090 2023-10-14T00:08:04.479 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:08:04.480 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242084 2023-10-14T00:08:04.480 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:08:04.480 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1445207090 ]] 2023-10-14T00:08:04.481 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1445207090 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\4\5\2\0\7\0\9\0 ]] 2023-10-14T00:08:04.481 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:08:06.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:06.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:06.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:06.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:06.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:06.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:06.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:06.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:06.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:06.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:06.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.278+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:06.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:06.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:06.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:08.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:08.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:08.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:08.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:08.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:08.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:08.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:08.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:08.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:08.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:08.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:08.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:08.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:08.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:08.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:08.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:08.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:08.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:08.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:08.118+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:08.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:08.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:08.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:08.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:09.482 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:08:09.478+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:08:09.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:09.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:09.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:09.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:09.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:09.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:09.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:09.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:09.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:09.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:09.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:09.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:09.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:09.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:09.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:09.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:09.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:09.886+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:09.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:09.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:09.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:09.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:10.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:10.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:10.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:10.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:10.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:10.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:11.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:10.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:11.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:11.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:11.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:11.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:11.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:11.062+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:11.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:11.074+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:11.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:11.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:11.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:11.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:13.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:13.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:13.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:13.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:13.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:13.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:13.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:13.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:13.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:13.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:13.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:13.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:13.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:13.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:13.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:13.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:13.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:13.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:13.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:13.774+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:13.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:13.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:13.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:13.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:14.486 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:08:14.491 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:08:14.492 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:08:14.533 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:08:14.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:14.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:14.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:14.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:14.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:14.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:14.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:14.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:14.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:14.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:14.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.550+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:14.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:14.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:14.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:15.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:15.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:15.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:15.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:15.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:15.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:15.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:15.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:15.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:15.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.418+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:15.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:15.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:15.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:15.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:15.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:15.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:15.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:15.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:15.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:15.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:15.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.778+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:15.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:15.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:15.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:08:15.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:15.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:15.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:15.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:15.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:15.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:15.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:15.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:15.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:15.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:15.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:15.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:15.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:15.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:15.993 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2614774899 2023-10-14T00:08:15.994 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:08:15.994 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242095 2023-10-14T00:08:15.995 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:08:15.995 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2614774899 ]] 2023-10-14T00:08:15.995 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2614774899 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\4\5\2\0\7\0\9\0 ]] 2023-10-14T00:08:15.995 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/2614774899 2023-10-14T00:08:17.370 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:17.366+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve parent: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:17.370 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:17.366+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to refresh image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:17.370 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:08:17.366+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74139700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:08:17.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:17.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:17.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:17.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:17.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:17.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:17.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:17.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:18.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:18.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:18.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:18.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:18.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:18.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:18.343 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/2614774899 until 2023-10-14T01:08:17.662334+0000 (3600 sec) 2023-10-14T00:08:18.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:18.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:18.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:18.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:18.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:18.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.386+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:18.391 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:08:18.391 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/2614774899 2023-10-14T00:08:18.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:18.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:18.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:18.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:18.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:18.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:18.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:18.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.666+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:18.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.666+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:18.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:18.666+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:19.394 INFO:tasks.workunit.client.0.smithi191.stderr:listed 8 entries 2023-10-14T00:08:19.442 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/2614774899 2023-10-14T00:08:19.442 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:08:19.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:19.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:19.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:19.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:19.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:19.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:19.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:19.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:19.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:19.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:19.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:19.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:19.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:19.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:19.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:19.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:19.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:19.734+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:19.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:19.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:19.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:19.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:22.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:22.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:22.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:22.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:22.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:22.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:22.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.750+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:22.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.750+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:22.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.750+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:22.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.750+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:22.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.750+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:22.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:22.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:22.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:22.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:22.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:22.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:22.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:22.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:22.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:22.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:22.866+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:23.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:23.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:23.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:23.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:23.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:23.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:23.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.106+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:23.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.122+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:23.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:23.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:23.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:23.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:23.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:23.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:23.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:23.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:24.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:24.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:24.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:24.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:24.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:24.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:24.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:24.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:24.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:24.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:24.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:24.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:24.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:24.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:24.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:24.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:24.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:24.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:24.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:24.686+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:24.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:24.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:24.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:24.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:25.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:25.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:25.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:25.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:25.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:25.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:25.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.202+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:25.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:25.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:25.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:25.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:25.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:25.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:25.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:25.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:25.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:25.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.294+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:25.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:25.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:25.591 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:08:25.590+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:08:25.596 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:08:25.594+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:08:25.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:25.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:25.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:25.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:25.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:25.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:25.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:25.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:25.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:25.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:25.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:25.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.786+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:25.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:25.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:25.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:26.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:26.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:26.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:26.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:26.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:26.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:26.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:26.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:26.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:26.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:26.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:26.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:26.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:26.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:26.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:26.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:26.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:26.842+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:26.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:26.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:26.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:26.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:27.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:27.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:27.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:27.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:27.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:27.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:27.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:27.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:27.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:27.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:27.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:27.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:27.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:27.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:27.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:27.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:27.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:27.310+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:27.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:27.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:27.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:27.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:29.466 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:08:29.466 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:08:29.467 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:08:29.467 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:08:30.022 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:08:30.018+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:08:30.123 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:08:30.122+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:08:30.945 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3829908932 2023-10-14T00:08:30.973 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:08:30.974 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242110 2023-10-14T00:08:30.974 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:08:30.975 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3829908932 ]] 2023-10-14T00:08:30.975 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3829908932 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\6\1\4\7\7\4\8\9\9 ]] 2023-10-14T00:08:30.975 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/3829908932 2023-10-14T00:08:31.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:31.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:31.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:31.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:31.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:31.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:31.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:31.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:31.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:31.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:31.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.478+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:31.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:31.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:31.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:32.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:32.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:32.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:32.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:32.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:32.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:32.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:32.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:32.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:32.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:32.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:32.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:32.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:32.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:32.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:32.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:32.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:32.870+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:33.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:33.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:33.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:33.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:33.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:33.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:33.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:33.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:33.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:33.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:33.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.274+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:33.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.278+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:33.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:33.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:33.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:33.394 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/3829908932 until 2023-10-14T01:08:32.701762+0000 (3600 sec) 2023-10-14T00:08:33.452 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:08:33.467 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/3829908932 2023-10-14T00:08:34.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:34.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:34.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:34.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:34.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:34.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:34.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:34.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:34.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:34.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:34.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:34.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:34.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:34.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:34.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:34.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:34.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.422+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:34.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:34.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:34.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:34.502 INFO:tasks.workunit.client.0.smithi191.stderr:listed 9 entries 2023-10-14T00:08:34.541 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/3829908932 2023-10-14T00:08:34.541 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:08:35.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:08:35.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:35.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:35.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:35.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:35.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:35.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:35.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:35.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:35.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:35.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:35.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:35.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.834+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:35.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:35.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:35.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:36.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:36.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:36.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:36.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:36.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:36.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:36.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:36.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:36.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:36.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:36.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:36.194+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:36.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:36.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:36.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:36.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:37.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:37.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:37.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:37.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:37.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:37.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:37.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:37.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:37.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:37.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:37.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:37.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:37.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:37.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:37.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:37.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:37.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:37.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:37.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:37.042+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:37.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:37.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:37.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:37.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:38.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:38.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:38.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:38.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:38.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:38.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:38.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:38.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:38.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:38.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:38.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.134+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:38.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.134+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:38.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.134+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:38.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.134+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:38.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:38.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:38.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:38.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:38.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:38.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:38.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:38.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.350+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:38.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.366+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:38.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:38.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:38.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:38.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:38.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:38.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:38.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:38.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.830+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:38.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:38.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:08:38.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:38.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:38.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:38.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:38.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:38.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:39.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:39.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:39.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:39.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:39.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:39.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:39.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:39.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:39.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:39.026+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:39.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:39.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:39.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:39.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:40.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:40.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:40.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:40.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:40.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:40.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:40.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.718+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:40.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.722+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:40.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:40.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:40.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:40.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:40.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:40.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:40.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:40.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:40.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.982+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:40.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:40.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:41.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:41.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:41.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:41.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:41.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:41.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:42.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:42.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:42.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:42.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:42.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:42.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:42.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:42.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:42.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:42.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:42.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:42.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:42.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:42.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:42.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:42.766+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:42.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:42.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:42.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:42.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:44.547 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:08:44.548 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:08:44.555 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:08:44.560 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:08:45.879 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3829908932 2023-10-14T00:08:45.888 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:08:45.889 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242125 2023-10-14T00:08:45.889 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:08:45.889 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3829908932 ]] 2023-10-14T00:08:45.890 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3829908932 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\8\2\9\9\0\8\9\3\2 ]] 2023-10-14T00:08:45.890 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:08:46.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:08:46.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:46.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:46.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:46.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:46.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:46.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:46.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:46.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:46.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:46.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:46.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:46.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.606+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:46.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.606+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:46.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:46.606+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:47.159 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:08:47.154+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:08:47.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:47.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:47.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:47.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:47.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:47.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:47.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:47.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:47.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:47.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:47.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:47.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:47.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:47.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:47.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:47.298+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:47.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:47.326+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:47.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:47.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:47.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:47.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:47.638 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:08:47.634+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:08:48.953 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:08:48.950+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:08:48.954 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:08:48.950+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:08:49.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:49.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:49.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:49.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:49.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:49.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:49.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:49.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.274+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:49.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:49.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.294+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:49.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.302+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:49.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.302+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:49.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:49.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:49.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:49.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:49.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:49.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:49.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:50.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:50.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:50.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:50.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:50.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:50.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:50.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:50.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:50.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:50.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:50.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.418+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:50.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:50.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:50.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:52.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:51.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:52.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:51.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:52.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:52.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:52.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:52.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:52.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.038+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:52.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:52.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.066+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:52.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:52.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:52.166 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:08:52.162+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T00:08:52.166 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:08:52.162+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:08:52.440 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:08:52.430+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:08:52.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:52.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:52.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:52.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:52.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:52.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:52.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:52.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:52.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.566+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:52.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.566+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:52.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.566+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:52.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.566+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:52.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:52.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:53.016 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:08:53.014+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:08:53.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:53.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:53.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:53.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:53.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:53.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:53.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:53.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:53.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:53.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:53.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:53.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:53.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:53.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:53.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:53.494+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:53.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:53.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:53.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:53.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:54.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:54.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:54.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:54.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:54.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:54.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:54.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:54.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:54.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:54.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:54.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:54.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:54.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:54.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:54.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:54.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:54.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:54.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:54.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:54.306+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:54.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:54.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:54.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:54.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:55.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:55.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:08:55.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:55.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:55.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:55.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:55.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:55.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:55.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:55.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:55.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:55.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:55.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:55.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:55.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:55.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:55.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:55.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:55.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:55.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:55.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:55.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:55.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:55.330+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:55.901 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:08:55.902 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:08:55.905 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:08:55.907 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:08:56.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:56.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:56.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:56.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:56.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:56.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:56.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:56.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:56.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:56.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:56.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.174+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:56.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:56.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:56.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:08:56.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:56.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:08:56.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:56.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:56.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:56.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:56.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:56.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:56.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:56.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:56.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:56.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.734+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:56.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:56.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:56.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:57.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:57.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:57.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:57.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:57.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:57.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:57.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:57.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:57.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:57.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.382+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:57.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:57.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:08:57.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:08:57.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:08:57.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:57.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:08:57.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:57.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:57.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:57.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:57.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:57.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:57.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:57.550 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3829908932 2023-10-14T00:08:57.557 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:08:57.570 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242137 2023-10-14T00:08:57.570 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:08:57.571 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3829908932 ]] 2023-10-14T00:08:57.571 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3829908932 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\8\2\9\9\0\8\9\3\2 ]] 2023-10-14T00:08:57.571 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:08:58.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:58.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:08:58.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:58.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:08:58.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:58.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:08:58.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:58.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:08:58.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:58.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:08:58.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:58.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:08:58.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:58.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:08:58.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:58.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:08:58.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:58.785+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:08:58.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:58.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:08:58.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:08:58.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:00.007 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.005+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.008 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.005+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.008 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.005+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c74200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.008 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.005+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec4180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.009 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.005+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.009 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.005+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec4380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.014 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.009+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.014 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.009+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec4580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.019 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.017+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.020 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.017+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da74ec4780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.026 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.021+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.026 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.021+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec4980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.034 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.029+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.034 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.029+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.034 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.029+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec4f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.034 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.029+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec4e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.077 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.073+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.077 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.073+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.078 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.073+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.078 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.073+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.089 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.085+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.090 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.085+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.123 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.121+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.123 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.121+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec4c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.139 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.137+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.139 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.137+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.139 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.137+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.137+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.137+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.137+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.137+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.137+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5d80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.144 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.141+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.144 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.141+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.147 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.145+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.148 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.145+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476a180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.153 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.149+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.153 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.149+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476a380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.154 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.149+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.154 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:09:00.149+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476a580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:09:00.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:00.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:00.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:00.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:00.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:00.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:00.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.365+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:00.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:00.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:00.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:00.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:00.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:00.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:00.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:00.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:00.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:00.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:00.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:00.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:00.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.969+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:00.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:00.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:00.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:01.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:01.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:09:01.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:01.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:01.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:01.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:01.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:01.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:02.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:02.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:02.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:02.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:02.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:02.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:02.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:02.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:02.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:02.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:02.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:02.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:02.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:02.049+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:02.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:02.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:02.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:02.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:04.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:04.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:04.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:04.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:04.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:04.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:04.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:04.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:04.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:04.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:04.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:04.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:04.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:04.165+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:04.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:04.197+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:04.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:04.225+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:04.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:04.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:04.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:04.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:05.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:05.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:05.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:05.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:05.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:05.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:05.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:05.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:05.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:05.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.097+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:05.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.129+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:05.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:05.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:05.585 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:09:05.581+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:09:05.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:05.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:05.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:05.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:05.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:05.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:05.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:05.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:05.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:05.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.713+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:05.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:05.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:05.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:09:05.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:05.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:05.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:05.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:05.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:05.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:05.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:05.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:05.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:05.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:05.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:05.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:05.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:05.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:05.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:07.440 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:09:07.437+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:09:07.585 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:09:07.585 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:09:07.589 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:09:07.593 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:09:08.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:08.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:08.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:08.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:08.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:08.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:08.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:08.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:08.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:08.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:08.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:08.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:08.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:08.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:08.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:08.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:08.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:08.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:08.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:08.433+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:08.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:08.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:08.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:08.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:09.066 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3829908932 2023-10-14T00:09:09.071 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:09:09.072 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242149 2023-10-14T00:09:09.073 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:09:09.073 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3829908932 ]] 2023-10-14T00:09:09.073 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3829908932 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\8\2\9\9\0\8\9\3\2 ]] 2023-10-14T00:09:09.073 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:09:11.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:11.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:11.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:11.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:11.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:11.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:11.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:11.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:11.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:11.785+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:11.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:11.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:11.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:11.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:12.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:12.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:12.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:12.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:12.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:12.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:12.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:12.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:12.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:12.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.053+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:12.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:12.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:12.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:12.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:12.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:12.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:12.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:12.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:12.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.629+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:12.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:12.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:12.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:12.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:12.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:12.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:12.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:12.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:12.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:12.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:13.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:13.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:13.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:13.001+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:13.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:13.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:13.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:13.037+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:13.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:13.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:13.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:13.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:15.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:15.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:15.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:15.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:15.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:15.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:15.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:15.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:15.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:15.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:15.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.429+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:15.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:15.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:15.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:15.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:15.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:15.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:15.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:15.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:15.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:15.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:15.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:15.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.613+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:15.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:15.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:15.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:16.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:16.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:16.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:16.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:17.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:16.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:17.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:16.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:17.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:17.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:17.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:17.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:17.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:17.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:17.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:17.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:17.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:17.005+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:18.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:18.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:18.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:18.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:19.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:19.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:19.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:19.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.061+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:19.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.061+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:19.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.061+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:19.081 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:09:19.084 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:09:19.097 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:09:19.100 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:09:19.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:19.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:19.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:19.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:19.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:19.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:19.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:19.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:19.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.413+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:19.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.433+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:19.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:19.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:19.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:19.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:19.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:19.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:19.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:19.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:19.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:19.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:19.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:19.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:19.965+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:20.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:20.017+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:20.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:20.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:20.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:20.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:20.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:20.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:20.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:20.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:20.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:20.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:20.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:20.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:20.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:20.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:20.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:20.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:20.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:20.473+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:20.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:20.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:20.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:20.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:20.540 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3829908932 2023-10-14T00:09:20.540 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:09:20.542 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242160 2023-10-14T00:09:20.543 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:09:20.543 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3829908932 ]] 2023-10-14T00:09:20.543 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3829908932 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\8\2\9\9\0\8\9\3\2 ]] 2023-10-14T00:09:20.543 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:09:21.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:09:21.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:21.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:21.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:21.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:21.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:21.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:21.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:21.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:21.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:21.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:21.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.749+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:21.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:21.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:21.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:23.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:23.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:23.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:23.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:23.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:23.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:23.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:23.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:23.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:23.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:23.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:23.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:23.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:23.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:24.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:24.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:24.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:24.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.021+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:24.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:24.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:24.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:09:24.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:24.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:24.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:24.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:24.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:24.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:24.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:24.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:24.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:24.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:24.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.097+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:24.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.097+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:24.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.097+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:24.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:24.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:24.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:24.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:24.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:24.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:24.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:24.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:24.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:24.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.657+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:24.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:24.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:24.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:09:24.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:24.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:24.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:24.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:24.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:24.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:24.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:24.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:24.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:24.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.981+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:24.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:24.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:24.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:25.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:25.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:25.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:25.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:25.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:25.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:25.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:25.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:25.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:25.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:25.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:25.249+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:25.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:25.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:25.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:25.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:25.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:25.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:25.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:25.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:27.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:27.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:27.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:27.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:27.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:27.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:27.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:27.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:27.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.849+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:27.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.853+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:27.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.853+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:27.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.853+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:27.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:09:27.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:27.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:27.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:27.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:27.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:27.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:27.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:27.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:27.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:27.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:27.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.945+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:27.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:27.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:27.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:29.186 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:09:29.181+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:09:29.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:29.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:29.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:29.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:29.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:29.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:29.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:29.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:29.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.461+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:29.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.481+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:29.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:29.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:29.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:29.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.669+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:29.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.681+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:29.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.681+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:29.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:29.681+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:29.926 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:09:29.925+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:09:29.927 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:09:29.925+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:09:30.569 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:09:30.572 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:09:30.572 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:09:30.575 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:09:30.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:30.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:30.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:30.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:30.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:30.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:30.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:30.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:30.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:30.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:30.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:30.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:30.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:30.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:30.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:30.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:30.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:30.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:30.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:30.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:30.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:30.897+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:30.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:30.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:31.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:31.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:31.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:31.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:31.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:31.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:31.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:31.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:31.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.025+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:31.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:31.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:31.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:31.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:31.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:31.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:31.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:31.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:31.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.217+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:31.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:31.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:31.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:32.127 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3829908932 2023-10-14T00:09:32.127 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:09:32.127 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242172 2023-10-14T00:09:32.127 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:09:32.128 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3829908932 ]] 2023-10-14T00:09:32.128 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3829908932 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\8\2\9\9\0\8\9\3\2 ]] 2023-10-14T00:09:32.128 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:09:32.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:32.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:32.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:32.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:32.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:32.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:32.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:32.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:32.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:32.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:32.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:32.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:32.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:32.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:32.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:32.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:32.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:32.285+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:32.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:32.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:32.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:32.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:34.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:34.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:34.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:34.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:34.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:34.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:34.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:34.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:34.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:34.577+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:34.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:34.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:34.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:34.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:35.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:35.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:35.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.061+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:35.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.069+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:35.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:35.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:35.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:35.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:35.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:35.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:35.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.709+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:35.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:35.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:35.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:36.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:36.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:36.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:36.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:36.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:36.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:36.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:36.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:36.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:36.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:36.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:36.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:36.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:36.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:36.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:36.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:36.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:36.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:36.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:36.605+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:36.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:36.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:36.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:36.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:37.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:37.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:37.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:37.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:37.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:37.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:37.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.165+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:37.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:37.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.177+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:37.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:37.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:37.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:09:37.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:37.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:37.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:37.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:37.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:37.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:37.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:37.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:37.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:37.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:37.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:37.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:37.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.701+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:37.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.701+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:37.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.701+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:37.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:37.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:37.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:37.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:37.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:37.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:37.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:37.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:37.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:37.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:37.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.937+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:37.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:37.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:37.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:38.258 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:09:38.253+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:09:38.725 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:09:38.721+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:09:38.728 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:09:38.725+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:09:40.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:09:40.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:40.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:40.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:40.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:40.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:40.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:40.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:40.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:40.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:40.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:40.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.197+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:40.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.197+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:40.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.197+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:40.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:40.197+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:41.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:41.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:41.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:41.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:41.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:41.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:41.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:41.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:41.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.285+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:41.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:41.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:41.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:09:41.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:41.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:41.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:41.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:41.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:41.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:41.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:41.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:41.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.305+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:41.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:41.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:41.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:41.462 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:09:41.457+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:09:42.130 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:09:42.131 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:09:42.132 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:09:42.134 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:09:42.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:42.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:42.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:42.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:42.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:42.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:42.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:42.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:42.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.541+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:42.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:42.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.549+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:42.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:42.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:42.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:42.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:42.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:42.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:42.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:42.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:42.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:42.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:42.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:42.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.917+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:42.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:42.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:42.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:43.626 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2527626298 2023-10-14T00:09:43.628 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:09:43.629 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242183 2023-10-14T00:09:43.630 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:09:43.630 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2527626298 ]] 2023-10-14T00:09:43.630 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2527626298 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\8\2\9\9\0\8\9\3\2 ]] 2023-10-14T00:09:43.630 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/2527626298 2023-10-14T00:09:45.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:45.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:45.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:45.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:45.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:45.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:45.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:45.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:45.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:45.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:45.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:45.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.829+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:45.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:45.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:45.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:46.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:46.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:46.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:46.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:46.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:46.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:46.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:46.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:46.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:46.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:46.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.309+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:46.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:46.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:46.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:46.452 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/2527626298 until 2023-10-14T01:09:45.869812+0000 (3600 sec) 2023-10-14T00:09:46.501 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:09:46.501 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/2527626298 2023-10-14T00:09:47.045 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:09:47.041+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:09:47.638 INFO:tasks.workunit.client.0.smithi191.stderr:listed 10 entries 2023-10-14T00:09:47.696 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/2527626298 2023-10-14T00:09:47.696 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:09:47.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:47.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:47.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:47.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:47.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:47.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:47.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:47.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:47.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:47.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:47.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:47.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:47.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:47.957+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:47.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:47.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:47.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:47.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:48.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:48.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:09:49.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:48.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:49.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:09:49.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:49.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:49.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:49.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:49.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:49.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:49.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:49.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:49.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:49.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.041+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:49.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:49.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:49.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:49.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:49.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:49.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:49.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:49.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:49.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:49.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:49.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.193+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:49.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:49.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:49.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:50.438 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:09:50.437+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:09:51.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:51.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:51.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:51.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:51.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:51.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:51.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:51.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:51.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.569+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:51.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:51.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:51.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:51.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:51.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:51.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:51.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:51.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:51.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.917+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:51.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:51.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.925+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:51.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:51.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:51.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:52.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:52.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:52.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:52.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:52.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:52.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:52.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:52.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:52.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:52.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:52.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:52.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:52.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:52.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:52.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:52.185+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:52.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:52.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:52.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:52.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:53.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:09:53.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:09:53.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:53.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:53.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:53.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:53.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:53.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:53.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:53.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:53.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:53.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.425+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:53.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:53.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:09:53.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:53.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:53.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:53.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:53.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:53.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:53.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:53.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:53.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:53.825+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:54.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:54.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:54.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:54.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:54.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:54.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:54.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:54.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:54.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:54.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:54.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:54.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:54.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:54.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:54.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:54.437+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:54.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:54.437+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:54.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:54.437+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:55.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:55.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:55.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:55.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:55.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:55.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:55.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:55.841+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:55.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:55.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:55.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:55.857+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:55.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:55.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:55.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:55.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:57.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:09:57.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:09:57.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:57.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:57.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:09:57.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:57.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:57.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:57.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.253+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:57.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:57.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:57.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:09:57.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:09:57.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:09:57.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:09:57.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.669+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:09:57.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.681+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:09:57.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.681+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:09:57.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:09:57.681+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:09:57.697 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:09:57.698 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:09:57.707 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:09:57.707 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:09:58.940 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2527626298 2023-10-14T00:09:58.941 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:09:58.942 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242198 2023-10-14T00:09:58.942 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:09:58.942 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2527626298 ]] 2023-10-14T00:09:58.942 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2527626298 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\5\2\7\6\2\6\2\9\8 ]] 2023-10-14T00:09:58.942 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:10:00.034 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.029+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.034 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.029+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74ec5f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.057 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.053+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.058 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.053+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da73f28d80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.064 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.061+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.065 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.061+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da73ff4300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.065 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.061+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.066 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.061+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.066 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.061+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da73ff5380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.066 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.061+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da73fd9200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.066 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.061+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.066 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.061+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74ce5080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.067 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.065+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.067 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.065+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74f83c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.085 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.081+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.086 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.081+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.086 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.081+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.086 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.081+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.086 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.081+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74f82c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.086 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.081+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74cc5d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.087 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.081+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74cc5600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.087 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.081+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74f82d80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.099 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.097+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.099 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.097+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74f82880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.100 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.097+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.100 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.097+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74c27180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.106 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.101+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.106 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.101+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da6f899980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.139 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.137+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.139 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.137+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.137+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.137+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.137+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.137+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da6f899a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.137+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da7476b580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.141 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.137+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da7476b480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.141 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.137+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74c27b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.141 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.137+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74f83c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.141+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:10:00.145+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74138680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:10:00.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:00.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:00.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:00.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:00.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:00.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:00.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:00.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:00.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:00.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:00.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:00.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:00.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:00.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:00.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:00.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:00.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:00.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:00.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:00.857+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:00.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:00.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:00.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:00.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:02.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:02.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:02.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:02.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:02.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:02.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:02.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:02.165+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:02.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:02.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:02.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:02.185+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:02.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:02.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:02.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:02.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:03.273 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:10:03.269+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:10:03.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:03.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:03.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:03.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:03.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:03.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:03.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:03.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:03.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:03.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:03.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:03.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:03.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:03.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:03.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:03.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:04.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.017+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:04.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:04.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:04.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:04.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:04.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:04.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:04.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:04.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:04.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:04.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:04.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.437+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:04.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:04.437+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:05.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:05.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:05.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:05.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:05.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:05.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:05.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:05.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:05.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:05.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:05.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:05.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:05.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:05.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:05.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:05.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:05.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:05.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:05.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:05.745+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:07.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:07.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:07.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:07.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:07.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:07.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:07.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:07.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:07.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:07.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:07.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:07.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:07.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:07.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:07.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:07.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:07.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:07.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:07.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:07.493+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:07.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:07.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:07.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:07.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:08.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:08.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:08.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:08.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:08.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:08.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:08.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:08.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:08.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:08.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:08.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:08.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:08.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:08.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:08.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:08.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:08.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:08.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:08.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:08.281+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:08.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:08.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:08.963 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:10:09.211 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:10:09.211 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:10:09.212 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:10:09.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:09.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:09.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:09.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:09.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:09.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:09.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:09.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:09.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:09.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.077+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:09.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:09.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:09.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:09.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:09.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:09.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:09.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.849+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:09.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:09.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.885+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:09.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:09.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:09.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:09.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:09.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:10.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:10.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:10.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:10.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:10.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:10.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:10.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:10.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:10.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:10.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:10.462 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:10:10.461+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:10:10.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:10.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:10.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:10.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:10.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:10.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:10.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:10.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:10.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:10.477+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:10.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:10.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:10.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:10.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:10.501 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2527626298 2023-10-14T00:10:10.501 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:10:10.503 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242210 2023-10-14T00:10:10.503 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:10:10.504 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2527626298 ]] 2023-10-14T00:10:10.504 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2527626298 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\5\2\7\6\2\6\2\9\8 ]] 2023-10-14T00:10:10.504 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:10:12.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:12.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:12.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:12.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:12.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:12.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:12.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:12.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:12.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:12.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:12.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:12.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:12.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:12.393+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:12.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:12.401+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:12.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:12.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:13.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:13.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:13.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:13.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:13.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:13.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:13.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:13.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.261+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:13.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:13.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:13.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:10:13.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:13.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:13.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:13.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:13.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:13.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:13.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:13.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:13.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:13.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:13.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:13.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:13.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:13.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:13.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:13.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.489+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:13.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:13.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:13.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:13.712 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:10:13.709+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:10:13.713 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:10:13.709+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:10:14.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:14.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:14.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:14.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:14.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:14.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:14.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:14.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:14.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:14.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:14.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:14.137+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:14.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:14.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:14.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:14.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:16.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:16.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:16.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:16.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:16.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:16.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:16.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:16.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.497+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:16.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:16.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.505+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:16.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:16.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:16.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:16.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:16.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:16.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:16.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:16.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:16.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:16.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:16.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:16.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.861+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:16.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:16.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:16.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:17.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:17.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:17.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:17.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:17.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:17.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:17.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:17.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:17.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.665+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:17.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.677+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:17.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:17.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:17.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:17.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:17.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:17.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:17.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:17.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:17.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:17.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.781+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:17.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:17.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:17.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:18.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:18.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:18.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:18.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:18.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:18.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:18.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:18.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:18.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:18.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:18.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:18.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:18.306 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:10:18.301+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:10:18.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:18.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:18.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:18.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:18.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:18.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:18.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:18.369+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:18.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:18.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:18.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:18.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:20.515 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:10:20.518 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:10:20.528 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:10:20.535 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:10:21.142 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:10:21.137+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:10:21.882 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2527626298 2023-10-14T00:10:21.895 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:10:21.898 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242221 2023-10-14T00:10:21.898 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:10:21.898 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2527626298 ]] 2023-10-14T00:10:21.899 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2527626298 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\5\2\7\6\2\6\2\9\8 ]] 2023-10-14T00:10:21.899 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:10:22.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:22.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:22.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.061+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:22.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.073+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:22.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:22.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:22.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:22.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:22.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:22.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:22.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:22.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:22.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:22.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.221+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:22.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:22.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:23.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:23.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:23.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:23.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:23.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:23.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:23.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:23.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:23.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:23.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:23.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:23.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:23.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:23.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:23.787 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:10:23.785+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:10:23.790 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:10:23.789+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:10:25.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:10:25.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:25.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:25.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:25.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:25.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:25.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:25.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:25.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:25.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:25.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:25.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:25.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.741+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:25.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:25.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:25.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:26.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:25.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:26.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:26.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:26.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:26.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:26.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:26.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.037+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:26.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:26.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:26.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:26.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:26.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:26.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:26.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:26.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.965+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:26.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:27.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.997+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:27.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:27.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:26.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:27.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:27.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:27.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:27.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:27.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:27.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:27.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:27.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:27.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:27.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:27.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:27.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:27.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:27.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:27.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:27.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:27.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:27.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:27.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:27.729+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:27.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:27.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:27.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:27.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:28.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:28.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:28.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:28.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:28.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:28.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:28.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:28.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:28.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:28.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.097+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:28.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.101+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:28.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:28.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:28.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:29.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:29.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:29.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:29.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:29.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:29.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:29.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:29.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:29.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:29.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:29.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:29.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:29.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:29.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:29.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:29.785+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:29.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:29.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:29.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:29.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:31.901 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:10:31.905 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:10:31.905 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:10:31.926 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:10:32.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:32.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:32.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:32.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:32.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:32.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:32.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:32.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:32.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:32.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:32.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:32.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:32.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:32.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:32.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:32.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:32.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:32.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:32.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:32.376+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:33.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:33.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:33.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:33.321 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2527626298 2023-10-14T00:10:33.321 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:10:33.322 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242233 2023-10-14T00:10:33.322 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:10:33.323 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2527626298 ]] 2023-10-14T00:10:33.323 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2527626298 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\5\2\7\6\2\6\2\9\8 ]] 2023-10-14T00:10:33.323 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:10:33.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:33.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:33.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:33.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:33.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:33.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.396+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:33.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:33.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:33.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:33.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:33.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:33.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:33.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:33.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:33.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:33.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:33.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.892+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:33.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:33.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:33.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:34.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:34.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:34.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:34.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:34.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:34.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:34.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:34.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:34.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:34.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:34.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:34.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:34.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:34.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:34.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:34.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:34.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:34.696+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:34.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:34.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:34.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:34.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:35.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:35.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:35.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:35.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:35.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:35.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:35.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:35.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:35.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:35.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:35.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:35.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.156+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:35.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:35.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:35.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:35.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:35.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:35.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:35.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:35.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:35.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:35.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:35.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:35.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:35.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:35.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.344+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:35.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:35.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:36.517 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:10:36.512+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:10:37.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:37.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:37.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:37.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:37.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:37.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:37.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:37.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:37.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:37.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:37.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:37.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:37.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:37.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:37.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:37.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:37.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:37.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:37.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:37.936+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:37.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:37.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:37.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:37.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:41.275 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:10:41.272+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:10:42.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:42.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:42.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:42.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:42.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:42.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:42.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:42.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:42.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:42.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:42.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:42.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:42.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:42.828+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:42.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:42.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:42.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:42.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:43.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:43.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:43.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:43.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:43.330 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:10:43.330 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:10:43.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:43.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:43.345 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:10:43.345 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:10:43.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.380+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:43.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.380+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:43.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.380+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:43.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:43.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:43.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:43.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:43.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:43.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:43.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:43.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:43.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:43.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.788+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:43.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:43.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:43.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:10:43.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:43.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:43.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:43.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:43.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:43.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:43.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:43.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:43.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:44.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:10:44.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:44.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:44.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:44.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:44.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:44.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:44.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:44.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:44.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:44.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:44.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:44.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.160+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:44.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:44.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:44.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:10:44.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:44.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:44.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:44.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:44.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:44.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:44.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:44.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:44.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:44.902 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2527626298 2023-10-14T00:10:44.908 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:10:44.909 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242244 2023-10-14T00:10:44.909 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:10:44.910 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2527626298 ]] 2023-10-14T00:10:44.910 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2527626298 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\5\2\7\6\2\6\2\9\8 ]] 2023-10-14T00:10:44.910 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:10:45.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:45.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:45.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:45.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:45.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:45.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:45.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:45.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:45.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:45.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:45.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:45.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:45.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:45.644+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:45.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:45.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:45.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:45.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:46.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:46.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:46.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:46.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:46.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:46.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:46.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:46.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:46.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:46.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:46.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.144+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:46.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:46.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:46.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:47.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:10:47.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:47.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:47.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:47.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:47.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:47.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:47.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:47.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:47.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:47.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.124+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:47.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:47.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:47.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:47.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:47.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:47.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:47.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:47.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:47.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:47.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.820+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:47.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:47.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:47.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:10:47.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:47.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:47.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:47.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:47.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:47.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:47.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:47.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:47.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:47.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.844+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:47.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:47.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:47.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:47.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:47.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:47.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:47.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:47.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:47.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:47.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:48.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:48.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:48.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:48.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:48.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:48.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:48.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:48.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:49.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:49.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:49.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:49.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:49.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:49.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:49.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:49.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:49.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:49.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:49.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:49.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.380+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:49.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.380+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:49.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:49.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:49.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:49.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:49.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:49.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:49.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:49.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:49.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:49.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:49.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.452+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:49.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:49.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:49.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:51.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:51.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:51.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:51.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:51.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:51.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:51.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:51.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:51.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:51.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:51.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.612+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:51.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:51.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:51.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:52.217 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:10:52.216+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:10:52.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:52.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:52.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:52.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:52.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:52.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:52.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:52.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:52.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:52.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:52.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.680+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:52.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:52.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:52.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:54.912 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:10:54.917 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:10:54.918 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:10:54.938 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:10:54.999 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:10:55.000+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:10:55.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:55.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:55.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:55.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:55.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:55.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:55.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.440+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:55.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.444+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:55.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:55.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:55.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:55.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:55.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:55.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:55.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:55.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:55.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:55.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:55.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:55.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:55.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.724+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:55.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:55.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:55.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:55.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:55.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:55.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:55.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:55.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:56.231 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/40477746 2023-10-14T00:10:56.231 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:10:56.247 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242256 2023-10-14T00:10:56.247 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:10:56.247 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/40477746 ]] 2023-10-14T00:10:56.247 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/40477746 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\5\2\7\6\2\6\2\9\8 ]] 2023-10-14T00:10:56.248 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/40477746 2023-10-14T00:10:57.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:57.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:57.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:57.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:57.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.092+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:57.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:10:57.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:57.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:57.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:57.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:57.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:57.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:57.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:57.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:57.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:57.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:57.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.296+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:57.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:57.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:57.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:57.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:57.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:57.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:57.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:57.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:57.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:57.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:57.508+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:58.511 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/40477746 until 2023-10-14T01:10:57.825673+0000 (3600 sec) 2023-10-14T00:10:58.575 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:10:58.585 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/40477746 2023-10-14T00:10:58.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:58.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:58.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:58.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:58.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:58.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:58.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:58.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:58.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:58.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:58.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:58.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:58.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:58.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:58.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:58.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:58.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:58.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:58.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:58.868+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:58.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:58.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:58.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:58.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:59.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:10:59.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:59.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:59.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:59.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:59.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:59.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:59.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:59.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:59.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.372+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:59.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:59.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.416+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:59.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:59.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:59.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:10:59.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:10:59.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:10:59.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:10:59.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:10:59.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:10:59.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:10:59.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:10:59.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:10:59.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:59.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.808+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:10:59.825 INFO:tasks.workunit.client.0.smithi191.stderr:listed 11 entries 2023-10-14T00:10:59.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:10:59.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:10:59.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:10:59.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:10:59.860+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:10:59.869 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/40477746 2023-10-14T00:10:59.869 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:11:00.014 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.016+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.015 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.016+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.015 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.016+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da73ff4300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.015 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.016+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da6f898f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.021 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.020+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.022 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.020+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c74700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.028 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.028+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.028 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.028+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da6f899c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.033 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.032+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.034 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.032+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c74a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.045 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.044+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.045 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.044+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec4f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.048 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.048+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.048 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.048+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec4d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.050 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.052+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.050 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.052+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec4b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.052+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.052+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476ac80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.055 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.056+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.055 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.056+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476a400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:00.090 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.092+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.090 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.092+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da73f29200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:00.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:00.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:00.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:00.100 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.100+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.100 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.100+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da73f28c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.101 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.100+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.101 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.100+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476af00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:00.143 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.144+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.143 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.144+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476b180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.156+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:00.156 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.156+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.156 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.156+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476b880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.162 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.164+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.163 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.164+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476ba80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.163 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.164+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.163 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.164+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.164 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.164+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476bc80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.164 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.164+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476be80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.164 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.164+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.164 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.164+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75168080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.165 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.164+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.165 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:11:00.164+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75168280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:11:00.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:11:00.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:00.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:00.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:00.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:00.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:00.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:00.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:00.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:00.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:00.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:00.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.664+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:00.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:00.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:00.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:01.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:01.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:01.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:01.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:01.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:01.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:01.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:01.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:01.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:01.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:01.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:01.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:01.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:01.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:01.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:01.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:01.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:01.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:01.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:01.716+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:01.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:01.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:01.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:01.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:02.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:02.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:02.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:02.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:02.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:02.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:02.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:02.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:02.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.112+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:02.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.132+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:02.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:02.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:02.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:02.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:11:02.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:02.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:02.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:02.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:02.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:02.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:02.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:02.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:02.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:02.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:02.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.612+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:02.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:02.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:02.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:03.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:03.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:03.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:03.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:03.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:03.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:03.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:03.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:03.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:03.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:03.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:03.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:03.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:03.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:03.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:03.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:03.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:03.656+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:03.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:03.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:03.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:03.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:04.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:04.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:11:04.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:04.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:04.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:04.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:04.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:04.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:04.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:04.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:04.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:04.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.512+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:04.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:04.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:04.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:04.566 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:04.564+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:05.653 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:05.652+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:06.065 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:06.064+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:06.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:06.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:06.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:06.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:06.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:06.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:06.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.828+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:06.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:06.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:06.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:06.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:11:06.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:06.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:06.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:06.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:06.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:06.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:06.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:06.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:06.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:06.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.968+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:06.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:06.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:06.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:07.266 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:07.268+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:07.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:07.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:07.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:07.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:07.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:07.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:07.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:07.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:07.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:07.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:07.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:07.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:07.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:07.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:07.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:07.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:07.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:07.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:07.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:07.632+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:07.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:07.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:07.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:07.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:08.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:08.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:08.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:08.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:08.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:08.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:08.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:08.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:08.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:08.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.612+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:08.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:08.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:08.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:08.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:08.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:08.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:09.778 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:09.772+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:11:09.779 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:09.776+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:09.871 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:11:09.872 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:11:09.874 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:11:09.890 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:11:10.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:10.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:10.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:10.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:10.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:10.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:10.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:10.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:10.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:10.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:10.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:10.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:10.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:10.156+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:10.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:10.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:10.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:10.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:11.378 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/40477746 2023-10-14T00:11:11.381 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:11:11.392 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242271 2023-10-14T00:11:11.393 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:11:11.393 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/40477746 ]] 2023-10-14T00:11:11.393 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/40477746 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\0\4\7\7\7\4\6 ]] 2023-10-14T00:11:11.393 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:11:11.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:11.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:11.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:11.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:11.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:11.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:11.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:11.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:11.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:11.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:11.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:11.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:11.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:11.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:11.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:11.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:11.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:11.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:11.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:11.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:11.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:11.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:11.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:11.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:12.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:12.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:12.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:12.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:12.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:12.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:12.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:12.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:12.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:12.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:12.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:12.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:12.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:12.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:12.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:12.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:12.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:12.676+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:12.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:12.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:12.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:12.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:13.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:13.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:13.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:13.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:13.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:13.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:13.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:13.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:13.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:13.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:13.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:13.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:13.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:13.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:13.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:13.472+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:13.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:13.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:13.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:13.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:14.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:14.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:14.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:14.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:14.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:14.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:14.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:14.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:14.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:14.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:14.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:14.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:14.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:14.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:14.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:14.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:14.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:14.804+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:14.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:14.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:14.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:14.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:15.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:15.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:15.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:15.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:15.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:15.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:15.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:15.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.748+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:15.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:15.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:15.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:15.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:15.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:15.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:15.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:15.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:15.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:15.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:15.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:15.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:16.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.004+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:16.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:16.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:16.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:16.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:16.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:16.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:16.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:16.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:16.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:16.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.360+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:16.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:16.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:16.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:17.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:17.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:17.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:17.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:17.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:17.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:17.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:17.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:17.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:17.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:17.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:17.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:17.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:17.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:17.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:17.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:17.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:17.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:17.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:17.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:17.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:17.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:17.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:17.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.528+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:17.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:17.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:17.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:18.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:18.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:18.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:18.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:18.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:18.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:18.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:18.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:18.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:18.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:18.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:18.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:18.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:18.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:18.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:18.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:18.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:18.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:18.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:18.748+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:18.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:18.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:18.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:18.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:19.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:19.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:19.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:19.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:19.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:19.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:19.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:19.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:19.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:19.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:19.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:19.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:19.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:19.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:19.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:19.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:19.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:19.248+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:19.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:19.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:19.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:19.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:21.414 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:11:21.414 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:11:21.429 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:11:21.432 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:11:21.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:21.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:21.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:21.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:21.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:21.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:21.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:21.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:21.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:21.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:21.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:21.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.780+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:21.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:21.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:21.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:22.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:22.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:22.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:22.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:22.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:22.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:22.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:22.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:22.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:22.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:22.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.532+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:22.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.532+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:22.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:22.532+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:22.685 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/40477746 2023-10-14T00:11:22.686 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:11:22.688 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242282 2023-10-14T00:11:22.688 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:11:22.688 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/40477746 ]] 2023-10-14T00:11:22.689 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/40477746 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\0\4\7\7\7\4\6 ]] 2023-10-14T00:11:22.689 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:11:23.031 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:23.028+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:24.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:24.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:24.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:24.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:24.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:24.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:24.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:24.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:24.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:24.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.264+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:24.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:24.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:24.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:24.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:24.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:24.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:24.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:24.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:24.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.576+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:24.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.576+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:24.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.576+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:24.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.576+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:24.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.576+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:24.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:24.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:24.885 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:24.884+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:25.203 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:25.204+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:25.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:25.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:25.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:25.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:25.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:25.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:25.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:25.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:25.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:25.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:25.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:25.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:25.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:25.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:25.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:25.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:25.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:25.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:25.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:25.680+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:25.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:25.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:25.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:25.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:27.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:27.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:27.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:27.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:27.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:27.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:27.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:27.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:27.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:27.200+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:27.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:27.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:27.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:27.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:27.584 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:27.584+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:28.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:28.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:28.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:28.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:28.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:28.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:28.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:28.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:28.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.584+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:28.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:28.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.616+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:28.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:28.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:28.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:28.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:28.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:28.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:28.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:28.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:28.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.940+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:28.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:28.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.976+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:28.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:28.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:28.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:29.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:29.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:29.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:29.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:29.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:29.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:29.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:29.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:29.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:29.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:29.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:29.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:29.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:29.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:29.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:29.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:29.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:29.360+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:29.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:29.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:29.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:29.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:30.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:30.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:30.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:30.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:30.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:30.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:30.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:30.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:30.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:30.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:30.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:30.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:30.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:30.760+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:30.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:30.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:30.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:30.796+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:30.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:30.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:30.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:30.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:31.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:11:31.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:31.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:31.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:31.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:31.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:31.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:31.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:31.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:31.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:31.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:31.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.192+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:31.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:31.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:31.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:32.706 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:11:32.708 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:11:32.709 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:11:32.711 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:11:33.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:33.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:33.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:33.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:33.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:33.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:33.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:33.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:33.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:33.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:33.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:33.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:33.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:33.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:34.076 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/40477746 2023-10-14T00:11:34.077 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:11:34.077 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242294 2023-10-14T00:11:34.077 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:11:34.078 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/40477746 ]] 2023-10-14T00:11:34.078 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/40477746 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\0\4\7\7\7\4\6 ]] 2023-10-14T00:11:34.078 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:11:37.389 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:37.388+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:38.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:38.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:38.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:38.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:38.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:38.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:38.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:38.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:38.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:38.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:38.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:38.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:38.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:38.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:38.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:38.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:38.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:38.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:38.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:38.956+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:38.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:38.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:38.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:38.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:39.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:39.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:11:39.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:39.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:39.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:39.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:39.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:39.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:39.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:39.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:39.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:39.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:39.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:39.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:39.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:39.972+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:39.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:39.984+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:39.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:39.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:39.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:39.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:41.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:41.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:41.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:41.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:41.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:41.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:41.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:41.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:41.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:41.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:41.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:41.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:41.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:41.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:41.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:41.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:41.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:41.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:41.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:41.216+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:41.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:41.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:41.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:41.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:42.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:42.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:42.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:42.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:42.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:42.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:42.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:42.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:42.078 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:42.072+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:11:42.095 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:42.096+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:42.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:42.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:42.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:42.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:42.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:42.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:42.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:42.120+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:42.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:42.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:42.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:42.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:42.210 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:42.212+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:43.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:43.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:43.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:43.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:43.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:43.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:43.855 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:43.856+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:43.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:43.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:43.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:43.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:43.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:43.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:43.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:43.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:43.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:43.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:43.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:43.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:43.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:43.884+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:43.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:43.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:43.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:43.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:44.084 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:11:44.085 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:11:44.092 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:11:44.093 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:11:44.291 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:44.292+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:45.013 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:45.012+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:45.104 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:11:45.104+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:11:45.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:45.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:11:45.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:45.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:45.463 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/40477746 2023-10-14T00:11:45.463 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:11:45.463 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242305 2023-10-14T00:11:45.464 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:11:45.464 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/40477746 ]] 2023-10-14T00:11:45.464 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/40477746 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\0\4\7\7\7\4\6 ]] 2023-10-14T00:11:45.464 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:11:45.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:45.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:45.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:45.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:45.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:45.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:45.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.496+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:45.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:45.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.548+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:45.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:45.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:45.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:45.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:11:45.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:45.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:45.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:45.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:45.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:45.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:45.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:45.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:45.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:45.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:45.620+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:46.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:11:46.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:46.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:46.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:46.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:46.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:46.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:46.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:46.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:46.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:46.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:46.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.820+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:46.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:46.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:46.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:47.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:47.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:47.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:47.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:47.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:47.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:47.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:47.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:47.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:47.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:47.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:47.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:47.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:47.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:47.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:47.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:47.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:47.704+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:47.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:47.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:47.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:47.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:48.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:48.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:48.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:48.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:48.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:48.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:48.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:48.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:48.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:48.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:48.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:48.056+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:48.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:48.056+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:48.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:48.056+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:49.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:49.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:49.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:49.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:49.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:49.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:49.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:49.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:49.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:49.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.784+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:49.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:49.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:49.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:49.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:49.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:49.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:49.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:49.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:49.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:49.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:49.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:49.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:49.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:49.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.856+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:49.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:49.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:49.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:49.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:50.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:50.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:50.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:50.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:50.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:50.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.048+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:50.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:50.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:50.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:50.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:50.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:50.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:50.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:50.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:50.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:50.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:50.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:50.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:50.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:50.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:50.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:50.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:51.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:11:51.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:51.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:51.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:51.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:51.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:51.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:51.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:51.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:51.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:51.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:51.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.232+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:51.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:51.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:51.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:51.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:51.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:51.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:51.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:51.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:51.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:51.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:51.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.380+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:51.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.380+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:51.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.380+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:51.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:51.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:51.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:51.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:51.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.644+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:51.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:51.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:51.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:51.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:51.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:51.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:51.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:51.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:51.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:51.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:52.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:52.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:52.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:52.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:52.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:52.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:52.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:52.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:52.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:52.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:52.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:52.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:53.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:53.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:53.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:53.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:53.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:53.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:53.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:53.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.428+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:53.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:53.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:53.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:53.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:53.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:53.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:53.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:53.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:53.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:53.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:53.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:53.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:53.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.640+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:53.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:53.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:53.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:53.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:53.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:53.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:53.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:53.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:53.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:53.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.952+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:53.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.968+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:53.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:53.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:53.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:55.466 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:11:55.467 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:11:55.482 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:11:55.485 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:11:56.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:56.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:56.770 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/40477746 2023-10-14T00:11:56.770 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:11:56.772 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242316 2023-10-14T00:11:56.772 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:11:56.773 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/40477746 ]] 2023-10-14T00:11:56.773 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/40477746 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\0\4\7\7\7\4\6 ]] 2023-10-14T00:11:56.773 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:11:56.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:56.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:56.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:56.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:56.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:56.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:56.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:56.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:56.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:56.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:56.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:56.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:56.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:56.836+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:56.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:56.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:56.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:56.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:57.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:57.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:57.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:57.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:57.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:57.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:57.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:57.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:57.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:57.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:57.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:57.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:57.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:57.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:57.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:57.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:57.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:57.240+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:57.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:57.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:57.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:57.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:58.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:11:58.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:11:58.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:58.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:58.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:58.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:58.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:58.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:58.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:58.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:58.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.112+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:58.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:58.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.120+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:58.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:58.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:11:58.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:11:58.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:11:58.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:58.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:58.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:58.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:59.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:59.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:11:59.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:59.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:11:59.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:59.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:11:59.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:59.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:11:59.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:59.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:11:59.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:59.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:11:59.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:59.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:11:59.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:59.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:11:59.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:59.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:11:59.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:59.724+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:11:59.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:59.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:11:59.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:11:59.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:00.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:00.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:00.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:00.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:00.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:00.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:00.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:00.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:00.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:00.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:00.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:00.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:00.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:00.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:00.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:00.196+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:00.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:00.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:00.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:00.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:02.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:02.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:02.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:02.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:02.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:02.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:02.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:02.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:02.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:05.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:12:05.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:05.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:05.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:05.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:05.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:05.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:05.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:05.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:05.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:05.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:05.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.612+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:05.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:05.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:05.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:05.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:05.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:05.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:05.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:12:05.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:05.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:05.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:05.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:05.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:05.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:05.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:05.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:05.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:05.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:06.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:06.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:06.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:06.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:06.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:06.048+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:06.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:06.048+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:06.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:06.048+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:06.778 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:12:06.779 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:12:06.780 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:12:06.781 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:12:08.276 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2179266399 2023-10-14T00:12:08.276 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:12:08.278 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242328 2023-10-14T00:12:08.278 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:12:08.279 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2179266399 ]] 2023-10-14T00:12:08.279 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2179266399 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\0\4\7\7\7\4\6 ]] 2023-10-14T00:12:08.279 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/2179266399 2023-10-14T00:12:08.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:08.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:08.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:08.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:08.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:08.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:08.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:08.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:08.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:08.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:08.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:08.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:08.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:08.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:08.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:08.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:08.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:08.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:08.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:08.843+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:08.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:08.843+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:08.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:08.843+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:09.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:09.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:09.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:09.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:09.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:09.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:09.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:09.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:09.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:09.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:10.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:10.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:10.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:10.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:10.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:10.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:10.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:10.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:10.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:10.047+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:10.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:10.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:10.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:10.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:10.513 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/2179266399 until 2023-10-14T01:12:09.895936+0000 (3600 sec) 2023-10-14T00:12:10.558 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/2179266399 2023-10-14T00:12:10.559 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:12:11.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:11.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:11.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:11.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:11.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:11.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:11.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:11.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:11.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:11.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:11.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.355+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:11.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:11.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:11.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:11.788 INFO:tasks.workunit.client.0.smithi191.stderr:listed 12 entries 2023-10-14T00:12:11.822 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/2179266399 2023-10-14T00:12:11.822 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:12:12.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:12.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:12.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:12.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:12.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:12.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:12.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:12.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:12.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:12.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:12.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:12.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:12.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:12.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:12.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:12.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:12.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:12.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:12.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.827+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:12.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:12.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:12.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:13.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:13.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:13.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:13.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:13.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:13.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:13.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:13.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:13.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:13.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:13.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:13.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:13.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:13.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:13.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:13.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:13.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:13.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:13.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:13.735+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:13.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:13.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:13.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:13.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:14.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:14.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:15.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:15.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:15.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:15.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:15.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.039+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:15.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.039+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:15.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:15.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:15.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:15.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:15.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:15.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:15.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:15.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:15.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:15.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:15.967+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:17.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:17.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:17.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:17.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:17.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:17.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:17.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:17.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:17.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:17.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:17.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:17.731+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:18.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:18.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:18.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:18.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:18.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:18.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:18.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:18.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.459+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:18.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:18.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:18.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:18.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:18.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:18.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:12:18.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:18.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:18.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:18.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:18.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:18.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:18.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.539+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:18.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:18.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.551+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:18.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:18.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:18.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:18.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:18.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:18.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:18.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:18.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:18.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:18.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:18.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.995+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:18.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:18.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:18.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:19.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:19.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:19.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:19.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:19.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:19.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:19.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:19.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:19.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:19.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:19.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:19.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:19.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:19.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:19.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:19.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:20.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:20.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:20.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:20.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.007+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:20.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:20.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:20.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:20.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:20.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:20.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:20.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:20.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:20.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.167+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:20.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:20.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:20.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:20.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:20.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:20.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:20.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:20.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:20.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:20.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:20.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:20.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.959+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:20.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.971+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:20.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:20.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:21.824 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:12:21.824 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:12:21.834 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:12:21.843 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:12:21.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:21.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:21.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:21.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:21.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:21.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:21.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:21.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:21.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:21.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:21.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:21.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:22.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:22.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:23.137 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2179266399 2023-10-14T00:12:23.138 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:12:23.139 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242343 2023-10-14T00:12:23.140 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:12:23.140 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2179266399 ]] 2023-10-14T00:12:23.140 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2179266399 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\1\7\9\2\6\6\3\9\9 ]] 2023-10-14T00:12:23.140 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:12:23.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:23.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:23.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:23.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:23.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:23.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:23.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:23.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:23.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:23.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:23.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:23.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:23.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:23.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:23.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:23.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:23.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:23.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:23.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:23.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:23.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:23.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:24.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:24.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.003+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:24.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:24.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.019+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:24.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:24.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:24.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:24.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:24.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:24.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:24.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:24.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:24.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.483+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:24.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:24.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:24.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:24.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.515+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:24.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.527+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:24.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.527+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:24.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.527+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:24.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:24.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:24.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:24.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:24.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:24.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:24.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:25.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:25.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:24.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:25.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:25.003+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:25.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:25.011+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:25.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:25.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:25.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:25.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:26.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:26.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:26.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:26.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:26.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:26.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:26.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:26.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:26.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:26.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:26.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.203+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:26.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:26.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:26.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:26.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:26.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:26.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:26.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:26.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:26.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:26.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:26.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:26.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:26.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:26.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:26.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:26.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:26.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:26.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:26.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:26.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:26.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:26.923+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:27.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:27.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:27.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:27.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:27.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:27.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:27.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:27.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:27.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.831+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:27.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.835+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:27.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.843+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:27.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.843+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:27.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:27.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:27.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:27.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:27.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:27.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:27.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:27.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:27.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:27.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:27.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:27.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:28.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:28.011+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:28.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:28.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:28.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:28.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:29.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:29.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:29.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:29.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:29.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:29.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:29.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:29.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:29.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:29.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:29.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:29.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:29.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:29.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:29.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:29.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:29.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:29.255+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:29.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:29.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:29.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:29.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:30.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:30.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:30.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:30.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:30.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:30.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:30.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.439+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:30.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:30.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:30.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:30.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:30.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:30.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:30.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:30.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:30.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:30.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:30.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:30.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:30.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:30.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.671+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:30.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:30.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:30.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:30.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:31.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:31.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:31.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:31.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:31.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:31.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:31.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:31.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:31.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.179+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:31.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:31.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:31.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:31.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:31.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:31.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:31.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:31.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:31.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:31.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:31.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:31.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.383+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:31.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:31.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:31.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:31.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:31.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:31.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:31.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:31.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:31.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:31.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.907+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:31.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:31.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:31.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:31.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:32.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:32.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:32.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:32.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:32.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:32.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:32.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:32.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:32.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.051+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:32.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:32.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:32.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:32.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:32.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:32.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.599+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:32.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:32.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:32.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:33.157 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:12:33.158 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:12:33.162 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:12:33.163 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:12:34.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:34.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:34.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:34.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:34.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:34.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:34.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:34.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:34.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:34.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:34.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:34.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:34.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:34.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:34.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:34.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:34.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:34.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:34.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:34.071+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:34.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:34.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:34.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:34.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:34.827 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2179266399 2023-10-14T00:12:34.827 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:12:34.828 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242354 2023-10-14T00:12:34.828 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:12:34.828 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2179266399 ]] 2023-10-14T00:12:34.828 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2179266399 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\1\7\9\2\6\6\3\9\9 ]] 2023-10-14T00:12:34.829 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:12:34.876 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:12:34.871+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:12:34.876 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:12:34.875+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:12:36.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:36.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:36.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:36.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:36.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:36.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:36.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:36.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.311+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:36.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:36.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:36.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:36.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:36.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:36.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:36.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:36.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:36.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.763+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:36.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:36.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:36.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:36.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:36.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:36.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:36.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:36.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:36.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:36.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.907+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:36.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:36.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:36.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:36.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:37.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:37.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:37.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:37.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:37.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:37.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:37.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:37.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:37.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.119+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:37.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:37.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:37.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:37.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:37.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:37.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:37.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:37.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:37.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:12:37.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:37.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:37.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:37.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:37.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:37.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:37.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:37.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:37.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:39.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:39.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:39.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:39.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:39.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:39.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:39.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:39.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:39.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:39.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:39.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:39.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:39.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:39.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:39.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:39.067+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:39.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:39.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:40.318 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:12:40.319+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:12:40.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:12:40.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:40.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:40.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:40.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:40.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:40.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:40.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:40.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:40.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:12:40.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:40.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:40.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:40.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:40.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:40.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:40.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:40.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:40.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:41.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:41.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:41.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:41.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:41.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:41.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:42.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:41.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:42.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:42.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:42.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:42.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:42.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.067+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:42.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:42.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:42.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:42.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:42.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:42.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:42.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:42.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:42.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:42.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:42.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:42.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.591+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:42.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.611+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:42.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.611+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:42.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.611+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:42.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:42.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:42.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:43.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:43.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:43.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:43.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:43.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:43.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:43.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:43.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:43.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.091+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:43.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:43.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:43.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:43.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:43.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:43.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:43.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:43.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:43.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:43.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:43.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:43.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.603+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:43.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.623+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:43.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:43.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:43.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:44.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:44.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:44.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:44.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:44.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:44.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:44.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:44.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:44.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.135+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:44.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:44.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:44.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:44.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:44.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:44.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:44.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:44.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:44.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:44.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:44.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.575+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:44.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.603+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:44.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:44.603+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:44.831 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:12:44.831 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:12:44.859 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:12:44.863 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:12:46.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:46.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:46.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:46.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:46.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:46.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:46.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:46.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:46.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:46.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:46.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:46.103+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:46.279 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2179266399 2023-10-14T00:12:46.280 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:12:46.280 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242366 2023-10-14T00:12:46.281 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:12:46.281 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2179266399 ]] 2023-10-14T00:12:46.281 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2179266399 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\1\7\9\2\6\6\3\9\9 ]] 2023-10-14T00:12:46.281 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:12:47.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:47.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:47.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:47.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:47.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:47.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:47.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:47.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:47.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:47.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:47.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:47.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:47.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:47.147+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:47.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:47.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:47.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:47.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:48.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:48.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:48.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:48.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:48.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:48.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:48.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:48.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:48.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:48.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:48.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:48.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:48.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:48.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:48.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:48.739+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:48.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:48.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:48.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:48.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:49.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:49.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:49.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:49.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:49.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:49.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:49.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:49.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:49.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:49.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.239+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:49.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:49.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:49.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:49.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:49.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:49.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:49.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:49.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:49.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:49.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:49.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.911+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:49.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:49.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:49.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:51.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:51.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:51.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:51.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:51.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:51.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:51.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.403+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:51.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:51.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:51.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:51.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:51.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:51.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:51.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:51.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:51.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:51.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:51.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:51.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:51.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:51.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:51.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:51.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:51.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:51.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:51.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:51.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:51.823+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:52.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:52.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:52.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:52.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:52.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:52.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:52.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:52.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:52.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:52.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.231+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:52.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:52.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:52.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:12:52.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:52.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:52.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:52.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:52.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:52.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:52.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:52.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:52.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:52.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:52.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.343+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:52.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.343+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:52.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.343+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:52.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.343+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:52.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:52.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:52.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:52.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:52.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:52.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:52.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:52.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:52.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:52.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:52.819+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:53.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:53.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:12:54.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:54.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:54.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:54.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:54.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:54.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:54.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:54.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:54.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:54.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:54.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:54.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:54.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:54.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:54.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:54.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:54.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:54.147+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:54.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:54.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:54.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:54.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:55.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:55.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:55.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:55.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:55.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:55.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:55.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:55.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:55.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:55.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:55.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:55.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:55.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:55.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:55.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:55.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:55.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:55.087+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:55.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:55.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:55.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:55.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:56.293 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:12:56.294 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:12:56.306 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:12:56.306 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:12:56.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:56.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:56.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:56.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:56.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:56.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:56.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:56.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:56.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:56.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:56.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:56.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:56.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:56.807+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:57.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:12:57.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:57.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:12:57.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:57.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:57.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:57.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:57.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:57.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:57.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:57.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:57.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:57.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.419+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:57.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:57.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:57.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:57.823 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2179266399 2023-10-14T00:12:57.823 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:12:57.824 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242377 2023-10-14T00:12:57.824 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:12:57.824 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2179266399 ]] 2023-10-14T00:12:57.824 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2179266399 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\1\7\9\2\6\6\3\9\9 ]] 2023-10-14T00:12:57.824 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:12:58.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:58.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:58.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:58.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:58.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:58.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:58.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:58.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:58.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:58.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.291+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:12:58.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.291+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:12:58.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.291+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:12:58.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:12:58.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:58.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:58.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:58.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:58.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:58.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:58.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:58.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:58.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:58.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:12:58.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:12:58.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:12:58.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:12:58.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:12:58.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:12:58.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:12:58.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:12:58.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:12:58.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:12:58.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:12:58.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:12:58.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:00.029 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.031+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.030 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.031+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.030 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.031+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75169b00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.030 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.031+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75169d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.065 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.063+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.065 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.063+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75169f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.087 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.087+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.088 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.087+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75148100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.104 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.103+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.104 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.103+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75148300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.105 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.103+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.105 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.103+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75148b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.110 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.111+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.111 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.111+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75148a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.111 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.111+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.111 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.111+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75148800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.119 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.119+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.119 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.119+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75148600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.121 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.119+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.121 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.119+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75148d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.134 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.135+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.135 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.135+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75148f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.135 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.135+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.138 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.135+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75149100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.143+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.143+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.143+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75149300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.143+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75149500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.150 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.151+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.150 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.151+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75149700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.151 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.151+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.151 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.151+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75149900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.152 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.151+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.152 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.151+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75149b00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.152 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.151+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.153 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.151+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75149d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.154 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.155+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.154 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.155+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75149f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.159 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.159+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:00.159 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:13:00.159+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74de0100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:13:01.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:01.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:01.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:01.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:01.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:01.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:01.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:01.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:01.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:01.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:01.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:01.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:01.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:01.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:01.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:01.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:01.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:01.295+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:01.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:01.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:01.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:01.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:03.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:03.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:13:03.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:03.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:03.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:03.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:03.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:03.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:03.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:03.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:03.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:03.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:03.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:03.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:03.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:03.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:03.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:03.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:03.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:03.671+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:03.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:03.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:03.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:03.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:07.828 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:13:07.830 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:13:07.830 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:13:07.856 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:13:08.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:08.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:08.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:08.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:08.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:08.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:08.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:08.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:08.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:08.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:08.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:08.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:08.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:08.683+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:08.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:08.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:08.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:08.691+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:08.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:08.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:08.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:08.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:09.171 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2179266399 2023-10-14T00:13:09.171 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:13:09.172 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242389 2023-10-14T00:13:09.172 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:13:09.172 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2179266399 ]] 2023-10-14T00:13:09.173 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2179266399 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\1\7\9\2\6\6\3\9\9 ]] 2023-10-14T00:13:09.173 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:13:09.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:09.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:09.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:09.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:09.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:09.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:09.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:09.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:09.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:09.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:09.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:09.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:09.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:09.539+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:09.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:09.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:09.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:09.559+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:09.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:09.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:10.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:13:10.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:13:10.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:10.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:10.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:10.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:10.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:10.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:10.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:10.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:10.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:10.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.331+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:10.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:10.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:10.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:11.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:11.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:11.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:11.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:11.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:11.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:11.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:11.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:11.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:11.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.563+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:11.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:11.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:11.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:11.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:11.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:11.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:11.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:11.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.711+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:11.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:11.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:11.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:11.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:11.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:11.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.979+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:11.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:11.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:11.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:12.640 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:12.639+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:13:14.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:14.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:14.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:14.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:14.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:14.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:14.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:14.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:14.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:14.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:14.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:14.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:14.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:14.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:14.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:14.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:15.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:15.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:15.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:15.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:15.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:15.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:15.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:15.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:15.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:15.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:15.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:15.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:15.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:15.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:15.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:15.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:15.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:15.931+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:15.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:15.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:15.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:15.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:19.181 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:13:19.181 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:13:19.183 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:13:19.188 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:13:20.638 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1935273287 2023-10-14T00:13:20.645 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:13:20.649 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242400 2023-10-14T00:13:20.649 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:13:20.649 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1935273287 ]] 2023-10-14T00:13:20.650 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1935273287 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\1\7\9\2\6\6\3\9\9 ]] 2023-10-14T00:13:20.650 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/1935273287 2023-10-14T00:13:20.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:13:20.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:20.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:20.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:20.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:20.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:20.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:20.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:20.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:20.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:20.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.951+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:20.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:20.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:20.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:21.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:21.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:21.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:21.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:21.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:21.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:21.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:21.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:21.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:21.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:21.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:21.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:21.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:21.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:21.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:21.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:21.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:21.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:21.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:21.435+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:21.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:21.435+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:21.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:21.435+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:22.321 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:22.319+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:13:22.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:13:22.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:13:22.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:22.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:22.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:22.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:22.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:22.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:22.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.791+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:22.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:22.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.807+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:22.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:22.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:22.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:22.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:22.984 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:22.983+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:13:23.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:23.059+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:23.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:23.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:23.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:23.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:23.414 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/1935273287 until 2023-10-14T01:13:22.814085+0000 (3600 sec) 2023-10-14T00:13:23.453 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/1935273287 2023-10-14T00:13:23.483 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:13:24.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:24.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:24.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:24.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:24.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:24.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:24.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:24.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:24.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:24.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:24.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:24.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:24.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:24.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:24.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:24.515+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:24.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:24.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:24.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:24.547+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:24.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:24.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:24.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:24.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:24.644 INFO:tasks.workunit.client.0.smithi191.stderr:listed 13 entries 2023-10-14T00:13:24.698 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/1935273287 2023-10-14T00:13:24.699 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:13:25.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:25.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:25.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:25.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:25.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:25.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:25.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:25.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:25.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:25.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:25.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:25.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:25.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:25.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:25.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:25.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:25.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:25.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:25.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:25.455+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:25.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:25.455+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:25.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:25.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:26.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:26.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:26.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:26.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:26.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:26.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.219+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:26.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:26.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:26.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:26.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:26.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:26.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.311+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:26.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:26.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:26.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:26.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:26.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:26.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:27.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:27.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:27.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:27.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.043+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:27.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:27.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:27.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:13:27.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:27.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:27.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:27.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:27.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:27.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:27.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.219+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:27.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:27.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:27.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:28.947 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:28.947+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:13:28.950 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:28.951+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:13:29.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:29.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:29.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:29.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:29.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:29.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:29.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:29.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:29.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:29.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:29.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:29.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:29.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:29.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:29.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:29.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:29.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:29.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:29.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:29.179+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:29.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:29.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:29.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:29.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:30.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:30.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:30.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:30.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:30.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:30.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:30.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:30.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:30.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.047+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:30.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:30.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:13:30.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:30.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:30.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:30.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:30.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:30.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:30.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:30.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:30.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:30.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.387+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:30.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:30.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:30.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:13:30.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:13:30.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:30.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:30.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:30.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:30.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:30.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:30.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:30.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:30.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:13:30.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:30.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:30.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:30.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:30.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:30.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:30.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:31.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.003+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:31.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:31.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.023+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:31.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:13:31.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:13:31.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:31.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:31.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:31.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:31.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:31.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:31.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:31.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:31.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:31.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.999+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:31.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:31.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:31.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:32.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:32.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:32.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:32.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:32.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:32.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:32.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.155+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:32.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.175+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:32.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:32.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:32.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:13:32.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:32.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:32.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:32.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:32.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:32.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:32.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:32.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:32.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:32.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.459+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:32.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:32.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:32.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:33.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:33.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:33.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:33.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:34.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:13:34.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:13:34.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:34.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:34.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:34.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:34.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:34.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:34.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:34.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:34.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.291+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:34.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.311+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:34.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:34.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:34.700 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:13:34.701 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:13:34.707 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:13:34.718 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:13:34.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:13:34.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:13:34.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:34.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:34.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:34.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:34.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:34.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:34.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:34.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:34.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:34.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:35.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:35.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:35.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:35.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:35.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:35.707+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:36.028 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1935273287 2023-10-14T00:13:36.031 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:13:36.034 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242416 2023-10-14T00:13:36.034 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:13:36.035 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1935273287 ]] 2023-10-14T00:13:36.035 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1935273287 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\9\3\5\2\7\3\2\8\7 ]] 2023-10-14T00:13:36.035 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:13:36.247 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:36.247+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:13:36.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:36.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:36.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:36.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:36.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:36.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:36.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:36.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:36.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:36.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:36.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:36.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:36.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:36.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:36.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:36.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:36.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:36.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:36.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:36.987+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:36.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:36.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:36.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:36.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:37.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:37.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:37.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:37.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:37.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:37.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:37.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:37.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:37.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:37.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:37.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:37.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:37.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:13:37.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:37.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:37.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:37.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:37.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:37.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:37.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:37.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:37.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.611+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:37.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.635+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:37.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.635+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:37.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:37.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:37.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:37.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:37.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:37.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:37.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:37.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:37.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:37.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.975+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:37.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:37.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:37.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:39.216 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:39.215+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:13:40.573 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:40.571+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:13:40.583 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:40.583+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:13:41.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:41.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:41.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:41.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:41.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:41.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:41.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:41.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:41.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:41.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:41.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:41.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:41.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:41.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:41.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:41.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:41.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:41.695+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:41.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:41.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:41.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:41.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:42.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:42.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:42.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:42.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:42.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:42.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:42.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.439+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:42.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:42.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:42.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:13:42.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.483+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:13:42.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.483+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:42.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:42.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:42.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:42.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:42.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:42.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:42.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.511+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:42.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.515+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:42.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.527+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:42.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.527+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:42.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:42.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:42.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:42.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:42.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:42.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:42.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:42.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:42.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:42.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.871+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:42.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.871+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:42.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:42.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:43.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:43.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:13:43.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:43.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:43.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:43.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:43.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:43.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:43.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:43.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:43.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:43.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:43.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:43.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:43.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:43.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:43.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:43.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:43.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:43.095+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:43.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:43.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:43.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:43.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:44.592 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:44.591+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:13:44.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:13:44.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:13:44.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:44.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:44.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:44.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:44.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:44.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:44.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:44.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:44.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:44.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.711+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:44.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:44.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:44.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:45.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:45.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:45.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:45.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:45.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:45.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:45.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:45.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:45.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:45.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:45.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:45.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:45.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:45.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:45.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:45.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:45.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:45.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:45.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:45.799+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:45.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:45.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:46.055 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:13:46.055 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:13:46.056 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:13:46.085 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:13:46.222 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:46.219+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:13:47.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:47.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:47.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:47.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:47.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:47.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:47.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.155+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:47.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:47.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.163+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:47.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:47.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:47.605 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1935273287 2023-10-14T00:13:47.605 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:13:47.605 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242427 2023-10-14T00:13:47.605 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:13:47.606 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1935273287 ]] 2023-10-14T00:13:47.606 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1935273287 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\9\3\5\2\7\3\2\8\7 ]] 2023-10-14T00:13:47.606 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:13:47.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:47.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:47.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.767+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:47.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:47.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.779+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:47.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:47.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:47.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:49.276 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:49.274+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:13:50.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:13:50.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:50.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:50.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:50.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:50.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:50.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:50.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:50.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:50.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:50.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.458+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:50.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:50.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:50.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:13:50.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:13:50.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:50.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:50.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:50.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:50.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:50.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:50.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:50.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:50.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.562+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:50.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.598+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:50.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:50.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:50.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:50.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:50.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:50.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:50.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:50.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:50.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:50.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:50.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:50.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.914+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:50.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:50.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:50.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:51.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:51.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:51.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:51.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:51.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:51.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:51.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:51.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.142+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:51.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:51.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:51.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:51.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:51.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:51.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:51.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:51.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:51.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:51.798+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:56.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:13:56.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:13:56.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:56.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:56.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:56.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:56.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:56.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:56.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:56.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:56.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.710+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:56.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:56.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:56.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:57.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:57.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:13:57.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:57.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:13:57.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:57.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:13:57.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:57.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:57.627 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:13:57.629 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:13:57.632 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:13:57.633 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:13:57.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:57.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:57.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:57.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:57.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:57.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:57.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:57.742+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:57.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:57.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:57.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:57.770+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:57.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:57.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:57.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:57.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:58.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:58.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:13:58.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:58.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:13:58.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:58.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:13:58.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:58.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:13:58.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:58.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:13:58.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:58.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:13:58.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:58.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:13:58.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:58.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:13:58.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:58.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:13:58.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:58.286+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:13:58.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:58.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:13:58.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:13:58.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:13:59.177 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1935273287 2023-10-14T00:13:59.177 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:13:59.178 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242439 2023-10-14T00:13:59.178 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:13:59.178 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1935273287 ]] 2023-10-14T00:13:59.179 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1935273287 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\9\3\5\2\7\3\2\8\7 ]] 2023-10-14T00:13:59.179 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:13:59.605 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:13:59.606+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:14:00.128 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.126+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.128 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.126+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.128 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.126+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.128 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.126+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.137 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.138+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.137 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.138+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.148 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.146+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.149 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.146+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.149 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.146+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.149 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.146+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.150 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.146+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.150 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.146+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.150 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.146+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751acb00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.150 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.146+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.151 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.146+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.151 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.146+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751acf80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.176 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.174+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.176 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.174+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.177 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.178+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.177 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.178+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.214 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.214+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.214 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.214+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.215 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.214+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.215 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.214+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.216 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.214+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.216 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.214+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.217 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.218+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.217 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.218+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.218 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.218+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.218 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.218+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.219 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.218+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.219 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.218+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751acb00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.225 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.222+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.225 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.222+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.225 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.222+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.225 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.222+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.225 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.222+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751acf80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.225 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.222+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.228 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.226+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.229 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:14:00.226+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:14:00.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:00.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:00.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:00.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:00.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:00.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:00.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:00.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:00.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:00.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:00.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.482+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:00.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:00.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:00.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:03.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:14:03.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:03.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:03.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:03.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:03.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:03.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:03.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:03.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:03.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:03.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.262+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:03.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:03.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:14:03.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:14:03.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:03.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:03.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:03.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:03.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:03.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:03.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:03.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:03.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:03.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:03.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.850+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:03.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:03.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:03.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:06.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:06.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:14:06.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:06.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:06.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:06.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:06.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:06.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:06.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:06.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:06.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:06.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:06.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:06.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:06.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:06.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:06.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:06.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:06.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:06.358+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:07.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:07.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:07.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:07.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:07.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:07.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:07.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:07.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:07.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.206+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:07.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:07.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:07.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:07.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:07.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:07.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:07.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:07.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:07.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.494+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:07.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:07.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:07.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:07.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:07.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:07.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:07.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:07.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:07.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:07.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.646+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:07.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:07.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:07.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:08.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:08.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:08.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:08.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:08.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:08.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:08.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:08.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:08.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:08.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:08.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:08.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:08.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:08.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:08.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:08.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:08.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:08.054+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:08.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:08.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:08.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:08.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:09.191 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:14:09.203 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:14:09.208 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:14:09.209 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:14:09.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:09.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:09.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:09.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:09.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:09.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:09.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:09.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:09.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:09.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:09.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:09.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:09.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:09.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:09.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:09.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:09.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:09.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:09.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:09.770+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:09.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:09.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:09.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:09.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:10.632 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1935273287 2023-10-14T00:14:10.632 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:14:10.633 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242450 2023-10-14T00:14:10.633 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:14:10.634 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1935273287 ]] 2023-10-14T00:14:10.634 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1935273287 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\9\3\5\2\7\3\2\8\7 ]] 2023-10-14T00:14:10.634 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:14:10.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:10.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:10.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:10.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:10.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:10.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:10.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:10.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:10.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:10.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:10.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.942+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:10.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:10.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:10.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:11.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:14:11.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:11.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:11.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:11.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:11.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:11.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:11.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:11.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:11.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:11.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.610+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:11.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:11.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:11.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:14.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:14.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:14.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:14.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:14.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:14.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:14.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:14.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:14.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:14.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:14.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:14.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:14.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:14.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:14.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:14.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:14.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:14.186+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:14.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:14.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:14.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:14.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:15.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:15.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:15.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:15.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:15.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:15.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:15.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.258+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:15.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:15.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:15.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:14:15.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:15.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:15.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:15.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:15.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:15.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:15.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:15.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:15.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:15.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:15.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.970+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:15.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:15.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:15.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:16.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:16.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:16.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:16.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:16.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:16.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:16.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:16.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:16.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:16.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:16.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.146+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:16.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:16.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:16.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:16.848 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:14:16.846+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:14:20.635 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:14:20.639 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:14:20.644 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:14:20.649 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:14:20.670 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:14:20.670+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:14:22.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:22.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:22.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:22.122+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:22.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:22.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:22.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:22.126+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:22.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:22.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:22.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:22.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:22.202 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1935273287 2023-10-14T00:14:22.203 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:14:22.204 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242462 2023-10-14T00:14:22.204 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:14:22.204 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1935273287 ]] 2023-10-14T00:14:22.204 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1935273287 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\9\3\5\2\7\3\2\8\7 ]] 2023-10-14T00:14:22.205 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:14:23.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:23.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:23.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:23.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:23.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:23.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:23.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:23.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:23.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:23.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:23.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:23.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:23.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:23.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:23.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:23.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:23.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:23.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:23.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:23.850+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:23.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:23.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:23.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:23.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:24.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:24.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:24.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:24.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:24.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:24.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:24.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:24.182+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:24.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:24.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:24.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:24.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:25.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:25.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:25.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:25.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:25.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:25.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:25.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:25.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:25.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:25.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:25.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.410+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:25.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:25.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:25.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:25.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:25.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:25.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:25.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:25.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:25.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:25.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:25.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:25.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.774+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:25.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:25.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:25.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:28.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:28.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:28.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:28.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:28.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:28.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:28.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:28.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:28.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:28.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:28.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:28.954+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:28.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:28.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:28.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:28.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:29.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:29.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:29.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:29.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:29.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:29.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:29.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:29.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:29.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:29.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:29.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:29.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:29.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:29.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:29.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:29.326+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:29.961 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:14:29.962+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:14:30.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:30.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:30.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:30.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:30.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:30.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:30.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:30.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:30.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:30.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:30.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:30.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:30.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:30.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:30.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:30.178+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:30.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:30.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:30.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:30.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:30.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:30.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:31.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:31.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:31.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:31.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.042+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:31.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:31.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:31.193 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:14:31.190+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:14:31.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:31.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:31.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:31.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:31.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:31.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:31.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.426+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:31.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.494+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:31.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:31.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:31.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:32.211 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:14:32.212 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:14:32.212 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:14:32.212 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:14:32.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:32.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:32.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:32.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:32.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:32.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:32.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:32.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:32.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:32.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:32.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:32.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:32.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:32.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:33.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:33.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:33.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:33.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:33.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:33.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:33.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:33.002+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:33.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:33.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:33.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:33.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:33.729 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3674977100 2023-10-14T00:14:33.730 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:14:33.730 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242473 2023-10-14T00:14:33.731 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:14:33.731 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3674977100 ]] 2023-10-14T00:14:33.731 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3674977100 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\9\3\5\2\7\3\2\8\7 ]] 2023-10-14T00:14:33.731 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/3674977100 2023-10-14T00:14:33.811 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:14:33.810+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:14:33.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:33.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:14:33.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:33.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:33.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:33.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:33.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:33.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:33.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:33.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:33.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:33.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:34.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:34.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:34.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:34.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:34.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:34.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.058+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:34.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:34.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:34.285 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:14:34.286+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:14:34.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:14:34.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:14:34.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:34.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:34.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:34.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:34.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:34.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:34.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:34.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:34.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:34.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:34.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.482+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:34.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:34.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:34.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:14:34.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:14:34.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:34.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:34.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:34.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:34.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:34.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:34.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:34.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:34.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:34.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:34.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.550+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:34.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:34.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:34.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:35.868 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:14:35.866+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:14:36.440 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/3674977100 until 2023-10-14T01:14:35.823864+0000 (3600 sec) 2023-10-14T00:14:36.512 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/3674977100 2023-10-14T00:14:36.513 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:14:37.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:37.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:37.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:37.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:37.732 INFO:tasks.workunit.client.0.smithi191.stderr:listed 14 entries 2023-10-14T00:14:37.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:37.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.754+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:37.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:37.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:37.809 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/3674977100 2023-10-14T00:14:37.810 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:14:37.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:37.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:37.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:37.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:37.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:37.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:37.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:37.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:37.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:37.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.950+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:37.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.950+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:37.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:37.950+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:38.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:14:38.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:38.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:38.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:38.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:38.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:38.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:38.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:38.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:38.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:38.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:38.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.258+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:38.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:38.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:38.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:38.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:38.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:38.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:38.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:38.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:38.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:38.887 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:14:38.886+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:14:38.888 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:14:38.886+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:14:38.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:38.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:38.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:38.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:38.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:38.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:38.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:38.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:38.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.986+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:38.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:38.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:38.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:38.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:39.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:39.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:39.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:39.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:39.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:39.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.806+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:39.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:39.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.858+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:39.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:14:39.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:14:39.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:39.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:39.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:39.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:39.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:39.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:39.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:41.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:41.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:41.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:41.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:41.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:41.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:41.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:41.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:41.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:41.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.090+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:41.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:41.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:41.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:41.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:41.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:41.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:41.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:41.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:41.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:41.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:41.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:41.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:41.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.758+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:41.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:41.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:41.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:43.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:43.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:43.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:43.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:43.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:43.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:43.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:43.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:43.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.846+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:43.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:43.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:14:43.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.882+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:43.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:43.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:43.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:43.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:43.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:43.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:43.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:43.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:43.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.938+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:43.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:43.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:44.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:14:44.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:14:44.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:44.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:44.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:44.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:44.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:44.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:44.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:44.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:44.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:44.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.782+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:44.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:44.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:44.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:14:44.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:14:44.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:44.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:44.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:44.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:44.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:44.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:44.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:44.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:44.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.818+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:44.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:44.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:44.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:45.944 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:14:45.942+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:14:47.837 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:14:47.837 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:14:47.838 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:14:47.858 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:14:48.574 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:14:48.566+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:14:49.270 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3674977100 2023-10-14T00:14:49.270 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:14:49.271 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242489 2023-10-14T00:14:49.272 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:14:49.272 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3674977100 ]] 2023-10-14T00:14:49.272 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3674977100 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\6\7\4\9\7\7\1\0\0 ]] 2023-10-14T00:14:49.273 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:14:50.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:50.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:50.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:50.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:50.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:50.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:50.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:50.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:50.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:50.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:50.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:50.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:51.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:51.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:51.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:51.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:51.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:51.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:51.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:51.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:51.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:51.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:51.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:51.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:51.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:51.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:51.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:51.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.242+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:51.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:51.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:51.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:51.497 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:14:51.494+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:14:52.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:52.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:52.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:52.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:52.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:52.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:52.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:52.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:52.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:52.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:52.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:52.414+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:55.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:55.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:55.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:55.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:55.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:55.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:55.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:55.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:55.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:55.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.642+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:55.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:55.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:55.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:55.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:55.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:55.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:55.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:55.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:55.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:55.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.858+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:55.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.858+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:55.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.858+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:55.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.858+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:55.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:14:55.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:14:55.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:55.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:55.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:55.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:56.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:56.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:56.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:56.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:56.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:14:56.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:14:56.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:56.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:56.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:56.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:56.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:56.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:56.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:56.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:56.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:56.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.518+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:56.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:56.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.530+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:56.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:56.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:56.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:56.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:56.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:56.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:56.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:56.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:56.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:56.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:56.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:56.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:57.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:57.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.026+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:57.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:57.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:57.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:57.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:14:57.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:14:57.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:57.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:57.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:57.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:57.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:57.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:57.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.365+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:57.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:57.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:57.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:58.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:58.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:58.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:58.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:58.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:58.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:58.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:58.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:58.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:58.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:58.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:58.301+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:58.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:58.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:58.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:58.309+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:58.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:58.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:58.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:58.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:59.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:59.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:14:59.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:59.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:14:59.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:59.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:14:59.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:59.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:14:59.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:59.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:14:59.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:59.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:14:59.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:59.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:14:59.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:59.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:14:59.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:59.285+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:14:59.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:59.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:14:59.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:14:59.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:14:59.291 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:14:59.294 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:14:59.301 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:14:59.306 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:15:00.010 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.009+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.011 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.009+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74cc5180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.011 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.009+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.011 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.009+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75168900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.012 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.009+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.013 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.009+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75149d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.053+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.053+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.053+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75168c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.063 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.061+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74f82480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.072 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.069+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.072 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.069+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ce5b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.078 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.077+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.078 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.077+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476b380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.080 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.077+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.080 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.077+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74056700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.093 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.085+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.093 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.085+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.093 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.089+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.094 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.089+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.099 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.097+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.099 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.097+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da73d6c180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.118 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.117+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.118 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.117+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476a300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.121 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.121+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.121 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.121+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c74c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.141 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.141+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.142 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.141+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c26080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.141+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.141+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.145+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c26800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.145+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751acd80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.145+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.147 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.145+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.155 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.153+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.155 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.153+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.156 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.153+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.156 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.153+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ada00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.163 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.161+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.163 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:15:00.161+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751adc00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:15:00.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:00.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:00.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:00.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:00.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:00.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:00.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:00.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:00.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:00.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:00.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:00.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:00.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:00.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:00.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:00.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:00.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:00.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:00.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:00.605+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:00.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:00.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:00.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:00.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:00.779 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3674977100 2023-10-14T00:15:00.779 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:15:00.780 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242500 2023-10-14T00:15:00.780 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:15:00.780 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3674977100 ]] 2023-10-14T00:15:00.781 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3674977100 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\6\7\4\9\7\7\1\0\0 ]] 2023-10-14T00:15:00.781 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:15:01.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:01.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:01.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:01.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:01.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:01.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:01.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:01.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:01.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:01.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:01.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.089+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:01.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:01.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:01.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:01.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:01.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:01.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:01.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:01.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:01.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:01.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:01.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.185+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:01.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:15:01.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:15:01.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:01.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:01.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:01.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:01.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:01.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:01.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:01.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:01.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:01.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.329+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:01.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.353+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:01.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:01.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:01.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:02.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:15:02.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:02.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:02.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:02.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:02.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:02.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:02.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:02.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:02.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:02.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.909+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:02.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:02.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:02.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:03.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:03.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:03.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:03.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:03.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:03.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:03.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:03.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:03.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:03.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.565+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:03.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:03.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:03.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:15:03.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:03.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:03.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:03.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:03.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:03.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:03.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:03.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.773+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:03.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:03.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:03.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:04.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:15:04.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:15:04.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:04.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:04.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:04.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:04.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:04.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:04.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:04.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:04.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:04.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:04.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.265+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:04.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:04.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:04.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:04.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:04.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:04.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:04.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:04.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.785+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:04.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:04.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:04.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:04.919 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:15:04.917+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:15:05.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:05.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:05.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:05.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:05.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:05.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:05.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:05.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:05.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:05.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:05.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:05.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:05.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:05.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:05.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:05.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:05.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:05.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:05.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:05.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:05.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:05.781+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:05.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:05.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:07.170 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:15:07.169+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:15:08.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:08.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:08.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:08.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:08.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:08.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:08.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:08.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:08.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:08.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:08.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:08.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:08.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:08.889+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:08.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:08.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:08.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:08.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:08.961 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:15:08.961+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:15:10.782 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:15:10.782 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:15:10.791 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:15:10.792 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:15:11.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:15:11.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:11.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:11.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:11.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:11.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:11.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:11.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:11.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:11.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:11.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.777+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:11.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:11.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:11.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:12.228 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3674977100 2023-10-14T00:15:12.229 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:15:12.229 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242512 2023-10-14T00:15:12.230 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:15:12.230 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3674977100 ]] 2023-10-14T00:15:12.231 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3674977100 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\6\7\4\9\7\7\1\0\0 ]] 2023-10-14T00:15:12.231 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:15:12.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:12.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:12.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:12.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:12.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:12.841+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:12.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:12.849+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:12.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:12.861+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:12.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:12.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:15.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:15.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:15.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:15.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:15.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:15.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:15.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:15.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:15.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:15.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:15.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:15.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:15.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:15.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:15.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:15.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:15:15.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:15.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:16.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:15:16.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:16.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:16.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:16.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:16.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:16.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:16.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:16.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:16.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:16.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:16.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.185+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:16.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:16.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:16.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:17.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:15:17.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:17.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:17.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:17.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:17.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:17.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:17.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:17.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:17.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:17.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:17.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.825+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:17.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:17.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:17.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:17.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:17.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:17.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:17.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:17.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:17.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.949+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:17.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:17.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:17.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:19.346 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:15:19.345+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:15:19.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:19.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:19.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:19.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:19.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:19.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:19.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:19.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:19.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:19.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:19.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:19.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:19.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:19.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:19.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:19.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:19.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:19.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:19.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:19.629+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:19.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:19.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:19.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:19.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:21.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:15:21.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:21.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:21.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:21.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:21.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:21.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:21.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:21.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:21.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:21.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:21.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.753+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:21.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:21.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:21.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:22.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:22.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:22.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:22.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:22.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:22.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:22.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:22.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:22.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:22.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:22.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:22.081+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:22.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:22.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:22.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:22.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:22.099 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:15:22.097+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:15:22.108 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:15:22.105+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:15:22.257 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:15:22.261 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:15:22.267 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:15:22.267 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:15:23.772 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3674977100 2023-10-14T00:15:23.777 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:15:23.778 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242523 2023-10-14T00:15:23.778 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:15:23.778 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3674977100 ]] 2023-10-14T00:15:23.778 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3674977100 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\6\7\4\9\7\7\1\0\0 ]] 2023-10-14T00:15:23.779 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:15:23.829 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:15:23.821+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:15:24.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:15:24.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:24.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:24.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:24.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:24.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:24.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:24.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:24.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:24.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:24.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:24.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.289+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:24.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:24.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:24.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:25.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:15:25.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:25.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:25.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:25.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:25.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:25.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:25.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:25.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:25.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:25.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.153+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:25.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:25.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:25.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:26.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:26.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:26.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:26.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:26.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:26.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:26.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.617+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:26.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.625+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:26.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.637+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:26.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.637+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:26.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:26.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:26.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:26.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:26.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:26.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:26.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:26.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:26.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:26.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.925+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:26.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:26.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:26.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:27.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:15:27.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:27.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:27.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:27.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:27.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:27.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:27.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:27.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:27.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:27.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:27.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.221+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:27.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:27.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:27.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:28.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:28.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:28.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:28.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:28.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:28.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:28.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:28.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:28.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:28.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:28.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:28.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:28.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:28.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:28.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:28.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:28.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:28.325+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:28.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:28.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:29.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:29.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:29.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:29.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:29.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:29.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:29.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:29.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:29.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:29.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:29.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:29.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:29.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:29.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:29.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:29.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:29.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:29.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:29.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:29.813+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:29.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:29.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:29.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:29.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:31.333 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:15:31.333+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:15:31.342 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:15:31.341+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:15:31.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:31.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:31.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:31.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:31.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:31.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:31.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:31.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:31.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:31.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:31.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:31.501+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:31.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:31.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:31.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:31.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:32.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:32.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:32.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:32.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:32.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:32.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:32.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:32.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:32.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:32.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:32.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:32.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:32.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:32.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:32.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:32.297+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:32.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:32.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:32.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:32.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:33.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:33.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:33.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:33.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:33.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:33.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:33.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:33.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:33.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:33.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.201+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:33.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:33.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:33.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:33.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:33.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:33.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:33.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.617+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:33.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.637+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:33.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.641+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:33.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:33.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:33.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:33.781 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:15:33.783 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:15:33.798 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:15:33.805 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:15:34.587 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:15:34.585+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:15:34.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:34.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:34.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:34.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:34.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:34.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:34.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:34.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:34.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:34.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:34.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:34.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:34.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:34.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:34.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:34.989+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:34.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:34.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:34.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:34.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:35.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:35.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:35.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:35.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:35.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:35.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:35.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:35.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:35.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:35.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:35.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:35.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:35.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:35.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:35.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:35.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:35.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:35.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:35.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:35.341+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:35.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:35.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:35.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:35.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:35.508 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3674977100 2023-10-14T00:15:35.508 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:15:35.524 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242535 2023-10-14T00:15:35.524 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:15:35.525 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3674977100 ]] 2023-10-14T00:15:35.525 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3674977100 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\6\7\4\9\7\7\1\0\0 ]] 2023-10-14T00:15:35.525 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:15:36.334 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:15:36.333+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:15:36.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:36.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:36.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:36.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:36.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:36.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:36.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:36.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:36.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:36.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:36.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:36.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:36.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:36.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:36.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:36.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:36.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:36.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:36.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:36.901+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:36.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:36.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:36.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:36.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:37.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:37.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:15:37.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:37.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:37.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:37.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:37.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:37.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:37.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:37.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:37.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:37.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:37.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:37.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:37.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:37.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:37.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:37.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:37.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:37.505+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:37.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:37.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:37.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:37.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:38.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:38.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:15:38.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:38.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:38.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:38.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:38.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:38.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:38.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:38.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:38.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:38.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:38.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:38.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:39.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:38.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:39.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:38.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:39.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:39.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.085+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:39.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:39.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:39.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:15:39.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:39.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:39.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:39.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:39.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:39.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:39.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:39.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.161+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:39.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:39.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:39.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:39.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:39.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:39.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:39.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:39.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:44.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:44.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:44.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:44.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:44.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:44.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:44.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:44.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.621+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:44.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:44.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:44.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:44.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:44.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:44.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:44.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:44.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:44.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.641+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:44.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:44.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:44.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:44.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:44.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:44.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.833+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:44.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:44.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:44.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:45.546 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:15:45.555 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:15:45.555 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:15:45.575 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:15:45.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:45.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:15:46.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:46.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:46.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:46.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:46.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:46.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:46.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:46.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:46.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:46.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:46.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.141+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:46.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.173+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:46.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.173+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:46.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:46.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:46.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:46.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:46.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:46.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:46.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:46.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:46.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:46.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:46.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.345+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:46.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:46.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:46.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:46.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:46.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:46.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:46.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:46.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:46.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:46.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:46.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:46.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:46.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:46.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:47.133 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/123804192 2023-10-14T00:15:47.133 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:15:47.149 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242547 2023-10-14T00:15:47.149 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:15:47.149 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/123804192 ]] 2023-10-14T00:15:47.150 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/123804192 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\6\7\4\9\7\7\1\0\0 ]] 2023-10-14T00:15:47.150 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/123804192 2023-10-14T00:15:48.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:15:48.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:48.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:48.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:48.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:48.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:48.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:48.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:48.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:48.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.097+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:48.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.097+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:48.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.097+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:48.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.097+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:48.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.097+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:48.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:48.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:48.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:48.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:48.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:48.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:48.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:48.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:48.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:48.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.677+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:48.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:48.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:48.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:48.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:48.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:48.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:48.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:48.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:48.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:48.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:48.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:48.905+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:49.657 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/123804192 until 2023-10-14T01:15:49.019103+0000 (3600 sec) 2023-10-14T00:15:49.753 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:15:49.764 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/123804192 2023-10-14T00:15:50.910 INFO:tasks.workunit.client.0.smithi191.stderr:listed 15 entries 2023-10-14T00:15:50.952 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/123804192 2023-10-14T00:15:50.952 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:15:51.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:15:51.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:51.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:51.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:51.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:51.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:51.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:51.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:51.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:51.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:51.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:51.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.453+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:51.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:51.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:51.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:55.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:55.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:55.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:55.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:55.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:55.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:55.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:55.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:55.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:55.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.481+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:55.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:55.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:55.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:55.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:55.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:55.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:55.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:55.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:55.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:55.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.816+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:55.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:55.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:55.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:56.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:56.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:56.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:56.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:56.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:56.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:56.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:56.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:56.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:56.888+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:56.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:56.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:56.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:56.924+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:56.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:56.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:56.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:56.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:57.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:57.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:57.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:57.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:57.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:57.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:57.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:57.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:57.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:57.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:57.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:57.248+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:58.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:15:58.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:15:58.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:58.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:58.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:58.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:58.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:58.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:58.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:58.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:58.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:58.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.716+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:58.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:58.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:15:58.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:15:58.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:58.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:58.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:58.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:58.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:58.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:58.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:58.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:58.808+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:59.552 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:15:59.548+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:15:59.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:59.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:15:59.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:59.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:15:59.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:59.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:15:59.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:59.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:15:59.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:59.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:15:59.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:59.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:15:59.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:59.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:15:59.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:59.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:15:59.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:59.620+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:15:59.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:59.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:15:59.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:15:59.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:00.025 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.020+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.025 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.020+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.025 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.020+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c75480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.026 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.020+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75149900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.032 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.028+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.032 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.028+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.038 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.036+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.038 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.036+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75149980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.045 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.040+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.045 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.040+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.046 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.044+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.046 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.044+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75153580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.077 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.072+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.077 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.072+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75153b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.077 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.076+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.078 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.076+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75153a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.103 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.100+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.103 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.100+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75153780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.125 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.120+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.125 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.120+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75153d80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:00.130 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.128+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.131 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.128+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75153f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.136 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.132+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.136 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.132+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.136 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.132+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a8180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.137 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.132+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a8380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:00.138 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.136+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.138 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.136+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a8580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.136+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.141 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.136+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a8780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.143 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.140+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:00.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:00.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.140+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a8980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.156 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.152+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.156 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.152+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.156 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.152+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.156 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.152+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.156 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.152+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a9280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.157 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.152+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a9100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.157 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.152+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a8f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.157 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:16:00.152+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a8d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:16:00.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:00.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:00.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:00.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:00.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:00.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.232+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:00.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:00.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:00.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:00.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:00.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:00.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:00.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:00.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:00.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:00.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:00.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:00.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.408+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:00.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:00.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:00.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:00.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:00.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:00.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:00.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:00.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:00.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:00.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:00.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:00.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:01.084 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:16:01.084 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:16:01.085 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:16:01.105 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:16:01.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:01.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:01.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:01.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:01.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:01.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:01.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:01.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:01.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:01.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:01.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:01.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:01.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:01.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:01.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:01.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:01.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:01.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:01.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:01.640+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:01.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:01.656+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:01.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:01.656+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:02.068 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:16:02.064+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:16:02.843 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/123804192 2023-10-14T00:16:02.845 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:16:02.845 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242562 2023-10-14T00:16:02.846 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:16:02.846 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/123804192 ]] 2023-10-14T00:16:02.846 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/123804192 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\2\3\8\0\4\1\9\2 ]] 2023-10-14T00:16:02.847 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:16:03.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:16:03.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:03.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:03.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:03.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:03.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:03.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:03.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:03.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:03.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:03.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.368+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:03.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:03.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.416+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:03.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:03.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:03.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:16:03.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:03.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:03.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:03.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:03.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:03.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:03.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:03.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:03.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:03.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.560+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:03.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:03.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.644+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:03.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:03.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:03.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:07.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:07.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:07.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:07.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:07.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:07.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:07.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:07.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:07.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:07.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:07.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:07.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:07.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:07.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:07.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:07.592+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:07.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:07.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:07.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:07.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:08.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:08.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:08.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:08.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:08.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:08.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:08.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:08.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:08.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:08.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:08.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:08.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:08.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:08.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:08.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:08.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:08.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:08.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:08.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:08.104+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:08.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:08.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:08.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:08.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:10.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:10.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:10.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:10.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:10.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:10.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:10.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:10.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:10.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:10.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:10.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:10.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:10.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:10.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:10.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:10.080+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:10.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:10.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:10.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:10.088+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:10.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:10.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:10.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:10.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:10.290 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:16:10.292+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:16:11.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:16:11.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:11.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:11.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:11.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:11.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:11.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:11.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:11.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:11.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:11.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.464+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:11.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.464+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:11.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.464+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:11.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.464+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:11.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:16:11.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:11.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:11.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:11.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:11.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:11.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:11.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:11.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:11.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:11.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:11.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:11.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.748+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:11.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:11.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:11.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:11.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:11.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.952+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:11.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:11.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.968+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:11.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:11.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:11.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:12.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:12.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:12.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:12.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:12.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:12.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:12.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:12.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:12.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:12.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.836+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:12.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:12.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:12.856 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:16:12.856 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:16:12.870 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:16:12.870 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:16:12.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:16:12.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:12.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:13.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:13.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:13.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:13.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:13.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:13.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:13.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.060+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:13.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.060+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:13.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:13.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:13.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:13.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:13.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:13.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:13.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:13.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:13.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:13.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.868+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:13.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:13.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:13.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:14.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:14.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:14.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:14.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:14.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:14.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:14.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:14.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:14.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:14.240 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/123804192 2023-10-14T00:16:14.240 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:16:14.241 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242574 2023-10-14T00:16:14.241 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:16:14.241 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/123804192 ]] 2023-10-14T00:16:14.242 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/123804192 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\2\3\8\0\4\1\9\2 ]] 2023-10-14T00:16:14.242 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:16:14.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:14.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.252+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:14.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:14.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:14.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:15.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:15.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:15.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:15.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:15.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:15.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:15.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:15.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:15.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:15.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:15.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:15.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:15.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:15.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:15.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:15.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:15.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:15.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:15.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:15.632+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:15.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:15.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:15.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:15.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:17.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:17.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:17.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:17.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:17.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.336+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:17.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:17.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:16:17.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:17.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:17.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:17.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:17.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:17.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:17.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:17.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:17.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:17.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:17.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:17.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.744+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:17.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:17.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:17.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:19.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:19.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:19.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:19.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:19.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:19.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:19.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:19.652+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:19.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:19.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:19.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:19.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:21.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:21.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:21.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:21.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:21.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:21.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:21.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:21.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:21.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:21.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:21.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:21.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:21.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:21.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:21.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:21.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:21.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:21.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:21.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:21.612+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:21.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:21.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:21.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:21.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:22.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:22.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:22.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:22.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:22.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:22.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:22.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:22.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:22.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:22.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:22.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:22.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:22.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:22.480+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:22.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:22.496+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:22.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:22.508+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:22.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:22.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:22.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:22.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:23.090 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:16:23.092+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:16:23.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:23.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:23.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:23.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:23.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:23.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:23.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:23.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.680+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:23.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:23.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:23.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:16:23.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:23.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:23.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:23.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:23.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:23.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:23.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:23.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:23.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:24.242 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:16:24.245 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:16:24.245 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:16:24.257 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:16:24.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:24.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:24.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:24.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:24.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:24.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:24.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:24.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:24.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:24.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:24.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:24.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:24.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:24.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:24.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:24.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:24.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:24.436+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:25.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:25.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:25.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:25.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:25.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:25.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:25.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:25.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:25.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:25.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.172+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:25.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:25.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:25.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:25.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:25.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:25.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:25.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:25.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:25.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:25.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.440+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:25.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.440+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:25.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.440+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:25.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:25.440+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:25.622 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/123804192 2023-10-14T00:16:25.623 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:16:25.712 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242585 2023-10-14T00:16:25.713 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:16:25.713 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/123804192 ]] 2023-10-14T00:16:25.713 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/123804192 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\2\3\8\0\4\1\9\2 ]] 2023-10-14T00:16:25.713 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:16:26.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:26.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:26.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:26.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:26.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:26.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:26.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:26.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:26.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:26.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:26.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:26.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:26.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:26.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:26.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:26.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:26.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:26.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:26.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:26.696+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:26.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:26.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:26.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:26.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:27.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:27.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:27.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:27.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:27.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:27.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:27.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:27.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:27.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:27.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:27.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:27.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:27.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:27.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:27.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:27.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:27.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:27.596+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:27.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:27.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:27.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:27.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:28.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:28.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:28.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:28.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:28.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:28.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:28.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:28.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:28.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:28.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:28.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:28.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:28.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:28.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:28.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:28.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:28.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:28.924+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:28.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:28.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:28.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:28.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:29.254 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:16:29.256+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:16:29.685 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:16:29.688+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:16:29.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:29.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:29.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:29.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:29.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:29.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:29.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:29.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:29.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:29.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:29.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:29.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:29.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:29.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:29.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:29.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:29.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:29.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:29.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:29.960+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:31.024 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:16:31.024+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:16:33.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:33.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:33.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:33.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:33.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:33.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:33.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:33.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:33.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.504+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:33.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:33.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.520+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:33.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:33.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:33.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:33.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:33.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:33.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:33.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:33.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:33.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:33.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:33.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:33.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:33.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.808+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:33.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:33.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:33.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:33.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:33.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:33.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:33.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:33.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:34.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:34.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:34.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:34.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:34.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:34.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:34.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:34.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:34.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:34.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:34.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:34.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:34.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:34.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:34.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:34.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:34.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:34.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:34.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:34.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:35.726 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:16:35.732 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:16:35.733 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:16:35.757 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:16:36.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:36.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:36.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:36.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:36.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:36.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:36.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:36.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:36.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:36.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:36.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:36.448+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:36.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:36.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:36.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:36.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:36.836 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/123804192 2023-10-14T00:16:36.836 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:16:36.840 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242596 2023-10-14T00:16:36.840 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:16:36.841 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/123804192 ]] 2023-10-14T00:16:36.841 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/123804192 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\2\3\8\0\4\1\9\2 ]] 2023-10-14T00:16:36.841 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:16:36.862 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:16:36.792+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:16:36.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:36.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:37.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:37.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:37.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:37.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:37.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:37.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:37.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:37.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:37.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.076+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:37.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:37.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:37.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:37.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:37.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:37.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:37.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:37.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:37.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:37.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:37.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:37.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.688+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:37.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:37.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:37.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:38.730 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:16:38.732+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:16:40.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:40.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:40.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:40.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:40.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:40.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:40.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:40.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:40.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:40.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:40.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:40.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:40.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:40.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:40.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:40.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:40.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:40.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:40.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:40.344+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:40.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:40.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:40.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:40.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:41.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:41.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:41.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:41.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:41.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:41.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:41.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:41.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.152+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:41.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:41.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.180+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:41.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:41.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:41.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:41.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:41.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:41.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:41.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:41.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.812+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:41.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.812+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:41.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.812+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:41.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.812+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:41.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:41.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:41.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:41.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:41.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:41.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:41.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:41.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:41.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:41.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:41.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:41.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:41.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.000+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:41.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:41.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:42.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:16:42.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:42.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:42.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:42.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:42.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:42.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:42.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:42.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:42.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:42.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:42.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:42.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.316+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:42.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:42.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:42.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:43.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:43.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:43.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:43.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:43.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:43.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:43.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:43.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:43.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.220+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:43.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:43.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:43.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:16:43.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:43.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:43.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:43.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:43.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:43.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:43.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:43.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:43.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:44.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:44.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:44.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:44.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:44.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:44.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:44.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:44.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:44.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:44.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:44.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:44.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:44.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:44.508+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:44.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:44.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:44.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:44.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:45.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:45.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:45.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:45.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:45.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:45.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:45.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:45.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:45.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:45.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:45.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.628+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:45.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:45.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:45.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:45.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:45.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:45.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:45.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:45.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:45.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:45.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:45.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:45.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:45.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:45.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:45.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:45.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:45.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:45.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:45.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.876+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:45.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:45.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:16:45.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:45.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:45.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:45.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:45.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:45.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:45.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:46.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:46.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:46.816 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:16:46.816+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:16:46.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:46.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:46.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:46.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:46.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:46.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:46.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:46.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:46.842 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:16:46.850 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:16:46.859 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:16:46.868 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:16:46.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:46.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:46.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:46.912+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:46.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:46.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:46.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:46.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:46.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:46.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:46.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:46.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:47.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:47.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:47.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:47.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:47.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:47.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:47.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:47.044+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:47.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:47.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:47.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:47.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:47.710 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:16:47.712+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:16:48.443 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/123804192 2023-10-14T00:16:48.443 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:16:48.444 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242608 2023-10-14T00:16:48.444 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:16:48.445 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/123804192 ]] 2023-10-14T00:16:48.445 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/123804192 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\2\3\8\0\4\1\9\2 ]] 2023-10-14T00:16:48.445 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:16:50.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:50.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:50.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:50.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:50.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:50.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:50.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:50.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:50.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.040+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:50.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:50.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:50.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:50.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:50.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:50.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:50.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:50.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:50.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:50.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.292+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:50.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:50.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:50.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:50.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:50.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:50.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:50.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:50.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:50.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:50.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:50.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:50.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:50.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.736+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:50.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:50.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:50.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:51.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:16:51.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:51.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:51.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:51.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:51.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:51.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:51.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:51.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:51.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:51.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:51.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:51.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.308+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:51.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:51.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:51.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:51.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:51.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:51.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:51.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.608+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:51.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:51.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:51.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:51.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:51.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:51.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:51.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:51.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:51.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:51.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:51.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:51.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.975+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:51.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:51.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:51.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:52.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:52.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:52.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:52.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:52.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:52.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:52.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:52.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:52.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:52.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:52.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:52.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:52.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:52.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:52.845 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:16:52.847+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:16:53.713 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:16:53.711+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:16:54.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:54.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:54.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:54.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:54.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:54.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:54.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:54.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:54.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:54.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:54.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:54.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:54.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:54.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:54.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:54.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:54.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:54.403+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:54.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:54.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:54.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:54.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:56.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:56.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:56.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:56.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:56.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:56.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:56.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:56.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:56.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.595+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:56.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.595+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:56.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.595+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:56.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:56.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:56.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:56.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:56.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:56.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:56.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:57.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:57.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:57.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:56.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:57.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.039+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:57.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.043+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:57.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:57.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:57.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:16:57.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:16:57.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:16:57.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:57.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:57.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:57.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:57.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:57.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:57.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:57.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:57.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.131+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:57.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:57.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:57.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:16:58.476 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:16:58.484 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:16:58.485 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:16:58.485 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:16:58.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:58.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:16:58.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:58.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:16:58.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:58.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:16:58.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:58.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:16:58.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:58.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:16:58.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:58.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:16:58.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:58.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:16:58.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:58.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:16:58.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:58.799+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:16:58.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:58.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:16:58.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:16:58.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:00.007 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/526315954 2023-10-14T00:17:00.008 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:17:00.008 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242620 2023-10-14T00:17:00.008 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:17:00.009 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/526315954 ]] 2023-10-14T00:17:00.009 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/526315954 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\2\3\8\0\4\1\9\2 ]] 2023-10-14T00:17:00.009 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/526315954 2023-10-14T00:17:00.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:00.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:00.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:00.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:00.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:00.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:00.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:00.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:00.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:00.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:00.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.687+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:00.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558875509ad0 2023-10-14T00:17:00.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55889955a820 2023-10-14T00:17:00.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55889955a9c0 2023-10-14T00:17:00.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55889955b930 2023-10-14T00:17:00.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:00.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55889b612680 2023-10-14T00:17:01.653 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.651+0000 7f3dc7f64640 -1 librbd::ImageWatcher: 0x55da753f8000 image watch failed: 94396758292480, (107) Transport endpoint is not connected 2023-10-14T00:17:01.653 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.651+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da753f8000 handle_error: handle=94396758292480: (107) Transport endpoint is not connected 2023-10-14T00:17:01.654 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.655+0000 7f3dc7f64640 -1 librbd::watcher::RewatchRequest: 0x55da73db2e10 handle_unwatch client blocklisted 2023-10-14T00:17:01.654 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.655+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da753f8000 handle_rewatch: client blocklisted 2023-10-14T00:17:01.660 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.659+0000 7f3dc7f64640 -1 librbd::ImageWatcher: 0x55da753ce300 image watch failed: 94396757014528, (107) Transport endpoint is not connected 2023-10-14T00:17:01.661 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.659+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da753ce300 handle_error: handle=94396757014528: (107) Transport endpoint is not connected 2023-10-14T00:17:01.663 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.663+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da753cf200 image watch failed: 94396758286336, (107) Transport endpoint is not connected 2023-10-14T00:17:01.663 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.663+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da753cf200 handle_error: handle=94396758286336: (107) Transport endpoint is not connected 2023-10-14T00:17:01.663 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.663+0000 7f3dc7f64640 -1 librbd::watcher::RewatchRequest: 0x55da73eeb450 handle_unwatch client blocklisted 2023-10-14T00:17:01.663 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.663+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da753cf200 handle_rewatch: client blocklisted 2023-10-14T00:17:01.667 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.667+0000 7f3dc7f64640 -1 librbd::ImageWatcher: 0x55da753ce600 image watch failed: 94396758225920, (107) Transport endpoint is not connected 2023-10-14T00:17:01.667 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.667+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da753ce600 handle_error: handle=94396758225920: (107) Transport endpoint is not connected 2023-10-14T00:17:01.667 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.667+0000 7f3dc8765640 -1 librbd::watcher::RewatchRequest: 0x55da73f34820 handle_unwatch client blocklisted 2023-10-14T00:17:01.668 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.667+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da753ce600 handle_rewatch: client blocklisted 2023-10-14T00:17:01.669 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.667+0000 7f3dc7f64640 -1 librbd::ImageWatcher: 0x55da753ce900 image watch failed: 94396758226944, (107) Transport endpoint is not connected 2023-10-14T00:17:01.669 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.667+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da753ce900 handle_error: handle=94396758226944: (107) Transport endpoint is not connected 2023-10-14T00:17:01.669 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.667+0000 7f3dc7f64640 -1 librbd::watcher::RewatchRequest: 0x55da74be0c80 handle_unwatch client blocklisted 2023-10-14T00:17:01.669 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.667+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da753ce900 handle_rewatch: client blocklisted 2023-10-14T00:17:01.675 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.675+0000 7f3dc8765640 -1 librbd::watcher::RewatchRequest: 0x55da73f34730 handle_unwatch client blocklisted 2023-10-14T00:17:01.675 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.675+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da753ce300 handle_rewatch: client blocklisted 2023-10-14T00:17:01.681 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.683+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da753cf500 image watch failed: 94396758288384, (107) Transport endpoint is not connected 2023-10-14T00:17:01.681 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.683+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da753cf500 handle_error: handle=94396758288384: (107) Transport endpoint is not connected 2023-10-14T00:17:01.682 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.683+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da74ed4000 image watch failed: 94396758222848, (107) Transport endpoint is not connected 2023-10-14T00:17:01.682 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.683+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da74ed4000 handle_error: handle=94396758222848: (107) Transport endpoint is not connected 2023-10-14T00:17:01.683 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.683+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da753ce000 image watch failed: 94396758223872, (107) Transport endpoint is not connected 2023-10-14T00:17:01.683 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.683+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da753ce000 handle_error: handle=94396758223872: (107) Transport endpoint is not connected 2023-10-14T00:17:01.693 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.695+0000 7f3dc7f64640 -1 librbd::watcher::RewatchRequest: 0x55da73eeb4a0 handle_unwatch client blocklisted 2023-10-14T00:17:01.693 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.695+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da753cf500 handle_rewatch: client blocklisted 2023-10-14T00:17:01.700 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.699+0000 7f3dc7f64640 -1 librbd::watcher::RewatchRequest: 0x55da74be0000 handle_unwatch client blocklisted 2023-10-14T00:17:01.700 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.699+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da74ed4000 handle_rewatch: client blocklisted 2023-10-14T00:17:01.700 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.699+0000 7f3dc7f64640 -1 librbd::watcher::RewatchRequest: 0x55da74983540 handle_unwatch client blocklisted 2023-10-14T00:17:01.701 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.699+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da753ce000 handle_rewatch: client blocklisted 2023-10-14T00:17:01.722 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.723+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da753cfb00 image watch failed: 94396758290432, (107) Transport endpoint is not connected 2023-10-14T00:17:01.722 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.723+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da753cfb00 handle_error: handle=94396758290432: (107) Transport endpoint is not connected 2023-10-14T00:17:01.722 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.723+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da753cf800 image watch failed: 94396758289408, (107) Transport endpoint is not connected 2023-10-14T00:17:01.723 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.723+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da753cf800 handle_error: handle=94396758289408: (107) Transport endpoint is not connected 2023-10-14T00:17:01.762 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.763+0000 7f3dc8765640 -1 librbd::watcher::RewatchRequest: 0x55da74a468c0 handle_unwatch client blocklisted 2023-10-14T00:17:01.763 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.763+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da753cfb00 handle_rewatch: client blocklisted 2023-10-14T00:17:01.763 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.763+0000 7f3dc8765640 -1 librbd::watcher::RewatchRequest: 0x55da749561e0 handle_unwatch client blocklisted 2023-10-14T00:17:01.763 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:01.763+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da753cf800 handle_rewatch: client blocklisted 2023-10-14T00:17:01.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:01.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:01.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:01.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:01.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:01.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:01.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:01.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:01.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:01.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:01.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:01.915+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:01.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:01.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:01.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:01.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:02.632 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/526315954 until 2023-10-14T01:17:01.984492+0000 (3600 sec) 2023-10-14T00:17:02.646 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.647+0000 7f3dc8765640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.646 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.647+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da74449450 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.647 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.647+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da74bd6840 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.647 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.647+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.647 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.647+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da753f02c0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.648 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.647+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da753f7b40 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.648 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.647+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74594180 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.657 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.651+0000 7f3dc7f64640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.657 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.651+0000 7f3dc7f64640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da744485b0 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.658 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.651+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da753d6b00 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.658 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.651+0000 7f3dc7f64640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.658 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.651+0000 7f3dc7f64640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da74449380 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.658 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.651+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da753f1080 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.658 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.655+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.659 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.655+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.659 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da753f1600 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.659 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.659 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.659 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da74dc1b40 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.660 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da744492b0 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.660 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da753d7ce0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.660 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da744491e0 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.660 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da753f0f20 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.661 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec4900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.662 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.662 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.662 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.662 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da74448820 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.662 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da74bd74a0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.663 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da74449040 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.663 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da74bd78c0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.663 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da74449110 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.663 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da753f0580 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.664 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.664 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da753f1760 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.664 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da753f7f40 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.681 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:17:02.681 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/526315954 2023-10-14T00:17:02.721 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.721 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.721 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.722 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da753f1080 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.722 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da753dc040 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.722 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da7525e000 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.722 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da7525e2c0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.723 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da7529cc00 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.723 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da753f7300 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.723 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.659+0000 7f3dc7f64640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74d91b00 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.723 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74a64e40 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.723 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.724 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.724 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74e02000 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.724 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da747ae3c0 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.724 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74dc4540 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.724 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.725 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.725 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da753d6b00 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.725 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da753f18c0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.725 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da74448680 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.725 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da753f0dc0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.726 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da74448f70 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.726 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da753d7e40 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.726 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da753f78c0 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.726 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.719+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da753f7d00 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.727 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.723+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.727 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.723+0000 7f3dc7f64640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.727 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.723+0000 7f3dc7f64640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.727 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.723+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da7525e160 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.728 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.723+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da7525e420 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.728 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.723+0000 7f3dc7f64640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da753f7f00 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.728 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.723+0000 7f3dc7f64640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da741e9680 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.728 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.723+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74ec4900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.728 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.727+0000 7f3dc7f64640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74595080 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.729 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.727+0000 7f3dc7f64640 -1 librbd::managed_lock::ReleaseRequest: 0x55da742a1da0 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.736 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.735+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da742a1260 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.736 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.735+0000 7f3dc7f64640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74e022a0 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.738 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.739+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.739 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.739+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.739 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.739+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.739 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.739+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74ec4900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.739 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.739+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75153100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.739 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.739+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da751ac600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.769 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.767+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.769 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.767+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74f83700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.774 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.775+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.774 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.775+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74f83d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.786 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.783+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.786 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.783+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476b900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.792 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.791+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.793 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.791+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da73ff4600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.802 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.803+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:02.802 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:17:02.803+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74ec4900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:17:03.622 INFO:tasks.workunit.client.0.smithi191.stderr:listed 16 entries 2023-10-14T00:17:03.623 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:17:03.619+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:17:03.655 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/526315954 2023-10-14T00:17:03.655 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:17:05.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:05.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:05.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:05.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:05.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:05.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:05.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:05.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:05.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:05.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:05.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:05.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:05.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:05.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:05.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:05.647+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:05.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:05.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:05.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:05.703+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:05.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:05.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:05.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:05.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:07.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:07.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:07.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:07.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:07.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:07.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:07.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:07.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:07.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:07.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:07.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:07.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:07.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:07.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:07.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:07.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:07.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:07.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:07.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:07.615+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:07.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:07.615+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:07.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:07.615+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:09.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:09.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:09.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:09.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:09.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:09.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:09.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:09.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:09.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:09.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:09.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:09.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:09.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:09.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:09.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:09.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:09.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:09.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:09.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:09.195+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:09.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:09.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:09.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:09.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:10.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:17:10.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:10.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:10.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:10.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:10.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:10.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:10.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:10.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:10.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:10.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.731+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:10.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:10.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:10.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:12.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:12.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:12.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:12.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:12.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:12.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:12.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:12.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:12.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:12.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.247+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:12.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:12.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:12.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:17:12.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:12.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:12.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:12.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:12.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:12.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:12.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:12.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:12.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:12.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:12.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.731+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:12.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:12.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:12.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:17:12.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:12.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:12.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:12.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:12.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:12.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:12.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:12.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:12.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:13.657 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:17:13.657 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:17:13.658 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:17:13.661 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:17:14.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:17:14.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:14.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:14.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:14.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:14.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:14.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:14.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:14.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:14.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:14.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.235+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:14.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:14.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:14.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:14.797 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:17:14.795+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:17:14.809 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:17:14.807+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:17:14.867 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/526315954 2023-10-14T00:17:14.868 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:17:14.869 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242634 2023-10-14T00:17:14.869 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:17:14.869 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/526315954 ]] 2023-10-14T00:17:14.870 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/526315954 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\5\2\6\3\1\5\9\5\4 ]] 2023-10-14T00:17:14.870 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:17:15.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:15.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:15.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:15.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:15.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:15.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:15.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:15.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:15.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:17:15.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:15.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:15.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:15.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:15.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:15.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:15.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:15.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:15.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:15.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.899+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:15.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:15.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.911+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:15.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:15.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:15.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:20.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:20.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:20.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:20.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:20.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:20.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:20.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:20.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:20.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.119+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:20.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:20.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:20.179 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:17:20.179+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:17:20.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:20.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:20.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:20.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:20.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:20.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:20.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:20.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:20.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:20.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.587+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:20.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:20.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:21.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:21.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:21.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:21.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:21.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:21.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:21.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:21.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:21.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:21.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.095+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:21.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:21.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:21.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:21.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:21.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:21.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:21.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:21.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:21.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.955+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:21.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:21.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:21.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:23.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:23.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:23.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:23.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:23.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:23.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:23.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:23.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:23.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:23.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:23.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:23.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:23.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:23.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:23.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:23.099+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:23.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:23.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:23.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:23.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:24.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:24.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:24.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:24.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:24.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:24.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:24.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:24.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:24.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:24.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:24.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:24.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:24.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:24.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:24.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:24.347+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:24.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:24.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:24.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:24.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:24.870 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:17:24.873 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:17:24.874 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:17:24.875 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:17:26.084 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/526315954 2023-10-14T00:17:26.089 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:17:26.090 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242646 2023-10-14T00:17:26.090 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:17:26.090 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/526315954 ]] 2023-10-14T00:17:26.091 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/526315954 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\5\2\6\3\1\5\9\5\4 ]] 2023-10-14T00:17:26.091 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:17:26.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:26.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:17:26.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:26.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:26.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:26.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:26.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:26.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:26.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:26.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:26.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:26.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.439+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:26.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:26.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:26.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:27.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:17:27.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:27.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:27.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:27.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:27.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:27.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:27.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:27.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:27.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.391+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:27.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.391+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:27.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.391+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:27.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:27.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:27.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:27.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:27.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:27.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:17:27.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:27.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:27.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:27.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:27.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:27.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:27.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:27.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:27.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:28.195 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:17:28.195+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:17:30.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:30.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:17:30.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:30.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:30.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:30.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:30.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:30.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:30.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:30.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:30.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:30.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.127+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:30.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:30.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:30.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:30.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:30.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:30.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:30.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:30.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:30.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:30.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:30.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.331+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:30.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:30.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:30.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:30.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:30.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:17:30.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:30.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:30.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:30.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:30.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:30.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:30.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:30.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:30.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:30.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.879+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:30.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:30.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:30.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:31.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:17:31.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:31.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:31.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:31.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:31.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:31.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:31.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:31.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:31.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:31.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.291+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:31.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:31.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:31.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:31.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:31.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:31.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:31.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:31.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:31.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:31.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:31.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.839+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:31.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:31.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:31.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:31.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:31.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:31.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:31.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:32.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:32.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:32.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:32.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:32.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:32.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:32.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.083+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:32.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:32.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:32.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:17:32.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:32.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:17:32.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:32.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:32.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:32.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:32.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:32.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:32.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:32.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:32.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:32.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.223+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:32.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:32.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:32.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:32.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:32.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:32.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:32.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:32.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:32.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:32.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.935+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:32.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.935+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:32.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:32.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:33.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:33.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:33.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:33.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:33.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:33.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:33.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:33.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:33.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:33.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:33.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:33.791+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:35.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:35.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:35.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:35.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:35.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:35.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:35.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:35.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:35.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:35.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.099+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:35.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:35.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:35.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:35.525 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:17:35.527+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:17:35.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:35.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:35.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:35.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:35.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:35.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:35.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:35.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.583+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:35.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:35.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:35.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:35.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:35.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:35.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:35.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:35.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:35.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:35.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:35.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:35.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.723+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:35.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:35.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:36.113 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:17:36.114 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:17:36.134 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:17:36.134 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:17:36.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:36.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:17:36.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:36.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:36.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:36.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:36.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:36.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:36.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:36.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:36.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:36.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:36.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:36.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:36.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:36.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:36.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:36.527+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:36.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:36.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:36.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:36.535+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:37.501 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/526315954 2023-10-14T00:17:37.504 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:17:37.504 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242657 2023-10-14T00:17:37.505 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:17:37.505 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/526315954 ]] 2023-10-14T00:17:37.505 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/526315954 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\5\2\6\3\1\5\9\5\4 ]] 2023-10-14T00:17:37.505 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:17:38.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:38.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:17:38.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:38.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:38.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:38.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:38.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:38.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:39.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:39.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:39.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:39.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:39.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:39.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:39.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.027+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:39.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:39.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:39.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:39.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:39.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:39.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:39.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:39.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:39.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:39.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:39.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:39.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.223+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:39.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:39.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:39.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:17:39.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:39.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:17:39.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:39.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:39.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:39.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:39.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:39.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:39.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:39.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:39.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:39.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.915+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:39.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:39.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:39.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:41.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:41.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:41.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:41.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:41.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:41.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:41.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:41.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:41.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:41.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:41.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:41.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:41.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:41.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:41.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:41.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:41.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:41.434+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:41.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:41.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:41.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:41.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:42.651 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:17:42.650+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:17:43.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:43.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:43.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:43.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:43.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:43.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.574+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:43.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:43.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.646+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:43.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:43.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:43.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:17:43.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:43.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:43.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:43.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:43.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:43.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:43.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:43.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:43.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:43.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:43.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.910+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:43.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:43.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:43.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:45.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:45.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:45.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:45.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:45.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:45.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:45.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:45.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:45.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:45.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:45.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:45.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:45.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:45.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:45.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:45.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:45.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:45.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:45.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:45.622+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:45.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:45.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:45.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:45.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:46.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:46.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:46.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:46.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:46.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:46.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:46.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:46.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.474+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:46.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:46.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.498+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:46.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.498+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:46.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.498+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:46.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:17:46.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:46.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:46.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:46.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:46.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:46.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:46.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:46.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:46.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.610+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:46.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:46.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:46.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:17:46.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:17:46.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:46.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:46.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:46.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:46.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:46.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:46.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:46.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:46.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:46.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.722+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:46.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:46.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:46.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:46.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:46.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:46.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:46.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:46.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:46.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:46.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:46.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:46.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:46.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.874+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:46.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:46.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:46.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:47.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:47.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:47.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:47.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:47.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:47.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:47.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:47.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:47.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:47.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.362+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:47.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:47.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:47.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:47.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:47.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:47.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:47.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:47.534 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:17:47.536 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:17:47.536 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:17:47.558 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:17:47.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:47.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:47.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:47.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:47.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:47.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:47.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.914+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:47.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:47.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:47.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:48.863 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/526315954 2023-10-14T00:17:48.863 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:17:48.864 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242668 2023-10-14T00:17:48.864 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:17:48.864 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/526315954 ]] 2023-10-14T00:17:48.864 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/526315954 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\5\2\6\3\1\5\9\5\4 ]] 2023-10-14T00:17:48.864 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:17:48.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:48.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:48.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:48.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:48.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:48.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:48.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:48.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:48.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:48.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:48.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:48.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:49.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:48.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:49.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:48.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:49.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:49.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:49.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:49.050+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:49.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:49.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:49.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:49.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:50.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:50.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:17:50.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:50.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:50.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:50.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:50.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:50.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:50.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:50.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:50.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:50.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:50.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:50.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:50.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:50.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:50.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:50.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:50.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:50.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:50.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:50.582+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:50.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:50.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:51.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:51.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:51.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:51.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:51.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:51.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:51.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:51.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:51.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:51.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:51.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:51.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:51.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:51.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:51.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:51.190+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:51.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:51.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:51.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:51.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:52.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:52.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:52.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:52.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:52.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:52.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:52.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.274+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:52.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:52.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:52.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:52.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:52.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:52.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:52.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:52.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.462+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:52.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:52.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:52.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:52.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:52.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:52.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:52.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:52.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:52.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.586+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:52.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:52.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:52.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:54.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:17:54.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:54.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:54.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:54.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:54.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:54.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:54.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:54.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:54.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:54.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.370+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:54.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:54.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:54.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:55.986 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:17:55.986+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:17:56.354 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:17:56.354+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:17:56.600 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:17:56.598+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:17:58.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:58.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:58.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:58.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:58.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:58.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:58.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:58.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:58.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:58.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:58.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:58.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:58.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:58.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:58.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:58.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:58.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:58.526+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:58.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:58.546+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:58.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:58.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:58.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:58.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:17:58.880 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:17:58.880 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:17:58.888 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:17:58.905 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:17:59.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:59.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:17:59.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:59.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:17:59.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:59.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:17:59.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:59.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:17:59.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:59.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:17:59.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:59.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:17:59.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:59.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:17:59.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:59.318+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:17:59.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:59.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:17:59.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:59.346+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:17:59.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:59.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:17:59.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:17:59.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:00.230 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/526315954 2023-10-14T00:18:00.232 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:18:00.234 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242680 2023-10-14T00:18:00.234 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:18:00.234 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/526315954 ]] 2023-10-14T00:18:00.235 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/526315954 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\5\2\6\3\1\5\9\5\4 ]] 2023-10-14T00:18:00.235 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:18:02.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:02.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:02.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:02.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:02.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:02.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:02.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:02.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:02.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:02.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:02.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:02.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:02.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:02.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:02.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:02.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:02.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:02.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:02.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:02.362+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:02.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:02.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:02.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:02.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:05.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:05.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:05.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:05.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:05.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:05.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:05.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:05.750+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:06.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:06.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:06.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:06.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:06.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:06.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:06.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:06.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:06.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:06.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:06.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:06.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:06.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:06.734+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:06.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:06.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:06.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:06.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:07.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:18:07.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:07.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:07.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:07.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:07.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:07.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:07.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:07.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:07.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:07.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.306+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:07.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:07.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:07.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:08.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:08.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:08.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:08.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:08.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:08.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:08.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:08.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:08.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:08.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:08.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:08.858+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:08.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:08.878+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:08.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:08.890+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:08.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:08.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:08.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:08.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:08.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:08.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:09.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:18:09.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:09.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:09.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:09.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:09.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:09.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:09.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:09.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:09.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:09.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.834+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:09.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:09.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:09.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:10.236 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:18:10.237 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:18:10.237 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:18:10.245 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:18:10.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:10.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:10.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:10.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:10.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:10.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:10.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:18:10.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:10.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:10.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:10.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:10.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:10.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:10.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:11.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:11.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:11.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:11.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:11.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:11.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:11.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:11.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:11.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.182+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:11.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:11.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:11.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:11.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:11.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:11.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:11.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:11.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:11.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:11.589 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/47890785 2023-10-14T00:18:11.589 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:18:11.590 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242691 2023-10-14T00:18:11.590 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:18:11.591 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/47890785 ]] 2023-10-14T00:18:11.591 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/47890785 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\5\2\6\3\1\5\9\5\4 ]] 2023-10-14T00:18:11.591 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/47890785 2023-10-14T00:18:13.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:13.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:13.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:13.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:13.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:13.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:13.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:13.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:13.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:13.290+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:13.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:13.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:13.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:13.298+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:13.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:13.298+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:13.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:13.298+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:13.673 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/47890785 until 2023-10-14T01:18:13.010710+0000 (3600 sec) 2023-10-14T00:18:13.705 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:18:13.706 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/47890785 2023-10-14T00:18:14.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:14.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:14.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:14.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:14.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:14.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:14.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:14.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.390+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:14.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:14.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:14.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:14.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:14.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:14.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:14.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:14.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:14.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:14.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.830+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:14.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:14.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:14.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:14.945 INFO:tasks.workunit.client.0.smithi191.stderr:listed 17 entries 2023-10-14T00:18:14.989 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/47890785 2023-10-14T00:18:14.989 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:18:15.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:15.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:15.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:15.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:15.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:15.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:15.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:15.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:15.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:15.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:15.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:15.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:15.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:15.098+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:15.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:15.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:15.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:15.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:16.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:16.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:16.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:16.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:16.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:16.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:16.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:16.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:16.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.546+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:16.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:16.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:16.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:16.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:16.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:16.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:16.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:16.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:16.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:16.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:16.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:16.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:16.834+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:17.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:17.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:17.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:17.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:17.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:17.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:17.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:17.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:17.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:17.402+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:17.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:17.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:17.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:17.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:17.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:17.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:18:19.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:19.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:19.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:19.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:19.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:19.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:19.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:19.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:19.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:19.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:19.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:19.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:19.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:19.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:19.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:19.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:19.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:19.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:19.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:19.426+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:19.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:19.426+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:19.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:19.426+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:20.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:18:20.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:20.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:20.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:20.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:20.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:20.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:20.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:20.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:20.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:20.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.234+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:20.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:20.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:20.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:20.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:20.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:20.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:20.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:21.749 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:18:21.746+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:18:21.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:21.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:21.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:21.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:21.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:21.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:21.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:21.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:21.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:21.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:21.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:21.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:21.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:21.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:21.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:21.866+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:21.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:21.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:21.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:21.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:23.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:18:23.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:23.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:23.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:23.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:23.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:23.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:23.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:23.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:23.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:23.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.962+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:23.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:23.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:23.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:24.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:18:24.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:18:24.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:18:24.471 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:18:24.470+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:18:24.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:24.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:24.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:24.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:24.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:24.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:24.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:24.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:24.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:24.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.542+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:24.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:24.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:24.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:18:24.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:24.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:24.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:24.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:24.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:24.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:24.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:24.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.806+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:24.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:24.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.830+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:24.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:24.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:24.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:25.005 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:18:25.005 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:18:25.007 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:18:25.010 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:18:25.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:25.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:25.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:25.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:25.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:25.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:25.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:25.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:25.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:25.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.394+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:25.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:25.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:25.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:25.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:25.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:25.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:25.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.618+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:25.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:25.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:25.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:25.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:25.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:25.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:25.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:25.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:25.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:25.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:25.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.966+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:26.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.998+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:26.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:26.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:25.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:26.467 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/47890785 2023-10-14T00:18:26.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:26.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:26.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:26.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:26.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:26.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:26.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:26.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:26.469 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:18:26.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:26.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:26.482 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242706 2023-10-14T00:18:26.482 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:18:26.482 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/47890785 ]] 2023-10-14T00:18:26.483 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/47890785 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\7\8\9\0\7\8\5 ]] 2023-10-14T00:18:26.483 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:18:26.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:26.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:26.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:26.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:26.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:26.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:26.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:26.494+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:26.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:26.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:26.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:26.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:27.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:18:27.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:18:27.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:27.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:27.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:27.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:27.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:27.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:27.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:27.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:27.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:27.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.602+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:27.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:27.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:27.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:28.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:18:28.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:28.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:28.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:28.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:28.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:28.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:28.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:28.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:28.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:28.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.126+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:28.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:28.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:28.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:28.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:28.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:28.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:28.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:28.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:28.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:28.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:28.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.282+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:28.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:28.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:28.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:29.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:18:29.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:29.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:29.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:29.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:29.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:29.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:29.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:29.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.238+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:29.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.250+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:29.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:29.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:29.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:29.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:29.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:30.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:29.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:30.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:30.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:30.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:30.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:30.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:30.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.042+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:30.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:30.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:30.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:30.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:30.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:30.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:30.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:30.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.418+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:30.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:30.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:30.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:32.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:32.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:18:32.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:32.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:32.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:32.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:32.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:32.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:32.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:32.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:32.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:32.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:32.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:32.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:32.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:32.382+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:32.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:32.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:32.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:32.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:32.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:32.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:18:35.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:35.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:35.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:35.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:35.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:35.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:35.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:35.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:35.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:35.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.313+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:35.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.329+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:35.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:35.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:18:35.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:18:35.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:18:35.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:35.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:35.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:35.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:35.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:35.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:35.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:35.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:35.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:35.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.445+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:35.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:35.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:35.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:35.455 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:18:35.453+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:18:36.491 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:18:36.508 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:18:36.516 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:18:36.531 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:18:37.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:37.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:37.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:37.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:37.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:37.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:37.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:37.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:37.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:37.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:37.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:37.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:37.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:37.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:37.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:37.745+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:37.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:37.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:37.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:37.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:38.008 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/47890785 2023-10-14T00:18:38.009 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:18:38.013 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242718 2023-10-14T00:18:38.014 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:18:38.014 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/47890785 ]] 2023-10-14T00:18:38.014 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/47890785 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\7\8\9\0\7\8\5 ]] 2023-10-14T00:18:38.014 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:18:38.407 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:18:38.405+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:18:40.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:40.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:40.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:40.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:40.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:40.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:40.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:40.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:40.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:40.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:40.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:40.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:40.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:40.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:40.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:40.809+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:40.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:40.809+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:40.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:40.809+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:40.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:40.809+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:43.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:43.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:18:44.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:44.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:44.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:44.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:44.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:44.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:44.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:44.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:44.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:44.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:44.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:44.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:44.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:44.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:44.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:44.113+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:44.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:44.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:44.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:44.145+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:44.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:44.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:44.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:44.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:45.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:18:45.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:18:45.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:45.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:45.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:45.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:45.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:45.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:45.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:45.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:45.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:45.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.101+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:45.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:45.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:45.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:46.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:46.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:46.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:46.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:46.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:46.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:46.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:46.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:46.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:46.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:46.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:46.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:46.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:46.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:46.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:46.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:46.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:46.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:46.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:46.241+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:46.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:46.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:48.027 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:18:48.027 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:18:48.033 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:18:48.034 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:18:49.367 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/47890785 2023-10-14T00:18:49.367 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:18:49.368 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242729 2023-10-14T00:18:49.368 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:18:49.368 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/47890785 ]] 2023-10-14T00:18:49.369 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/47890785 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\7\8\9\0\7\8\5 ]] 2023-10-14T00:18:49.369 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:18:52.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:52.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:52.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:52.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:52.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:52.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:52.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:52.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:52.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:52.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:52.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:52.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:52.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:52.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:52.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:52.321+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:52.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:52.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:52.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:52.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:53.424 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:18:53.421+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:18:54.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:18:54.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:18:54.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:18:54.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:54.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:54.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:54.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:54.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:54.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:54.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:54.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:54.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.677+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:54.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:54.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:54.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:54.736 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:18:54.733+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:18:55.131 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:18:55.129+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:18:55.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:55.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:55.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:55.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:55.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:55.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:55.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:55.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.297+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:55.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:55.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:18:55.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:55.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:55.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:55.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:55.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:55.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:55.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:55.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.605+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:55.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:55.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:55.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:18:57.990 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:18:57.989+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:18:59.369 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:18:59.370 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:18:59.371 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:18:59.380 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:18:59.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:59.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:18:59.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:59.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:18:59.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:59.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:18:59.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:59.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:18:59.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:59.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:18:59.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:59.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:18:59.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:59.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:18:59.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:59.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:18:59.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:59.909+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:18:59.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:59.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:18:59.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:18:59.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:00.038 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.037+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.038 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.037+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.038 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.037+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.039 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.037+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.039 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.037+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.039 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.037+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da74057680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.040 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.037+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75169700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.040 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.037+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da74c74e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.040 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.037+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75148700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.040 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.037+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a8a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.042 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.041+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.042 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.041+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a9100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.049 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.049+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.050 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.049+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a8f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.058 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.057+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.058 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.057+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a8d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.085 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.081+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.085 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.081+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.086 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.081+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a8b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.086 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.081+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751f0180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.114 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.113+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.114 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.113+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.114 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.113+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.114 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.113+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.115 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.113+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751f0880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.115 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.113+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751f0700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.115 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.113+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751f0500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.115 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.113+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751f0980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.115 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.113+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.116 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.113+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751f0b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.165 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.157+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.166 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.157+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751f0d80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.166 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.157+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.166 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.157+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.166 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.161+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.166 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.161+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751f1180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.167 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.161+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.167 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.161+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751f1380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.167 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.161+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.167 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:00.161+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751f1580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:00.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:00.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:00.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:00.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:00.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:00.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:00.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:00.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:00.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:00.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.325+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:00.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:00.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:00.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:00.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:00.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:00.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.705+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:00.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.713+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:00.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:00.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:00.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:19:00.791 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/47890785 2023-10-14T00:19:00.793 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:19:00.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:00.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:00.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:00.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:00.804 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242740 2023-10-14T00:19:00.804 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:19:00.804 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/47890785 ]] 2023-10-14T00:19:00.804 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/47890785 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\7\8\9\0\7\8\5 ]] 2023-10-14T00:19:00.805 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:19:00.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:00.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:00.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:00.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:00.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:00.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.825+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:00.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:00.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:01.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:01.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:01.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:01.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:01.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:01.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:01.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:01.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:01.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:01.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:01.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:01.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:01.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:01.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:01.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:01.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:01.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:01.885+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:01.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:01.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:01.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:01.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:02.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:02.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:19:02.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:02.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:02.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:02.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:02.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:02.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:02.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:02.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:02.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:02.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:02.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:02.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:02.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:02.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:02.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:02.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:02.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:02.813+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:02.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:02.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:02.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:02.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:03.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:19:03.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:03.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:03.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:03.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:03.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:03.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:03.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:03.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:03.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.325+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:03.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:03.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:03.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:03.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:03.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:03.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:04.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:04.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:04.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:04.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:03.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:04.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:04.005+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:04.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:04.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:04.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:04.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:05.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:05.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:05.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:05.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:05.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:05.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:05.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:05.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.237+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:05.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:19:05.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:05.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:05.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:05.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:05.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:05.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:06.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:06.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:06.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:06.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:06.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:06.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:06.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.237+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:06.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:06.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:06.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:06.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:06.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:06.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:06.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:06.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:06.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:06.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:07.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:07.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:19:07.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:07.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:07.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:07.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:07.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:07.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:07.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:07.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:07.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.197+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:07.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.201+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:07.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:07.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:07.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:07.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:07.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:07.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:07.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:07.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:07.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:07.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:07.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:07.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.961+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:07.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:07.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:07.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:08.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:08.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:08.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:08.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:08.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:08.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:08.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:08.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:08.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:08.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:08.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:08.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:08.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:08.985+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:09.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:09.001+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:09.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:09.009+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:09.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:09.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:09.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:09.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:09.140 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:19:09.137+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T00:19:09.140 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:19:09.137+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:19:10.809 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:19:10.810 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:19:10.810 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:19:10.815 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:19:11.912 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/47890785 2023-10-14T00:19:11.912 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:19:11.913 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242751 2023-10-14T00:19:11.913 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:19:11.913 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/47890785 ]] 2023-10-14T00:19:11.914 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/47890785 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\7\8\9\0\7\8\5 ]] 2023-10-14T00:19:11.914 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:19:12.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:19:12.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:19:12.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:12.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:12.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:12.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:12.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:12.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:12.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:12.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.093+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:12.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:12.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:12.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:12.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:12.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:12.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:12.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:12.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:12.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:12.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:12.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.553+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:12.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:12.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:12.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:12.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:12.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:12.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:12.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:12.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:12.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:12.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:12.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.917+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:12.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.937+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:12.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:12.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:12.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:13.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:13.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:13.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:13.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:13.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:13.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:13.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:13.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:13.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:13.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:13.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:13.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:13.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:13.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:13.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:13.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:13.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:13.625+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:13.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:13.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:13.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:13.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:14.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:14.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:14.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:14.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:14.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:14.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:14.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:14.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:14.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:14.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:14.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:14.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:14.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:14.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:14.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:14.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:14.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:14.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:14.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:14.161+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:14.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:14.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:14.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:14.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:14.520 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:19:14.517+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:19:15.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:19:15.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:15.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:19:15.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:15.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:15.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:15.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:15.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:15.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:15.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:15.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:15.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:15.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.341+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:15.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:15.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:15.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:15.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:15.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:15.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:15.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:15.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:15.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.453+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:15.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:15.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:15.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:16.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:16.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:19:16.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:16.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:16.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:16.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:16.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:16.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:16.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:16.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:16.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:16.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.901+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:16.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:16.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:16.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:18.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:18.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:18.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:18.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:18.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:18.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:18.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:18.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:18.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:18.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:18.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:18.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:18.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:18.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:18.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:18.541+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:18.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:18.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:18.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:18.557+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:18.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:18.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:18.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:18.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:19.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:19.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:19.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:19.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:19.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:19.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:19.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:19.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:19.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:19.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:19.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:19.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:19.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:19.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:19.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:19.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:19.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:19.153+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:19.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:19.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:19.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:19.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:20.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:20.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:20.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:20.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:20.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:20.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:20.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:20.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:20.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:20.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:20.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:20.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:20.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:20.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:20.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:20.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:20.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:20.957+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:20.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:20.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:20.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:20.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:21.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:21.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:21.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:21.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:21.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:21.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:21.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:21.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:21.915 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:19:21.916 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:19:21.916 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:19:21.936 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:19:22.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:22.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:22.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:22.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:22.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:22.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:22.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:22.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:22.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:22.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.313+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:22.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:22.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:22.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:22.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:22.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:22.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:22.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:22.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:22.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.933+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:22.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.945+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:22.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:22.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:22.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:23.340 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/271917931 2023-10-14T00:19:23.340 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:19:23.341 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242763 2023-10-14T00:19:23.341 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:19:23.341 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/271917931 ]] 2023-10-14T00:19:23.342 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/271917931 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\7\8\9\0\7\8\5 ]] 2023-10-14T00:19:23.342 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/271917931 2023-10-14T00:19:23.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:23.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:23.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:23.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:23.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:23.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:23.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:23.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:23.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:23.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:23.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:23.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:24.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:24.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:24.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:24.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:24.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:24.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:24.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:24.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:24.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:24.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:24.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.161+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:24.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:24.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:24.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:24.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:24.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:24.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:24.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:24.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:24.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:24.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:24.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.609+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:24.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:24.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:24.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:24.716 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:24.713+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da745befc0 handle_get_snapcontext: failed to get snapcontext: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:24.718 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:24.717+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da745bea80 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:24.738 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:24.737+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da745bfa40 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:24.746 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:24.745+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da745bee40 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:24.752 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:24.749+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da745bf380 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:24.769 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:24.769+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da745be9c0 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:24.775 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:24.773+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da745bed80 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:24.776 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:19:24.773+0000 7f3dc575f640 -1 librbd::api::Mirror: image_info_list: failed to list mirror image statuses: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:19:25.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:25.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:25.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:25.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:25.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:25.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:25.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:25.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:25.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.105+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:25.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.105+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:25.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.105+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:25.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.105+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:25.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.117+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:25.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:25.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:25.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:25.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:25.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:25.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:25.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:25.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:25.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:25.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.449+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:25.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:25.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:25.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:25.665 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/271917931 until 2023-10-14T01:19:24.949566+0000 (3600 sec) 2023-10-14T00:19:25.785 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:19:25.786 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/271917931 2023-10-14T00:19:26.842 INFO:tasks.workunit.client.0.smithi191.stderr:listed 18 entries 2023-10-14T00:19:26.868 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/271917931 2023-10-14T00:19:26.868 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:19:27.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:19:27.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:27.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:19:27.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:27.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:27.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:27.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:27.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:27.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:27.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:27.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.097+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:27.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:27.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.101+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:27.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:27.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:27.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:27.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:27.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:27.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:27.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:27.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:27.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:27.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:27.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.525+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:27.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:27.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:27.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:27.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:19:28.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:28.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:28.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:28.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:28.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:28.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:28.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:28.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:28.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:28.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.025+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:28.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:28.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:28.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:28.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:28.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:28.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:28.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:28.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:28.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.277+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:28.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:28.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:32.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:32.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:32.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:32.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:32.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:32.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:32.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:32.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:32.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:19:32.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:32.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:32.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:32.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:32.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:32.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:32.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:32.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:32.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:32.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:32.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:32.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:32.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:32.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.437+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:32.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.437+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:32.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.437+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:32.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.437+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:32.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.437+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:32.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:32.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:32.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:32.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:32.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:32.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:32.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:32.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:32.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.757+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:32.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:32.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:32.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:33.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:33.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:33.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:33.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:33.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:33.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:33.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:33.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.229+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:33.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.233+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:33.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:33.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:33.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:33.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:19:33.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:33.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:33.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:33.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:33.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:33.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:33.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:33.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:33.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:33.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.793+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:33.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:33.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:33.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:35.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:35.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:35.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:35.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:35.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:35.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:35.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:35.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:35.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:35.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:35.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:35.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:35.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:35.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:35.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:35.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:35.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:35.468+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:35.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:35.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:35.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:35.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:35.945 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:19:35.940+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:19:36.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:36.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:36.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:36.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:36.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:36.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:36.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:36.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.104+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:36.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:36.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:36.878 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:19:36.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:19:36.885 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:19:36.890 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:19:36.909 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:19:36.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:19:36.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:36.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:36.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:36.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:36.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:36.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:36.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:36.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:36.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:36.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.984+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:36.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:36.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:36.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:38.366 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1301423837 2023-10-14T00:19:38.366 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:19:38.376 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242778 2023-10-14T00:19:38.376 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:19:38.377 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1301423837 ]] 2023-10-14T00:19:38.377 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1301423837 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\7\1\9\1\7\9\3\1 ]] 2023-10-14T00:19:38.377 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/1301423837 2023-10-14T00:19:39.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:39.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:39.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:39.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:39.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:39.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:39.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:39.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.104+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:39.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:39.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:39.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:39.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:39.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:39.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:39.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:39.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.336+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:39.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:39.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:39.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:39.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:39.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:39.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:39.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:39.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:39.468+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:39.992 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:19:39.988+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:19:40.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:40.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:40.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:40.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:40.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:40.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:40.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:40.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:40.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:40.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:40.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:40.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:40.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:40.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:40.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:40.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:40.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:40.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:40.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:40.352+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:40.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:40.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:40.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:40.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:40.726 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/1301423837 until 2023-10-14T01:19:39.999554+0000 (3600 sec) 2023-10-14T00:19:40.759 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/1301423837 2023-10-14T00:19:40.760 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:19:41.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:41.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:41.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:41.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:41.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:41.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:41.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:41.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:41.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:41.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.152+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:41.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.176+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:41.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:41.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:41.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:41.983 INFO:tasks.workunit.client.0.smithi191.stderr:listed 19 entries 2023-10-14T00:19:42.033 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/1301423837 2023-10-14T00:19:42.033 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:19:42.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:42.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:42.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:42.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:42.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:42.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:42.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:42.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:42.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.720+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:42.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:42.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:42.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:42.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:42.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:42.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:42.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:42.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:42.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:42.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:42.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:42.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.940+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:42.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.952+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:42.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.952+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:42.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.952+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:42.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:19:42.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:42.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:42.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:42.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:42.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:42.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:42.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:43.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:43.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:43.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:43.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:43.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:43.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:43.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:43.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.212+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:43.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:43.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.244+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:43.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:43.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:43.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:43.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:43.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:43.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:43.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:43.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:43.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:43.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:43.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.628+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:43.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:43.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:43.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:44.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:44.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:44.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:44.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:44.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:44.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:44.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:44.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:44.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:44.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:44.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:44.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:44.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:44.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:44.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:44.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:44.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:44.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:44.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:44.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:44.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:44.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.740+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:44.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:44.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:44.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:46.645 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:19:46.640+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:19:47.029 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:19:47.028+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:19:48.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:48.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:19:48.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:48.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:48.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:48.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:48.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:48.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:48.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:48.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:48.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:48.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.592+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:48.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:48.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:48.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:48.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:48.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:48.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:48.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:48.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:48.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:48.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:48.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.792+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:48.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:48.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:48.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:48.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:48.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:48.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:48.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:48.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:48.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:48.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:48.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:48.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:48.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:49.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:49.008+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:49.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:49.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:49.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:49.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:49.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:49.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:49.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:49.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:49.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:49.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:49.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:49.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:49.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:49.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:49.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:49.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:49.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:49.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:50.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:50.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:50.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:50.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:50.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:50.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:50.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:50.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:50.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:50.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:50.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.556+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:50.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:50.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:50.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:50.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:50.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:50.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:50.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:50.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:50.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:50.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:51.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:51.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:51.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:51.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:51.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:51.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:51.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:51.684+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:51.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:51.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:51.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:51.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:52.039 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:19:52.058 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:19:52.062 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:19:52.062 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:19:52.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:52.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:52.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:52.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:52.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:52.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:52.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:52.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:52.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.408+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:52.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:52.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:52.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:19:52.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:52.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:19:52.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:52.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:52.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:52.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:52.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:52.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:52.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:52.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:52.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:52.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.564+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:52.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:52.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:52.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:19:52.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:52.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:52.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:52.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:52.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:52.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:52.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:52.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:52.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:53.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:53.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:53.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:53.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:53.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:53.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:53.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:53.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:53.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:53.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.160+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:53.468 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1301423837 2023-10-14T00:19:53.476 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:19:53.477 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242793 2023-10-14T00:19:53.477 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:19:53.477 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1301423837 ]] 2023-10-14T00:19:53.477 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1301423837 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\3\0\1\4\2\3\8\3\7 ]] 2023-10-14T00:19:53.477 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:19:53.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:53.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:53.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:53.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:53.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:53.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:53.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:53.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:53.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.952+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:53.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.968+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:53.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:53.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:53.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:54.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:54.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:54.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:54.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:54.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:54.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:54.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:54.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:54.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.640+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:54.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:54.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:54.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:19:54.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:54.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:55.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:55.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:55.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:55.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:55.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:55.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:55.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:55.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:55.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:55.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:55.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:55.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:55.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:55.060+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:55.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:55.080+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:55.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:55.080+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:55.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:55.080+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:55.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:55.080+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:56.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:19:56.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:56.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:56.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:56.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:56.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:56.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:56.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.636+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:56.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.676+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:56.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:56.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:56.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:56.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:56.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:56.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:56.953 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:19:56.948+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:19:56.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:56.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:56.987 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:19:56.988+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:19:56.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:56.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:56.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:57.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:57.000+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:57.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:57.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:57.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:57.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:19:57.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:57.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:57.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:57.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:57.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:57.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:57.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:57.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:57.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:57.600+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:57.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:57.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:59.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:59.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:19:59.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:59.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:19:59.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:59.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:19:59.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:59.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:19:59.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:59.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:19:59.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:59.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:19:59.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:59.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:19:59.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:59.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:19:59.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:59.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:19:59.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:59.764+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:19:59.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:59.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:19:59.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:19:59.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:00.051 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.052+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.052 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.052+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da74cc5c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.052 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.052+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.052+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da74ec5c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.052+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.053 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.052+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da74ce5b00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.054 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.056+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.054 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.056+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da73ff5b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.074 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.076+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.074 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.076+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da74c27800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.075 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.076+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.075 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.076+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751ad780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.075 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.076+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.075 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.076+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751ac680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.133 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.132+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.134 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.132+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751ad380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.144 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.144+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.144+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.144+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.144+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.144+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.144+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75149880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.144+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75149980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.144+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75149200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.147 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.144+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751adb00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.147 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.144+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75153880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.197 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.196+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.198 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.196+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.198 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.196+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.198 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.196+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.199 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.196+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da74c75180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.199 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.196+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75149c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.199 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.196+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da7476a280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.199 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.196+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75153180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.205 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.208+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.206 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.208+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75153480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.238 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.236+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.238 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.236+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.238 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.236+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75149880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.239 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:20:00.236+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75149980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:20:00.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:00.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:00.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:00.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:00.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:00.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:00.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:00.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:00.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:00.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:00.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:00.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:00.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:00.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:00.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:00.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:00.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:00.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:00.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:00.844+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:00.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:00.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:00.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:00.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:01.144 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:20:01.144+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:20:02.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:02.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:02.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:02.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:02.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:02.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:02.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:02.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:02.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:02.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:02.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:02.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.324+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:02.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:02.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:02.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:02.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:02.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:02.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:02.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:02.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:02.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:02.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:02.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:02.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.400+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:02.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:02.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:02.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:02.534 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:20:02.536+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:20:03.479 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:20:03.479 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:20:03.491 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:20:03.494 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:20:04.790 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1301423837 2023-10-14T00:20:04.791 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:20:04.792 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242804 2023-10-14T00:20:04.792 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:20:04.793 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1301423837 ]] 2023-10-14T00:20:04.793 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1301423837 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\3\0\1\4\2\3\8\3\7 ]] 2023-10-14T00:20:04.793 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:20:05.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:05.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:05.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:05.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:05.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:05.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:05.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:05.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:05.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:05.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.380+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:05.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:05.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.408+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:05.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:05.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:05.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:05.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:05.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:05.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:05.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:05.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:05.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:05.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:05.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:05.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:05.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:05.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:05.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.516+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:05.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:05.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:06.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:06.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:06.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:06.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:06.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:06.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:06.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:06.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:06.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:06.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.176+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:06.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:06.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:06.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:06.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:07.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:07.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:07.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:07.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:07.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:07.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:07.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.056+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:07.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.056+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:07.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.068+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:07.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:07.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:07.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:07.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:07.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:07.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:07.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:07.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:07.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:07.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:07.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:07.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:07.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:07.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:07.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:07.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:07.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.576+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:07.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:07.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:08.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:08.008+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:08.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:08.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:08.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:08.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:08.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:08.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:08.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:08.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:08.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:08.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:08.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:08.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:08.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:08.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:08.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:08.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:08.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:08.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:08.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:08.720+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:09.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:09.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:09.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:09.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:09.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:09.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:09.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:09.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:09.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:09.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:09.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:09.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:09.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:09.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:09.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:09.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:09.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:09.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:09.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:09.688+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:09.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:09.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:09.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:09.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:10.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:10.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:10.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:10.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:10.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:10.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:10.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:10.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:10.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:10.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:10.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:10.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:10.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:10.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:10.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:10.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:10.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:10.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:10.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:10.832+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:10.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:10.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:10.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:10.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:11.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:11.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:11.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:11.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:11.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:11.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:11.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:11.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:11.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:11.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:11.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:11.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:12.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:12.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:12.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:12.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:12.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:12.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:12.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:12.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:12.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:12.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:12.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:12.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:12.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:12.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:12.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:12.456+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:12.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:12.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:12.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:12.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:14.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:14.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:14.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:14.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:14.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:14.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:14.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:14.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:14.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:14.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:14.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:14.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:14.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:14.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:14.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:14.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:14.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:14.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:14.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:14.440+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:14.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:14.440+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:14.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:14.440+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:14.798 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:20:14.799 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:20:14.800 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:20:14.800 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:20:16.021 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1301423837 2023-10-14T00:20:16.021 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:20:16.022 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242816 2023-10-14T00:20:16.022 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:20:16.022 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1301423837 ]] 2023-10-14T00:20:16.023 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1301423837 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\3\0\1\4\2\3\8\3\7 ]] 2023-10-14T00:20:16.023 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:20:16.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:16.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:16.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:16.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:16.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:16.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:16.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:16.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:16.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:16.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:16.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:16.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:16.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:16.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:16.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:16.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:16.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:16.796+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:16.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:16.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:16.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:16.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:19.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:19.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:19.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:19.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:19.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:19.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:19.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:19.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:19.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:19.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:19.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.792+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:19.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:19.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:19.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:20.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:20.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:20.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:20.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:20.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:20.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:20.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:20.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:20.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:20.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:20.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:20.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:20.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:20.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:20.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:20.968+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:20.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:20.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:20.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:20.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:21.138 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:20:21.136+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:20:23.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:23.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:23.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:23.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.716+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:23.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:23.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:23.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:23.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:23.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:23.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:23.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:23.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:23.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:23.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:23.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.820+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:23.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:23.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:23.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:23.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:23.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:23.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:23.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:23.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:23.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:23.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:23.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:23.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.932+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:23.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.932+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:23.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.936+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:23.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:23.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:25.616 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:20:25.616+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:20:26.028 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:20:26.046 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:20:26.047 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:20:26.069 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:20:26.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:26.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:26.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:26.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:26.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:26.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:26.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:26.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:26.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:26.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:26.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:26.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:26.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.840+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:26.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:26.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:26.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:26.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:26.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:26.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:26.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:26.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:26.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:26.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:26.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:26.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:26.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:26.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:26.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:27.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:27.012+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:27.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:27.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:27.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:27.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:27.521 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1301423837 2023-10-14T00:20:27.523 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:20:27.524 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242827 2023-10-14T00:20:27.524 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:20:27.525 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1301423837 ]] 2023-10-14T00:20:27.525 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1301423837 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\3\0\1\4\2\3\8\3\7 ]] 2023-10-14T00:20:27.525 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:20:28.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:28.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:28.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:28.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:28.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:28.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:28.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:28.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:28.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:28.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:28.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:28.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:28.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:28.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:28.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:28.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:28.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:28.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:28.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:28.716+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:28.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:28.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:28.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:28.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:29.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:29.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:29.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:29.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:29.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:29.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:29.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:29.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:29.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:29.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:29.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:29.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:29.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:29.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:29.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:29.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:29.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:29.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:29.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.876+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:29.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:29.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:29.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:30.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:30.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:30.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:30.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:30.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:30.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:30.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:30.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:30.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:30.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:30.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:30.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:30.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:30.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:30.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:30.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:30.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:30.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:30.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:30.792+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:30.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:30.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:30.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:30.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:31.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:31.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:31.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:31.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:31.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:31.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:31.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:31.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:31.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:31.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:31.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:31.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.920+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:31.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:31.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:31.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:32.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:32.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:32.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:32.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:32.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:32.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:32.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:32.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:32.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:32.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:32.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:32.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:32.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:32.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:32.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:32.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:32.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:32.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:32.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:32.696+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:32.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:32.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:32.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:32.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:33.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:33.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:33.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:33.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:33.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:33.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:33.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:33.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:33.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.144+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:33.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:33.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:33.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:33.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:33.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:33.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:33.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:33.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:33.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:33.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:33.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:33.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:33.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.268+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:33.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.272+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:33.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:33.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:33.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:33.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:33.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:33.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:33.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:33.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:33.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:33.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.728+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:33.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:35.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:35.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:35.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:35.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:35.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:35.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:35.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:35.552+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:35.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:35.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:35.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:35.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:37.539 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:20:37.542 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:20:37.544 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:20:37.555 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:20:38.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:38.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:38.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:38.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:38.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:38.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:38.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.355+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:38.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:38.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:38.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:38.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:38.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:38.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:38.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:38.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:38.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:38.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:38.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:38.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:38.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:38.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:38.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.451+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:38.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:38.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:38.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:38.968 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1301423837 2023-10-14T00:20:38.969 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:20:38.970 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242838 2023-10-14T00:20:38.970 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:20:38.971 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1301423837 ]] 2023-10-14T00:20:38.971 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1301423837 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\3\0\1\4\2\3\8\3\7 ]] 2023-10-14T00:20:38.971 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:20:39.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:39.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:39.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:39.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:39.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:39.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:39.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:39.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:39.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.211+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:39.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:39.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:39.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:39.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:39.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:39.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:39.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:39.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:39.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:39.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:39.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:39.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:39.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.811+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:39.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:39.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:39.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:40.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:40.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:40.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:40.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:40.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:40.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:40.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:40.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:40.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:40.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:40.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:40.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.739+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:40.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:40.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:40.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:40.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:40.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:40.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.967+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:40.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:40.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:40.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:44.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:44.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:44.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:44.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:44.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:44.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:44.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:44.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:44.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.231+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:44.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:44.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:44.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:44.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:44.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:44.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:44.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:44.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:45.519 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:20:45.515+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:20:47.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:47.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:47.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:47.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:47.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:47.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:47.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:47.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:47.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.679+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:47.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:47.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:47.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:47.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:47.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:47.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:47.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:47.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:47.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:47.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:48.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:48.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:48.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:48.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:48.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:48.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:48.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:48.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.595+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:48.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.595+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:48.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.595+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:48.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:48.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:48.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:48.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:48.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.603+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:48.845 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:20:48.843+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:20:48.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:48.979 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:20:48.980 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:20:48.980 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:20:48.993 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:20:48.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:48.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:48.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:48.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:49.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:49.015+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:49.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:49.035+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:49.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:49.035+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:49.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:49.035+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:50.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:50.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:50.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:50.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:50.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:50.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:50.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:50.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:50.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:50.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.303+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:50.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:50.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:50.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:50.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:50.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:50.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:50.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:50.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:50.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:50.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:50.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:50.645 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/222793192 2023-10-14T00:20:50.645 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:20:50.646 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242850 2023-10-14T00:20:50.646 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:20:50.646 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/222793192 ]] 2023-10-14T00:20:50.647 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/222793192 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\3\0\1\4\2\3\8\3\7 ]] 2023-10-14T00:20:50.647 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/222793192 2023-10-14T00:20:50.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:50.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.679+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:50.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:50.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:50.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:51.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:51.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:51.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:51.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:51.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:51.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:51.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:51.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:51.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:51.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:51.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:51.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:51.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.139+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:51.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.139+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:51.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:51.139+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:52.718 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/222793192 until 2023-10-14T01:20:52.071815+0000 (3600 sec) 2023-10-14T00:20:52.792 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:20:52.792 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/222793192 2023-10-14T00:20:53.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:53.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:53.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:53.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:53.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:53.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:53.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:53.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:53.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:53.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:53.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:53.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:53.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:53.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:53.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:53.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:53.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:53.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:53.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:53.527+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:53.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:53.527+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:53.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:53.527+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:53.975 INFO:tasks.workunit.client.0.smithi191.stderr:listed 20 entries 2023-10-14T00:20:54.029 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/222793192 2023-10-14T00:20:54.029 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:20:54.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:54.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:54.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:54.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:54.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:54.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:54.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:54.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:54.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.275+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:54.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:54.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:54.768 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:20:54.767+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:20:54.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:54.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:54.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:54.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:54.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:54.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:54.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:54.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:54.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:54.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.931+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:54.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:54.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:54.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:54.965 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:20:54.963+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:20:56.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:56.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:56.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:56.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:56.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:56.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:56.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:56.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:56.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:56.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:56.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:56.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:56.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:56.103+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:56.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:56.135+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:56.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:56.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:56.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:56.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:58.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:58.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:58.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:58.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:58.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:58.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:58.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:58.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:58.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:58.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:58.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:58.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:58.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:58.691+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:58.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:58.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:58.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:58.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:20:59.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:20:59.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:20:59.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:20:59.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:20:59.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:20:59.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:20:59.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:20:59.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:20:59.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:20:59.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:20:59.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:20:59.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:20:59.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.323+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:20:59.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:20:59.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:20:59.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:00.030 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.031+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.031 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.031+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74056400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.037 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.035+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.037 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.035+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.037 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.035+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476a280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.037 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.035+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.121 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.119+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.122 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.119+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.122 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.119+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476ae80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.123 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.119+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.128 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.123+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.129 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.123+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.130 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.123+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.130 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.123+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75168e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.132 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.131+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.132 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.131+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.132 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.131+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.133 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.131+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.162 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.159+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.162 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.159+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75149880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.169 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.167+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.169 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.167+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75168480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.170 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.171+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.170 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.171+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75168f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.171 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.171+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.171 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.171+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a8b00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.174 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.175+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.174 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.175+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476ae80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.175 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.175+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.175 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.175+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.175 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.175+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.176 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.175+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.176 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.175+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.176 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.175+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75168e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.176 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.175+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.176 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.175+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.182 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.183+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.182 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.183+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.183 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.183+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.183 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:21:00.183+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75149880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:21:00.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:00.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:00.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:00.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:00.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:00.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:00.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:00.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:00.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:00.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.427+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:00.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:00.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:00.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:00.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:00.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:00.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:00.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:00.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:01.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:01.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:01.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:01.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:01.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:01.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:01.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:01.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:01.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:01.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:01.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:01.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:01.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:01.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:01.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:01.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:01.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:01.815+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:01.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:01.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:01.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:01.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:01.825 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:21:01.827+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:21:01.861 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:21:01.859+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:21:03.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:03.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:03.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:03.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:03.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:03.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:03.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:03.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:03.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:03.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:03.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:03.435+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:03.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:03.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:03.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:03.447+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:03.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:03.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:03.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:03.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:03.596 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:21:03.595+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:21:04.038 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:21:04.049 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:21:04.053 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:21:04.055 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:21:05.493 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/222793192 2023-10-14T00:21:05.495 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:21:05.497 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242865 2023-10-14T00:21:05.497 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:21:05.497 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/222793192 ]] 2023-10-14T00:21:05.497 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/222793192 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\2\2\7\9\3\1\9\2 ]] 2023-10-14T00:21:05.498 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:21:06.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:06.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:06.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:06.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:06.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:06.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:06.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:06.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:06.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:06.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:06.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.275+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:06.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:06.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:06.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:06.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:06.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:06.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:06.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:06.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:06.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:06.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:06.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.611+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:06.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:06.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.627+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:06.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:06.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:06.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:06.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:06.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:06.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:06.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:06.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:06.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.935+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:06.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:06.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.955+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:06.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:06.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:06.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:09.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:09.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:09.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:09.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:09.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:09.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:09.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:09.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:09.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:09.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:09.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.531+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:09.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:09.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:09.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:21:09.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:09.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:09.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:09.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:09.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:09.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:09.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:09.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:09.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:09.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.595+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:09.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.639+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:09.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.639+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:09.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.639+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:09.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.639+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:09.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:21:09.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:09.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:09.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:09.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:09.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:09.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:09.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:09.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:09.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:09.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:09.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.715+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:09.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:09.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:09.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:21:09.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:09.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:09.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:09.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:09.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:09.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:09.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:09.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:09.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:09.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:09.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:09.759+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:10.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:10.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:10.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:10.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:10.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:10.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:10.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:10.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.263+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:10.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:10.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:10.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:10.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:10.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:10.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:10.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:10.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.379+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:10.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:10.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:10.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:21:10.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:10.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:10.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:10.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:10.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:10.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:10.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:10.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:10.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:10.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.895+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:10.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.895+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:10.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.895+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:10.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:10.895+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:11.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:11.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:11.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:11.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:11.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:11.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:11.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:11.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:11.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:11.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:11.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:11.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:11.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:11.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:11.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:11.487+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:11.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:11.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:11.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:11.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:13.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:13.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:13.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:13.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:13.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:13.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:13.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:13.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:13.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:13.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:13.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:13.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:13.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:13.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:13.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:13.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:13.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:13.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.943+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:13.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:13.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:13.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:15.509 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:21:15.526 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:21:15.526 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:21:15.537 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:21:15.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:15.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:15.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:15.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:15.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:15.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:15.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:15.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:15.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:15.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:15.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:15.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:15.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:15.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:15.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:15.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:15.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:15.975+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:15.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:15.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:15.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:15.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:16.813 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/222793192 2023-10-14T00:21:16.814 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:21:16.814 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242876 2023-10-14T00:21:16.815 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:21:16.815 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/222793192 ]] 2023-10-14T00:21:16.815 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/222793192 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\2\2\7\9\3\1\9\2 ]] 2023-10-14T00:21:16.815 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:21:17.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:21:17.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:17.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:17.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:17.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:17.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:17.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:17.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:17.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:17.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:17.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:17.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.127+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:17.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:17.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:17.320 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:21:17.319+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:21:17.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:17.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:17.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:17.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:17.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:17.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:17.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:17.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:17.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:17.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:17.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:17.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.587+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:17.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:17.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:17.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:19.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:19.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:19.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:19.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:19.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:19.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:19.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.783+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:19.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:19.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:19.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:21:19.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:19.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:19.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:19.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:19.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:19.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:19.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.871+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:19.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:19.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.887+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:19.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:19.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:19.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:19.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:21.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:21.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:21.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:21.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:21.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:21.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:21.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:21.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:21.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:21.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:21.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:21.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:21.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:21.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:21.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:21.903+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:21.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:21.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:23.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:23.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:23.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:23.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:23.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:23.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:23.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:23.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:23.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:23.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:23.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:23.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:23.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:23.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:23.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:23.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:23.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:23.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:23.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:23.427+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:23.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:23.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:23.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:23.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:25.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:25.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:25.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:25.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:25.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:25.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:25.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:25.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:25.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:25.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:25.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:25.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:25.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:25.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:25.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:25.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:25.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:25.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:25.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:25.671+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:25.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:25.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:25.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:25.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:26.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:26.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:26.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:26.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:26.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:26.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:26.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:26.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:26.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:26.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:26.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:26.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:26.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:26.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:26.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.435+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:26.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:26.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.455+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:26.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.455+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:26.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:26.455+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:26.832 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:21:26.841 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:21:26.841 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:21:26.850 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:21:28.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:28.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:28.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:28.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:28.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:28.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:28.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:28.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:28.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:28.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:28.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:28.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:28.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:28.143+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:28.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:28.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:28.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:28.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:28.412 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/222793192 2023-10-14T00:21:28.414 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:21:28.416 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242888 2023-10-14T00:21:28.416 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:21:28.416 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/222793192 ]] 2023-10-14T00:21:28.416 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/222793192 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\2\2\7\9\3\1\9\2 ]] 2023-10-14T00:21:28.416 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:21:28.944 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:21:28.943+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:21:29.086 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:21:29.087+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:21:33.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:21:33.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:33.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:33.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:33.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:33.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:33.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:33.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:33.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:33.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:33.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:33.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.771+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:33.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.791+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:33.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.791+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:33.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.791+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:33.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:33.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:33.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:33.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:33.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:33.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:33.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:33.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:34.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:34.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:34.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:34.015+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:34.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:34.015+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:34.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:34.035+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:34.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:34.035+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:34.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:34.035+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:36.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:36.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:36.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:36.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:36.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:36.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:36.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:36.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:36.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:36.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:36.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:36.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:36.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:36.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:36.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:36.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:37.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:37.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:37.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:37.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.023+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:37.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.059+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:37.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:37.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:37.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:21:37.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:37.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:37.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:37.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:37.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:37.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:37.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:37.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:37.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.375+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:37.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:37.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:37.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:37.535 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:21:37.535+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:21:38.439 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:21:38.442 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:21:38.443 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:21:38.474 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:21:39.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:39.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:39.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:39.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:39.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:39.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:39.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:39.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:39.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.247+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:39.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:39.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:39.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:39.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:39.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:39.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:39.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:39.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:39.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:39.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:39.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:39.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.571+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:39.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:39.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:39.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:39.867 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/222793192 2023-10-14T00:21:39.869 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:21:39.870 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242899 2023-10-14T00:21:39.871 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:21:39.871 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/222793192 ]] 2023-10-14T00:21:39.871 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/222793192 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\2\2\7\9\3\1\9\2 ]] 2023-10-14T00:21:39.871 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:21:41.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:41.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:41.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:41.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:41.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:41.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:41.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:41.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:41.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:41.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:41.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:41.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.343+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:41.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.343+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:41.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:41.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:41.471 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:21:41.471+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:21:42.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:21:42.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:42.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:42.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:42.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:42.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:42.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:42.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:42.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:42.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:42.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:42.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.243+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:42.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:42.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:42.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:42.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:42.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:42.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:42.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:42.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:42.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:42.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:42.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:42.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:42.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.583+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:42.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:42.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:42.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:42.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:42.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:42.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.919+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:42.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:42.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:43.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:21:43.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:43.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:43.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:43.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:43.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:43.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:43.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:43.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:43.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:43.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:43.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:43.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:43.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:43.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:43.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:44.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:44.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:44.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:44.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:44.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:44.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:44.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:44.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:44.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:44.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:44.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:44.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:44.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:44.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:44.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:44.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:44.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:44.119+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:44.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:44.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:44.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:44.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:46.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:46.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:46.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:46.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:46.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:46.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:46.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:46.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:46.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:46.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:46.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:46.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:46.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:46.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:46.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:46.523+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:46.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:46.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:46.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:46.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:46.785 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:21:46.787+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:21:48.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:48.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:48.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:48.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:48.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:48.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:48.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:48.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:48.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:48.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:48.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:48.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.234+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:48.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:48.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:48.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:48.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:48.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:48.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:21:48.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:48.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:48.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:48.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:48.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:48.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:48.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:48.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.794+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:48.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:48.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.814+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:48.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:48.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:48.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:49.876 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:21:49.877 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:21:49.881 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:21:49.882 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:21:50.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:50.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:50.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:50.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:50.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:50.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:50.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:50.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:50.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:50.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:50.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:50.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:50.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:50.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:50.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:50.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:50.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:50.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:51.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:51.038+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:51.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:51.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:51.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:51.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:51.439 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/222793192 2023-10-14T00:21:51.440 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:21:51.441 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242911 2023-10-14T00:21:51.441 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:21:51.441 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/222793192 ]] 2023-10-14T00:21:51.442 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/222793192 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\2\2\7\9\3\1\9\2 ]] 2023-10-14T00:21:51.442 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:21:52.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:52.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:52.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:52.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:52.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:52.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:52.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:52.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:52.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:52.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.714+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:52.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:52.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:52.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:21:52.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:52.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:52.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:52.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:52.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:53.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:53.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:53.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:53.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:53.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:53.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.054+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:53.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.062+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:53.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:53.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:53.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:53.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:53.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:53.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:53.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:53.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:53.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:53.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:53.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:53.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.866+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:53.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:53.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:53.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:54.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:54.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:54.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:54.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:54.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:54.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:54.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:54.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:54.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:54.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:54.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:54.382+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:54.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:54.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:54.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:54.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:56.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:56.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:56.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:56.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:56.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:56.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:56.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:56.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:56.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:56.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.110+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:56.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:56.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:56.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:56.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:56.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:56.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:56.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:56.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.738+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:56.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.742+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:56.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.758+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:56.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:56.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:56.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:21:57.698 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:21:57.698+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:21:57.889 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:21:57.882+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:21:58.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:21:58.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:21:58.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:21:58.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:21:58.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:21:58.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:21:58.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:21:58.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:21:58.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:21:58.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:21:58.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.530+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:21:58.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:21:58.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:21:58.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:00.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:22:00.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:22:00.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:00.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:00.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:00.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:00.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:00.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:00.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:00.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.350+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:00.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:00.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.374+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:00.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:00.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:00.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:00.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:00.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:00.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:00.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:00.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:00.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:00.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:00.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:00.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.898+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:00.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.898+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:00.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:00.898+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:01.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:01.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:01.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:01.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:01.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:01.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:01.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:01.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:01.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.130+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:01.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:01.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:01.443 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:22:01.443 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:22:01.444 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:22:01.447 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:22:01.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.938+0000 7f3f36fa4640 -1 reset not still connected to 0x5588a27f9040 2023-10-14T00:22:01.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:01.958+0000 7f3f36fa4640 -1 reset not still connected to 0x5588a27f9c70 2023-10-14T00:22:02.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558891498270 2023-10-14T00:22:02.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558899243d40 2023-10-14T00:22:02.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558899243e10 2023-10-14T00:22:02.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.222+0000 7f3f36fa4640 -1 reset not still connected to 0x5588a27f9040 2023-10-14T00:22:02.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.222+0000 7f3f36fa4640 -1 reset not still connected to 0x5588a27f91e0 2023-10-14T00:22:02.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.230+0000 7f3f36fa4640 -1 reset not still connected to 0x5588a27f9c70 2023-10-14T00:22:02.356 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:22:02.354+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:22:02.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:22:02.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:22:02.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:22:02.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:02.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:02.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:02.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:02.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:02.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:02.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:02.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:02.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:02.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.598+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:02.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:02.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:02.606+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:02.783 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3282223265 2023-10-14T00:22:02.783 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:22:02.783 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242922 2023-10-14T00:22:02.784 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:22:02.784 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3282223265 ]] 2023-10-14T00:22:02.784 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3282223265 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\2\2\7\9\3\1\9\2 ]] 2023-10-14T00:22:02.784 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/3282223265 2023-10-14T00:22:03.750 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.750+0000 7f3dc8765640 -1 librbd::managed_lock::GetLockerRequest: 0x55da7462a700 handle_get_lockers: failed to retrieve lockers: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:03.751 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.750+0000 7f3dc8765640 -1 librbd::managed_lock::AcquireRequest: 0x55da756602d0 handle_get_locker: failed to retrieve lockers: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:03.751 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.750+0000 7f3dc8765640 -1 librbd::ManagedLock: 0x55da7460cd18 handle_acquire_lock: failed to acquire exclusive lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:03.751 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.750+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da7562a410 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:03.751 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.750+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da7566ac60 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:03.757 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.758+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:03.758 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.758+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:03.761 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.762+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da7506e300 image watch failed: 94396760556544, (107) Transport endpoint is not connected 2023-10-14T00:22:03.761 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.762+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da7506e300 handle_error: handle=94396760556544: (107) Transport endpoint is not connected 2023-10-14T00:22:03.762 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.762+0000 7f3dc8765640 -1 librbd::watcher::RewatchRequest: 0x55da74983f40 handle_unwatch client blocklisted 2023-10-14T00:22:03.762 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.762+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da7506e300 handle_rewatch: client blocklisted 2023-10-14T00:22:03.764 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.762+0000 7f3dc8f66640 -1 librbd::ImageWatcher: 0x55da7506f800 image watch failed: 94396760536064, (107) Transport endpoint is not connected 2023-10-14T00:22:03.764 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.762+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da7506f800 handle_error: handle=94396760536064: (107) Transport endpoint is not connected 2023-10-14T00:22:03.786 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.786+0000 7f3dc8f66640 -1 librbd::watcher::RewatchRequest: 0x55da74983860 handle_unwatch client blocklisted 2023-10-14T00:22:03.786 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.786+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da7506f800 handle_rewatch: client blocklisted 2023-10-14T00:22:03.786 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.786+0000 7f3dc8f66640 -1 librbd::ImageWatcher: 0x55da75359200 image watch failed: 94396760708096, (107) Transport endpoint is not connected 2023-10-14T00:22:03.787 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.786+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da75359200 handle_error: handle=94396760708096: (107) Transport endpoint is not connected 2023-10-14T00:22:03.787 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.786+0000 7f3dc8f66640 -1 librbd::watcher::RewatchRequest: 0x55da748836d0 handle_unwatch client blocklisted 2023-10-14T00:22:03.787 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.786+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da75359200 handle_rewatch: client blocklisted 2023-10-14T00:22:03.816 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.814+0000 7f3dc8f66640 -1 librbd::ImageWatcher: 0x55da7506e600 image watch failed: 94396760725504, (107) Transport endpoint is not connected 2023-10-14T00:22:03.816 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.814+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da7506e600 handle_error: handle=94396760725504: (107) Transport endpoint is not connected 2023-10-14T00:22:03.816 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.814+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da75359500 image watch failed: 94396760538112, (107) Transport endpoint is not connected 2023-10-14T00:22:03.816 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.814+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da75359500 handle_error: handle=94396760538112: (107) Transport endpoint is not connected 2023-10-14T00:22:03.826 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.826+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da73d2c000 image watch failed: 94396760534016, (107) Transport endpoint is not connected 2023-10-14T00:22:03.826 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.826+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da73d2c000 handle_error: handle=94396760534016: (107) Transport endpoint is not connected 2023-10-14T00:22:03.827 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.826+0000 7f3dc8f66640 -1 librbd::ImageWatcher: 0x55da7506ec00 image watch failed: 94396760649728, (107) Transport endpoint is not connected 2023-10-14T00:22:03.827 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.826+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da7506ec00 handle_error: handle=94396760649728: (107) Transport endpoint is not connected 2023-10-14T00:22:03.827 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.826+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da75359800 image watch failed: 94396760724480, (107) Transport endpoint is not connected 2023-10-14T00:22:03.827 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.826+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da75359800 handle_error: handle=94396760724480: (107) Transport endpoint is not connected 2023-10-14T00:22:03.828 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.826+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da73d2c300 image watch failed: 94396755934208, (107) Transport endpoint is not connected 2023-10-14T00:22:03.828 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.826+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da73d2c300 handle_error: handle=94396755934208: (107) Transport endpoint is not connected 2023-10-14T00:22:03.840 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.838+0000 7f3dc8f66640 -1 librbd::watcher::RewatchRequest: 0x55da74954550 handle_unwatch client blocklisted 2023-10-14T00:22:03.841 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.838+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da7506e600 handle_rewatch: client blocklisted 2023-10-14T00:22:03.841 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.838+0000 7f3dc8f66640 -1 librbd::watcher::RewatchRequest: 0x55da74857f90 handle_unwatch client blocklisted 2023-10-14T00:22:03.841 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.838+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da75359500 handle_rewatch: client blocklisted 2023-10-14T00:22:03.901 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.898+0000 7f3dc8f66640 -1 librbd::watcher::RewatchRequest: 0x55da74be06e0 handle_unwatch client blocklisted 2023-10-14T00:22:03.901 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.898+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da73d2c000 handle_rewatch: client blocklisted 2023-10-14T00:22:03.902 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.898+0000 7f3dc8f66640 -1 librbd::watcher::RewatchRequest: 0x55da74be0550 handle_unwatch client blocklisted 2023-10-14T00:22:03.902 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.898+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da75359800 handle_rewatch: client blocklisted 2023-10-14T00:22:03.902 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.898+0000 7f3dc8f66640 -1 librbd::ManagedLock: 0x55da74617398 send_acquire_lock: watcher not registered - client blocklisted 2023-10-14T00:22:03.902 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.898+0000 7f3dc8f66640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da7562a270 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:03.902 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.898+0000 7f3dc8f66640 -1 librbd::io::AioCompletion: 0x55da7565f1e0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:03.903 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.902+0000 7f3dc8765640 -1 librbd::watcher::RewatchRequest: 0x55da74957130 handle_unwatch client blocklisted 2023-10-14T00:22:03.903 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.902+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da73d2c300 handle_rewatch: client blocklisted 2023-10-14T00:22:03.904 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.902+0000 7f3dc8765640 -1 librbd::ManagedLock: 0x55da74609538 send_acquire_lock: watcher not registered - client blocklisted 2023-10-14T00:22:03.904 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.902+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da7562a680 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:03.904 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:03.902+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da75633340 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.726 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/3282223265 until 2023-10-14T01:22:03.914880+0000 (3600 sec) 2023-10-14T00:22:04.742 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.742+0000 7f3dc8f66640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.742 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.742+0000 7f3dc8f66640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da73cb2a90 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.743 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.742+0000 7f3dc8f66640 -1 librbd::io::AioCompletion: 0x55da7565e9a0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.743 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.742+0000 7f3dc8f66640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.743 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.742+0000 7f3dc8f66640 -1 librbd::io::AioCompletion: 0x55da75633340 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.744 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.742+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da75649640 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.744 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.742+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da73e838c0 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.770 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:22:04.771 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/3282223265 2023-10-14T00:22:04.774 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.774+0000 7f3dc8765640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.774 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.774+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da7562a4e0 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.774 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.774+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da756334a0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.775 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.774+0000 7f3dc8765640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.775 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.774+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da744492b0 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.775 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.774+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da7556b4a0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.793 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.790+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.793 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.790+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da75633340 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.793 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.790+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da75639bc0 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.794 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.790+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.794 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.790+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da756334a0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.794 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.790+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da75638c00 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.794 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.790+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74967e60 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.795 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.794+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da749661e0 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.796 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.794+0000 7f3dc8765640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.796 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.794+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da7562a5b0 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.796 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.794+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da75633b80 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.823 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.822+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.823 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.822+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da756334a0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.824 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.822+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da7561f900 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.830 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.830+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74c709c0 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.835 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.834+0000 7f3dc8765640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.835 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.834+0000 7f3dc8765640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.836 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.834+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da74449c70 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.836 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.834+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da75633a20 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.836 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.834+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da74448750 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.836 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.834+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da75632420 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.854 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.850+0000 7f3dc8f66640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.854 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.850+0000 7f3dc8f66640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.854 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.850+0000 7f3dc8f66640 -1 librbd::io::AioCompletion: 0x55da756334a0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.854 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.850+0000 7f3dc8f66640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da75639ac0 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.855 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.850+0000 7f3dc8f66640 -1 librbd::io::AioCompletion: 0x55da75633b80 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.855 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.850+0000 7f3dc8f66640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da75639d00 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.883 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.878+0000 7f3dc8f66640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74a31ce0 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:04.884 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:22:04.878+0000 7f3dc8f66640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74b4c780 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:22:05.540 INFO:tasks.workunit.client.0.smithi191.stderr:listed 21 entries 2023-10-14T00:22:05.574 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/3282223265 2023-10-14T00:22:05.574 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:22:06.706 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:22:06.706+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:22:09.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:09.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:09.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:09.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:09.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:09.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:09.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:09.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:09.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:09.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:09.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:09.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:09.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:09.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:09.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:09.750+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:09.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:09.774+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:09.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:09.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:09.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:09.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:11.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:22:11.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:22:11.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:22:11.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:11.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:11.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:11.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:11.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:11.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:11.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:11.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:11.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:11.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.722+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:11.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:11.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:11.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:12.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:12.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:12.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:12.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:12.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:12.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:12.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:12.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:12.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:12.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:12.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:12.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:12.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:12.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:12.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:12.298+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:12.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:12.322+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:12.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:12.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:12.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:12.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:13.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:22:13.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:13.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:13.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:13.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:13.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:13.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:13.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.378+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:13.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:13.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:13.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:22:13.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:13.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:13.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:13.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:13.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:13.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:13.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:13.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:13.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:14.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:14.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:14.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:14.006+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:14.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:14.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:14.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:14.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:15.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:15.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:15.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:15.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:15.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:15.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:15.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:15.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:15.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:15.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:15.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:15.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:15.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:15.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:15.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:15.470+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:15.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:15.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:15.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:15.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:15.575 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:22:15.576 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:22:15.603 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:22:15.604 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:22:16.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:16.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:22:16.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:16.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:22:16.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:16.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:16.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:16.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:16.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:16.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:16.938 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3282223265 2023-10-14T00:22:16.941 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:22:16.942 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242936 2023-10-14T00:22:16.943 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:22:16.943 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3282223265 ]] 2023-10-14T00:22:16.943 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3282223265 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\2\8\2\2\2\3\2\6\5 ]] 2023-10-14T00:22:16.943 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:22:16.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:16.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:16.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:16.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:16.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:16.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:16.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:16.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:16.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:16.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:17.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:17.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:17.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:17.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:17.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:17.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:17.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:17.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:17.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:17.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:17.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:17.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:17.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.762+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:17.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:17.802 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:22:17.798+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:22:17.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:17.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:17.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:17.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:17.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:17.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:17.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.934+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:17.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:17.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:17.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:20.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:20.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:20.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:20.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:20.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:20.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:20.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:20.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:20.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:20.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:20.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:20.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:20.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:20.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:20.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:20.126+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:20.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:20.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:20.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:20.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:21.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:21.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:21.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:21.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:21.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:21.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:21.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:21.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:21.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:21.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:21.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:21.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:21.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:21.234+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:21.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:21.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:21.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:21.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:22.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:22.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:22.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:22.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:22.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:22.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:22.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:22.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:22.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:22.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:22.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:22.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:22.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:22.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:22.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:22.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:22.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:22.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:22.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:22.254+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:22.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:22.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:22.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:22.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:23.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:23.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:22:23.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:23.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:23.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:23.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:23.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:23.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:23.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:23.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:23.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:23.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:23.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:23.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:23.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:23.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:23.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:23.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:23.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:23.526+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:23.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:23.526+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:24.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:24.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:24.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:24.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:24.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:24.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:24.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:24.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:24.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:24.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:24.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:24.370+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:24.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:24.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:24.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:24.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:25.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:25.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:25.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:25.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:25.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:25.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:25.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:25.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:25.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:25.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:25.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:25.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:25.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:25.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:25.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:25.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:25.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:25.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:25.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:25.258+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:25.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:25.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:25.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:25.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:26.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:26.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:26.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:26.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:26.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:26.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:26.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:26.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.134+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:26.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:26.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.162+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:26.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:26.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:26.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:22:26.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:26.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:26.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:26.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:26.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:26.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:26.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:26.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.390+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:26.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:26.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:26.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:26.818 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:22:26.818+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:22:26.944 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:22:26.945 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:22:26.948 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:22:26.981 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:22:28.157 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:22:28.158+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:22:28.373 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3282223265 2023-10-14T00:22:28.374 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:22:28.374 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242948 2023-10-14T00:22:28.375 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:22:28.375 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3282223265 ]] 2023-10-14T00:22:28.375 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3282223265 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\2\8\2\2\2\3\2\6\5 ]] 2023-10-14T00:22:28.375 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:22:28.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:28.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:28.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:28.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:28.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:28.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:28.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:28.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:28.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.554+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:28.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:28.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:28.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:28.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:28.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:28.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:28.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:28.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.766+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:28.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:28.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:29.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:29.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:29.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:29.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:29.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:29.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:29.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:29.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:29.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:29.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:29.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:29.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:29.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:29.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:29.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:29.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:29.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:29.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:29.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:29.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:30.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:30.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:30.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:30.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:30.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:30.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.034+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:30.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:30.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:30.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:30.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:30.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:30.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:30.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:30.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:30.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:30.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.442+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:30.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:30.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:30.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:31.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:22:31.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:22:31.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:22:31.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:31.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:31.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:31.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:31.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:31.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:31.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.318+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:31.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:31.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.378+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:31.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:31.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:31.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:22:31.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:22:31.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:22:31.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:31.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:31.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:31.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:31.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:31.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:31.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:31.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:31.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.554+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:31.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.554+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:31.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:31.554+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:32.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:32.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:32.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:32.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:32.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:32.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:32.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:32.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:32.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:32.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:32.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:32.446+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:32.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:32.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:32.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:32.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:33.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:33.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:33.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:33.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:33.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:33.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:33.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:33.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:33.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:33.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:33.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:33.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:33.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:33.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:33.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:33.626+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:33.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:33.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:33.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:33.638+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:33.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:33.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:34.101 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:22:34.098+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:22:34.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:34.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:34.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:34.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:34.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:34.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:34.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:34.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:34.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:34.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:34.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:34.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:36.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:36.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:36.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:36.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:36.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:36.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:36.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:36.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:36.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:36.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:36.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:36.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:36.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:36.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:36.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:36.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:36.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:36.410+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:36.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:36.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:36.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:36.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:38.399 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:22:38.408 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:22:38.409 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:22:38.429 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:22:39.690 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3282223265 2023-10-14T00:22:39.691 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:22:39.692 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242959 2023-10-14T00:22:39.692 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:22:39.693 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3282223265 ]] 2023-10-14T00:22:39.693 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3282223265 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\2\8\2\2\2\3\2\6\5 ]] 2023-10-14T00:22:39.693 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:22:42.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:42.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:42.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:42.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:42.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:42.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:42.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:42.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:42.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:42.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:42.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:42.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:42.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:42.910+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:44.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:44.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:44.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:44.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:44.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:44.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:44.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:44.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:44.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:44.486+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:44.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:44.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:44.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:44.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:48.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:22:48.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:22:48.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:22:48.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:48.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:48.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:48.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:48.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:48.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:48.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:48.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:48.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:48.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.258+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:48.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:48.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:48.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:22:48.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:22:48.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:48.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:48.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:48.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:48.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:48.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:48.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:48.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.562+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:48.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:48.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.598+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:48.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:48.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:48.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:22:48.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:22:48.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:22:48.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:48.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:48.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:48.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:48.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:48.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:48.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:48.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:48.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:48.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.638+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:48.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:48.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:48.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:48.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:48.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:48.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:48.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:48.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:48.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:48.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:48.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:48.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:48.826+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:49.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:49.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:49.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:49.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:49.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:49.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:49.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:49.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:49.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:49.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:49.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:49.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:49.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:49.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:49.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:49.474+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:49.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:49.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:49.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:49.482+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:49.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:49.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:49.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:49.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:49.698 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:22:49.700 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:22:49.703 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:22:49.703 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:22:51.069 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3282223265 2023-10-14T00:22:51.070 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:22:51.071 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242971 2023-10-14T00:22:51.071 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:22:51.071 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3282223265 ]] 2023-10-14T00:22:51.071 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3282223265 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\2\8\2\2\2\3\2\6\5 ]] 2023-10-14T00:22:51.071 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:22:51.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:51.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:51.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:51.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:51.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:51.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:51.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:51.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:51.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:51.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:51.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:51.270+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:51.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:51.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:51.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:51.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:52.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:52.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:52.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:52.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:52.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:52.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:52.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:52.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:52.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:52.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:52.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:52.370+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:52.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:52.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:52.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:52.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:54.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:54.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:54.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:54.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:54.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.378+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:54.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:54.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:54.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:54.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:54.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:54.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:54.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:54.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:54.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:55.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:55.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:55.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:55.026+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:55.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:55.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:55.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:55.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:55.965 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:22:55.962+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:22:56.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:56.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:56.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:56.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:56.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:56.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:56.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:56.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:56.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:56.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:56.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:56.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:56.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:56.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:56.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:56.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:56.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:56.590+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:56.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:56.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:56.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:56.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:59.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:22:59.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:22:59.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:22:59.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:22:59.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:22:59.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:22:59.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:22:59.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:22:59.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:22:59.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.186+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:22:59.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:22:59.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:22:59.890 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:22:59.890+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:22:59.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:00.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:00.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:00.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:22:59.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:00.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:00.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:00.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:00.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:00.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.098+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:00.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:00.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:00.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:00.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:00.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:00.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:00.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:00.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:00.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:00.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.246+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:00.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.274+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:00.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.286+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:00.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:00.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:00.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:00.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:00.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:00.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:00.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:00.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:00.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:00.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:00.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:00.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:00.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.734+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:00.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:00.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:00.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:01.077 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:23:01.077 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:23:01.078 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:23:01.091 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:23:01.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:01.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:01.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:01.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:01.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:01.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:01.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:01.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:01.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:01.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:01.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:01.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:01.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:01.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:01.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:01.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:01.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:01.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:01.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:01.313+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:01.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:01.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:01.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:01.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:02.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:02.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:02.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:02.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:02.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:02.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:02.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:02.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.561+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:02.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:02.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:02.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:02.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:02.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:02.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:02.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:02.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:02.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:02.663 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3282223265 2023-10-14T00:23:02.663 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:23:02.664 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242982 2023-10-14T00:23:02.664 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:23:02.665 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3282223265 ]] 2023-10-14T00:23:02.665 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3282223265 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\2\8\2\2\2\3\2\6\5 ]] 2023-10-14T00:23:02.665 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:23:02.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:02.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:02.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:02.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.657+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:02.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:02.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:02.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:03.043 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:23:03.041+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:23:04.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:04.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:04.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:04.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:04.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:04.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:04.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:04.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:04.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:04.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:04.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:04.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:04.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:04.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:04.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:04.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:04.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:04.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:04.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:04.549+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:04.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:04.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:04.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:04.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:05.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:05.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:05.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:05.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:05.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:05.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:05.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:05.681+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:06.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:06.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:06.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:06.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:06.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:06.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:06.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:06.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:06.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:06.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:06.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:06.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:06.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:06.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:06.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:06.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:06.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:06.193+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:06.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:06.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:06.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:06.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:08.583 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:23:08.581+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:23:09.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:09.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:09.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:09.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.165+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:09.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:09.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.193+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:09.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:09.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:09.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:09.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:09.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:09.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:09.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:09.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:09.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:09.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:09.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:09.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:09.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.357+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:09.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:09.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:09.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:10.566 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:23:10.561+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:23:12.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:12.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:12.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:12.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:12.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:12.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:12.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:12.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:12.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:12.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:12.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:12.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:12.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:12.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:12.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:12.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:12.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:12.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:12.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:12.313+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:12.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:12.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:12.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:12.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:12.666 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:23:12.667 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:23:12.667 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:23:12.706 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:23:13.806 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/744012462 2023-10-14T00:23:13.809 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:23:13.810 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697242993 2023-10-14T00:23:13.810 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:23:13.810 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/744012462 ]] 2023-10-14T00:23:13.811 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/744012462 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\2\8\2\2\2\3\2\6\5 ]] 2023-10-14T00:23:13.811 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/744012462 2023-10-14T00:23:14.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:14.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:14.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:14.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:14.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:14.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:14.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:14.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:14.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:14.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:14.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:14.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:14.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.773+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:14.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:14.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:14.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:15.304 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:23:15.301+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:23:15.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:15.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:15.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:15.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:15.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:15.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:15.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:15.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:15.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:15.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:15.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:15.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:15.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.445+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:15.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:15.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.469+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:15.755 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/744012462 until 2023-10-14T01:23:15.065777+0000 (3600 sec) 2023-10-14T00:23:15.826 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:23:15.827 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/744012462 2023-10-14T00:23:15.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:15.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:16.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:16.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:16.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:16.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:16.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:16.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:16.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:16.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.089+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:16.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:16.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:16.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:16.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:16.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:16.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:16.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:17.037 INFO:tasks.workunit.client.0.smithi191.stderr:listed 22 entries 2023-10-14T00:23:17.085 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/744012462 2023-10-14T00:23:17.085 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:23:17.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:17.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:17.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:17.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:17.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:17.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:17.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:17.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:17.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:17.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.581+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:17.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:17.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:17.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:17.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:17.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:17.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:17.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:17.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:17.904 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:23:17.901+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:23:17.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.901+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:17.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:17.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:17.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:17.916 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:23:17.913+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:23:18.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:18.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:18.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:18.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:18.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:18.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:18.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:18.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:18.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:18.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:18.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.045+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:18.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:18.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:18.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:19.838 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:23:19.833+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:23:22.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:22.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:22.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:22.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:22.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:22.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:22.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:22.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:22.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:22.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:22.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:22.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:22.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:22.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:22.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:22.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:22.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:22.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:22.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:22.245+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:22.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:22.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:22.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:22.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:23.325 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:23:23.317+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:23:23.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:23.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:23.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:23.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:23.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:23.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:23.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:23.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.461+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:23.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:23.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.489+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:23.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:23.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:23.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:23.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:23.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:23.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:23.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:23.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:23.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:23.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:23.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:23.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:23.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.605+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:23.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:23.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:23.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:23.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:23.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:23.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.953+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:23.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:23.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:24.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:24.001+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:27.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:27.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:27.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:27.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:27.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:27.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:27.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:27.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:27.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:27.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.065+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:27.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:27.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:27.088 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:23:27.089 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:23:27.094 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:23:27.112 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:23:27.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:27.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:28.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:28.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:28.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:28.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:28.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:28.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:28.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:28.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:28.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:28.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:28.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:28.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:28.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:28.061+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:28.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:28.085+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:28.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:28.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:28.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:28.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:28.614 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/744012462 2023-10-14T00:23:28.614 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:23:28.620 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243008 2023-10-14T00:23:28.620 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:23:28.620 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/744012462 ]] 2023-10-14T00:23:28.621 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/744012462 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\7\4\4\0\1\2\4\6\2 ]] 2023-10-14T00:23:28.621 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:23:32.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:32.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:32.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:32.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:32.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:32.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:32.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:32.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:32.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:32.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:32.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:32.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.737+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:32.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:32.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:32.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:33.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:33.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:33.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:33.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:33.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.681+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:33.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:33.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.697+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:33.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:33.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:33.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:33.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:33.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:33.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:33.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:33.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:33.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:33.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:33.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:33.803 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:23:33.801+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:23:33.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.813+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:33.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:33.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:33.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:33.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:33.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:33.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:33.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:33.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:33.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:33.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:33.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:33.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:33.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.933+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:33.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:33.933+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:34.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:34.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:34.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:34.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:34.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:34.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:34.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:34.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:34.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:34.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.501+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:34.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:34.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:34.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:34.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:34.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:34.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:34.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:34.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.973+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:34.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:34.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:34.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:36.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:36.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:36.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:36.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:36.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:36.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:36.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:36.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:36.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:36.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:36.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:36.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.697+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:36.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:36.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:36.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:36.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:36.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:36.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:36.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:36.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:36.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:36.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:36.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.813+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:36.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:36.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:36.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:38.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:38.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:38.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:38.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:38.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:38.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:38.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:38.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:38.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:38.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:38.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:38.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:38.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:38.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:38.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:38.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:38.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:38.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:38.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:38.481+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:38.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:38.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:38.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:38.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:38.630 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:23:38.636 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:23:38.636 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:23:38.637 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:23:40.058 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/744012462 2023-10-14T00:23:40.059 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:23:40.059 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243020 2023-10-14T00:23:40.060 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:23:40.060 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/744012462 ]] 2023-10-14T00:23:40.060 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/744012462 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\7\4\4\0\1\2\4\6\2 ]] 2023-10-14T00:23:40.060 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:23:40.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:40.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:40.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:40.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:40.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:40.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:40.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.177+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:40.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:40.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:40.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:40.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:40.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:40.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:40.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:40.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:40.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:40.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:40.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:40.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:40.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:40.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:40.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.333+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:40.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:40.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:40.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:41.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:41.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:41.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:41.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:41.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:41.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:41.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:41.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:41.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:41.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:41.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:41.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:41.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:41.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:41.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:41.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:41.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:41.345+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:41.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:41.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:41.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:41.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:42.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:42.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:42.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:42.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:42.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:42.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:42.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:42.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:42.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:42.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:42.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.841+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:42.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.841+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:42.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:42.841+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:43.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:43.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:43.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:43.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:43.392 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:23:43.389+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:23:43.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:43.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:43.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:43.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:43.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.457+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:43.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:43.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:43.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:43.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:43.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:43.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:43.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:43.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:43.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:43.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:43.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:43.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.644+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:43.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:43.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:43.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:46.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:46.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:46.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:46.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:46.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:46.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:46.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:46.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:46.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:46.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:46.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:46.584+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:46.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:46.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:46.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:46.612+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:46.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:46.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:46.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:46.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:47.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:47.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:47.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:47.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:47.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:47.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:47.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:47.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:47.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:47.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:47.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:47.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:47.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:47.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:47.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:47.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:47.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:47.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:47.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:47.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:49.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:49.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:49.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:49.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:49.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:49.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:49.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:49.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:49.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:49.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:49.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:49.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:49.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:49.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:49.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:49.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:49.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:49.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:49.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:49.352+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:49.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:49.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:49.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:49.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:50.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:50.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:50.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:50.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:50.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:50.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:50.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:50.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:50.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:50.048+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:50.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:50.048+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:50.070 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:23:50.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:50.068+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:50.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:50.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:50.077 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:23:50.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:50.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:50.093 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:23:50.100 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:23:51.067 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:23:51.064+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:23:51.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:51.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:51.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:51.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:51.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:51.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:51.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:51.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:51.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:51.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.400+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:51.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:51.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:51.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:51.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:51.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:51.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:51.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:51.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:51.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:51.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:51.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:51.612+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:51.637 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/744012462 2023-10-14T00:23:51.644 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:23:51.651 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243031 2023-10-14T00:23:51.652 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:23:51.652 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/744012462 ]] 2023-10-14T00:23:51.652 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/744012462 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\7\4\4\0\1\2\4\6\2 ]] 2023-10-14T00:23:51.652 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:23:53.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:53.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:53.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:53.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:53.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:53.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:53.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:53.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:53.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:53.140+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:53.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:53.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:53.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:53.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:54.516 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:23:54.516+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:23:54.539 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:23:54.540+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:23:55.411 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:23:55.412+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:23:55.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:55.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:55.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:55.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:55.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:55.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:55.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:55.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:55.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:55.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:55.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:55.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:55.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:55.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:55.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:55.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:55.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:55.988+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:55.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:55.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:55.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:55.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:56.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:56.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:56.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:56.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:56.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:56.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:56.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:56.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:56.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:56.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:56.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:56.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:56.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.088+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:56.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.096+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:56.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.096+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:56.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:56.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:56.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:56.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:56.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:56.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:56.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:56.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:56.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.252+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:56.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:56.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:56.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:56.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:56.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:56.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:56.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:56.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:56.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.672+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:56.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:56.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:56.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:57.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:57.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:57.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:57.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:57.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:57.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:57.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:57.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:57.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:57.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:57.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:57.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:57.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:57.364+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:57.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:57.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:57.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:57.372+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:58.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:58.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:58.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:58.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:58.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:58.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:58.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:58.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:58.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:58.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:58.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:58.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:58.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.628+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:58.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:58.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:58.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:23:58.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:58.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:58.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:58.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:58.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:58.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:58.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:58.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:58.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:58.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:58.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:58.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.752+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:58.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:58.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:58.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:23:59.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:23:59.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:23:59.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:23:59.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:23:59.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:23:59.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:23:59.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:23:59.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:23:59.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:23:59.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:23:59.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:23:59.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.336+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:23:59.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:23:59.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:23:59.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:00.047 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.048+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.047 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.048+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.047 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.048+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.048 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.048+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75169280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.048 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.048+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.048 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.048+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.048 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.048+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.048 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.048+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75168e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.071 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.072+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.071 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.072+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.072 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.072+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a8480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.072 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.072+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a8080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.101 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.100+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.101 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.100+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a9f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.105 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.104+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.105 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.104+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a9280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.108 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.108+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.108 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.108+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75153380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.109 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.108+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.109 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.108+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75153200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.110 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.108+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.110 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.108+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a9400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.110 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.108+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.110 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.108+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a8000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.110 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.112+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.111 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.112+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da747cd880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.111 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.112+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.111 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.112+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da747cc100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.112 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.112+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.112 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.112+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75153480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.118 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.120+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.118 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.120+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.118 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.120+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.119 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.120+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.122 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.124+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.122 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.124+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476ba80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.129 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.128+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.129 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.128+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0b00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.148+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:00.148+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f1b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:00.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:00.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:00.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:00.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:00.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:00.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:00.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:00.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:00.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:00.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:00.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:00.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:00.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:00.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:00.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:00.264+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:00.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:00.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:00.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:00.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:00.265 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:00.264+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:24:01.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:01.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:01.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:01.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:01.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:01.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:01.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.264+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:01.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:01.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:01.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:01.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:01.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:01.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:01.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:01.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:01.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:01.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:01.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:01.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:01.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:01.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:01.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:01.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:01.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:01.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:01.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.484+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:01.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:01.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:01.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:01.669 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:24:01.675 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:24:01.682 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:24:01.685 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:24:03.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:03.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:03.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:03.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:03.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:03.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:03.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:03.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:03.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:03.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:03.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:03.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:03.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:03.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:03.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:03.232+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:03.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:03.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:03.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:03.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:03.319 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:03.316+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:24:03.421 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/744012462 2023-10-14T00:24:03.424 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:24:03.424 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243043 2023-10-14T00:24:03.425 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:24:03.425 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/744012462 ]] 2023-10-14T00:24:03.425 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/744012462 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\7\4\4\0\1\2\4\6\2 ]] 2023-10-14T00:24:03.425 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:24:04.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:04.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:04.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:04.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:04.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:04.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:04.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:04.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:04.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:04.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:04.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:04.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:04.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:04.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:04.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:04.196+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:04.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:04.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:04.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:04.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:04.629 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:24:04.628+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:24:05.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:05.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:05.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:05.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:05.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:05.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:05.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.732+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:05.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:05.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:05.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:05.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:05.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:05.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:05.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:05.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:05.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:05.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:07.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:07.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:07.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:07.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:07.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:07.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:07.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:07.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:07.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.084+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:07.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:07.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:07.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:07.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:07.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:07.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:07.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:07.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:07.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.496+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:07.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:07.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.504+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:07.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.504+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:07.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.504+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:07.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:07.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:07.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:07.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:07.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.908+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:07.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:07.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:07.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:08.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:08.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:08.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:08.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:08.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:08.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:08.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:08.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:08.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:08.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:08.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:08.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.260+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:08.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:08.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:08.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:08.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:08.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:08.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:08.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:08.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:08.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:08.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:08.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.440+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:08.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.440+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:08.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:08.440+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:09.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:09.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:09.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:09.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:09.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:09.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:09.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:09.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:09.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:09.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:09.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.272+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:09.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:09.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:09.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:09.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:09.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:09.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:09.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:09.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:09.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:09.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:09.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:09.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.900+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:09.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:09.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:09.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:09.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:09.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:09.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:09.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:09.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:10.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:10.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.024+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:10.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:10.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.072+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:10.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.072+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:10.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.072+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:10.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:10.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:10.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:10.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:10.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:10.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:10.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:10.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:10.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:10.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:10.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:10.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.748+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:10.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:10.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:10.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:11.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:11.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:11.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:11.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:11.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:11.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:11.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:11.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:11.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.496+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:11.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:11.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.500+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:11.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:11.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:11.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:13.438 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:24:13.439 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:24:13.441 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:24:13.447 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:24:13.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:13.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:13.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:13.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:13.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:13.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:13.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:13.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:13.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:13.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:13.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:13.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:13.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:13.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:13.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:13.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:13.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:13.852+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:13.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:13.888+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:13.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:13.888+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:14.299 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:14.300+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:24:14.777 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/744012462 2023-10-14T00:24:14.777 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:24:14.778 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243054 2023-10-14T00:24:14.778 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:24:14.778 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/744012462 ]] 2023-10-14T00:24:14.778 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/744012462 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\7\4\4\0\1\2\4\6\2 ]] 2023-10-14T00:24:14.779 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:24:15.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:15.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:15.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:15.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:15.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.252+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:15.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:15.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:15.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:15.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:15.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:15.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:15.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:15.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:15.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:15.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:15.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:15.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:15.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.804+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:15.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:15.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:15.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:16.005 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:16.008+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:24:18.002 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:18.004+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:24:18.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:18.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:18.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:18.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:18.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:18.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:18.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:18.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:18.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.836+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:18.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:18.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:18.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:18.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:18.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:18.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:18.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:18.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:18.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:18.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:18.961 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:18.960+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:24:19.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:19.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:19.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:19.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:19.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:19.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:19.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:19.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:19.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:19.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:19.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:19.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:19.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.580+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:19.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:19.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:19.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:19.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:19.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:19.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:19.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:19.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:19.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:19.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:19.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:19.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:19.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.840+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:19.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:19.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:19.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:21.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:21.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:21.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:21.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:21.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:21.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:21.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:21.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:21.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:21.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:21.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.532+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:21.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.556+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:21.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:21.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:21.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:22.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:22.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:22.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:22.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:22.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:22.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:22.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:22.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:22.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:22.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:22.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:22.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:22.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:22.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:22.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:22.456+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:22.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:22.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:22.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:22.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:22.806 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:22.804+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:24:23.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:23.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:23.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:23.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:23.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:23.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:23.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:23.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:23.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.372+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:23.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.376+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:23.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:23.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:23.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:23.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:23.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:23.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:23.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:23.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:23.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:23.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:23.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:23.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:23.520+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:24.788 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:24:24.798 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:24:24.810 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:24:24.810 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:24:25.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:25.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:25.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:25.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:25.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:25.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:25.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:25.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:25.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:25.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:25.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:25.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:25.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:25.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:25.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:25.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:25.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:25.884+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:25.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:25.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:26.200 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1467302996 2023-10-14T00:24:26.223 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:24:26.224 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243066 2023-10-14T00:24:26.225 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:24:26.225 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1467302996 ]] 2023-10-14T00:24:26.225 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1467302996 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\7\4\4\0\1\2\4\6\2 ]] 2023-10-14T00:24:26.225 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/1467302996 2023-10-14T00:24:26.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:26.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:26.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:26.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:26.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:26.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:26.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:26.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:26.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:26.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:26.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:26.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.616+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:26.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:26.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:26.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:26.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:26.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:26.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:26.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:26.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:26.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:26.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:26.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:26.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:26.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:26.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:26.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.895+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:26.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.895+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:26.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:26.895+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:27.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:27.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:27.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:27.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:27.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:27.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:27.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:27.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:27.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:27.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:27.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:27.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:27.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:27.787+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:27.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:27.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:27.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:27.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:27.899 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:27.899+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da74877e00 handle_get_snapshots: failed to get snapshots: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:27.902 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:27.903+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da747a1a40 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:27.904 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:27.903+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da74877680 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:27.920 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:27.919+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da74877d40 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:27.921 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:27.919+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da74877800 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:27.923 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:27.923+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da74876240 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:27.950 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:27.947+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da74876fc0 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:27.967 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:27.967+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da748763c0 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:28.012 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:28.011+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da74877380 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:28.034 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:28.031+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da748778c0 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:28.045 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:28.043+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da74877740 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:28.081 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:28.075+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da748772c0 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:28.089 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:28.083+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da745bf2c0 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:28.091 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:28.091+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da745be600 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:28.093 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:28.091+0000 7f3dc8f66640 -1 librbd::mirror::GetInfoRequest: 0x55da745be900 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:28.093 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:28.095+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da747a1ec0 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:28.095 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:24:28.095+0000 7f3dc575f640 -1 librbd::api::Mirror: image_info_list: failed to list mirror image statuses: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:24:28.780 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/1467302996 until 2023-10-14T01:24:28.012402+0000 (3600 sec) 2023-10-14T00:24:28.824 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:24:28.826 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/1467302996 2023-10-14T00:24:29.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:29.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:29.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:29.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:29.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:29.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:29.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:29.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:29.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:29.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.399+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:29.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:29.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:29.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:29.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:29.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:29.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:29.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:29.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:29.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:29.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:29.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:29.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:29.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:29.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:29.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:29.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:29.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:29.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.603+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:29.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.623+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:29.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:29.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:29.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:30.028 INFO:tasks.workunit.client.0.smithi191.stderr:listed 23 entries 2023-10-14T00:24:30.067 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/1467302996 2023-10-14T00:24:30.067 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:24:30.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:30.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:30.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:30.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:30.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:30.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:30.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:30.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.935+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:30.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:30.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.967+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:30.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:30.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:30.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:30.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:31.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:31.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:31.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:31.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:31.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:31.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:31.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:31.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:31.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:31.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:31.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:31.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.151+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:31.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:31.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:31.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:33.092 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:33.091+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:24:33.511 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:33.511+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:24:33.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:33.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:33.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:33.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:33.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:33.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:33.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:33.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:33.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.663+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:33.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:33.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:33.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:33.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:33.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:34.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:34.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:34.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:34.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:34.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:34.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:34.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:34.027+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:34.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:34.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:34.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:34.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:34.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:34.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:34.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:34.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:34.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:34.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:34.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:34.119+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:34.550 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:34.551+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:24:34.565 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:34.563+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:24:34.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:34.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:34.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:34.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:35.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:35.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:35.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:35.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:35.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:35.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:35.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:35.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:35.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.071+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:35.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:35.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:35.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:35.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:35.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:35.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:35.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:35.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:35.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:35.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:35.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:35.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:35.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.279+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:35.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:35.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:35.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:36.026 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:24:36.027+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T00:24:36.026 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:24:36.027+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:24:36.026 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:24:36.027+0000 7f30478aa640 -1 reset not still connected to 0x55c894ab09c0 2023-10-14T00:24:36.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:36.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:36.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:36.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:36.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:36.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:36.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:36.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:36.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:36.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.367+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:36.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:36.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:36.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:36.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:36.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:36.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:36.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:36.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:36.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:36.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:36.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:36.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:36.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:36.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.519+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:36.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:36.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:36.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:38.272 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:24:38.271+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:24:38.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:38.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:38.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:38.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:38.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:38.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:38.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:38.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:38.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:38.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:38.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:38.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:38.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:38.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:38.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:38.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:38.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:38.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:38.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:38.963+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:38.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:38.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:39.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:39.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:39.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:39.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:39.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:39.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:39.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:39.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:39.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:39.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:39.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:39.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:39.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:39.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:39.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:39.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:39.795 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:39.795+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:24:40.075 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:24:40.075 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:24:40.080 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:24:40.082 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:24:41.378 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/76236964 2023-10-14T00:24:41.379 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:24:41.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243081 2023-10-14T00:24:41.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:24:41.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/76236964 ]] 2023-10-14T00:24:41.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/76236964 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\6\7\3\0\2\9\9\6 ]] 2023-10-14T00:24:41.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/76236964 2023-10-14T00:24:43.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:43.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:43.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:43.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:43.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:43.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:43.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:43.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:43.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:43.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:43.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:43.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:43.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:43.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:43.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:43.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:43.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:43.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:43.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:43.259+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:43.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:43.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:43.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:43.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:43.833 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/76236964 until 2023-10-14T01:24:43.223854+0000 (3600 sec) 2023-10-14T00:24:43.894 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:24:43.896 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/76236964 2023-10-14T00:24:45.079 INFO:tasks.workunit.client.0.smithi191.stderr:listed 24 entries 2023-10-14T00:24:45.139 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/76236964 2023-10-14T00:24:45.139 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:24:45.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:45.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:45.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:45.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:45.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:45.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:45.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:45.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:45.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:45.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.303+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:45.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:45.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:45.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:45.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:45.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:45.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:45.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:45.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:45.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:45.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:45.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.427+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:45.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:45.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:45.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:45.563 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:24:45.563+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:24:48.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:48.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:48.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:48.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:48.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:48.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:48.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:48.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:48.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:48.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:48.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:48.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.107+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:48.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:48.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:48.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:48.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:48.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:48.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:48.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:48.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:48.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:48.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:48.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:48.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.235+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:48.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:48.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:48.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:48.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:48.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:48.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:48.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:48.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:48.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.763+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:48.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:48.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:48.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:49.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:49.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:49.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:49.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:49.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:49.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:49.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:49.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:49.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:49.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:49.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:49.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:49.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:49.607+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:49.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:49.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:49.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:49.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:50.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:50.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:50.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:50.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:50.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:50.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:50.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:50.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:50.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:50.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.327+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:50.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:50.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:50.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:50.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:50.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:50.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:50.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:50.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:50.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:50.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:50.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:50.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.575+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:50.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:50.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:50.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:51.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:51.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:51.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:51.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:51.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:51.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:51.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:51.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:51.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:51.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:51.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:51.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:51.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:51.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:51.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:51.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:51.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:51.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:51.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:51.355+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:51.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:51.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:51.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:51.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:52.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:52.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:53.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:53.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:53.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:53.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:53.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:53.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:53.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.067+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:53.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:53.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:53.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:53.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:53.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:53.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:53.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:53.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:53.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:53.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:53.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:53.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.323+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:53.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:53.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:54.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:54.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:54.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:54.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:54.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:54.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:54.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:54.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:54.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:54.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:54.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:54.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:54.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:54.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:54.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:54.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:54.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:54.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:54.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:54.707+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:54.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:54.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:54.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:54.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:55.142 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:24:55.149 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:24:55.158 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:24:55.166 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:24:55.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:24:55.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:55.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:55.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:55.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:55.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:55.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:55.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:55.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:55.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:55.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:55.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:55.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.671+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:55.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:55.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:55.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:56.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:56.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:56.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:56.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:56.671 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/76236964 2023-10-14T00:24:56.673 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:24:56.674 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243096 2023-10-14T00:24:56.674 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:24:56.674 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/76236964 ]] 2023-10-14T00:24:56.674 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/76236964 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\7\6\2\3\6\9\6\4 ]] 2023-10-14T00:24:56.675 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:24:56.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:56.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:56.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:56.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:56.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:56.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:56.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:56.687+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:56.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:56.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:56.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:56.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:57.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:57.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:57.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:57.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:57.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:57.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:57.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:57.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:57.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:57.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:57.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:57.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:57.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:57.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:57.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:57.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:57.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:57.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:57.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:57.983+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:57.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:57.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:57.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:57.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:58.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:58.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:58.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:58.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:58.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:58.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:58.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:58.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:58.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:58.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:58.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:58.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.747+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:58.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:58.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:24:58.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:24:58.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:24:58.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:24:58.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:24:58.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:24:58.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:24:58.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:24:58.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:24:58.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:24:58.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:58.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:24:59.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:59.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:24:59.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:59.019+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:24:59.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:59.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:24:59.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:24:59.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:00.014 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.011+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.014 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.011+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.015 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.011+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.015 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.011+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da74c74e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.015 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.011+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75148800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.015 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.015+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75169280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.054 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.055+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.055 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.055+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.055 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.055+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75148700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.055 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.055+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a8100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.055 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.055+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.056 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.055+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75153400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.056 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.055+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.056 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.055+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a9680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.057 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.055+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.057 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.055+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75152800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.057 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.055+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.057 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.055+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f1f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.071 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.071+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.071 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.071+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f1580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.072 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.071+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.072 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.071+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.090 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.087+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.090 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.087+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.090 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.087+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.090 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.087+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75153480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.091 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.087+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75073f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.091 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.087+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f1980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.130 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.131+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.130 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.131+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565c080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.131 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.131+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.131 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.131+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565c280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.131 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.131+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.132 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.131+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565c480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.132 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.131+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.132 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.131+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565ce80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.172 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.171+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.172 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.171+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565cd00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.176 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.175+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:00.176 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:25:00.175+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565cb00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:25:01.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:25:01.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:01.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:01.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:01.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:01.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:01.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:01.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:01.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:01.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:01.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:01.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.247+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:01.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:01.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:01.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:02.718 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:25:02.719+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:25:06.680 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:25:06.687 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:25:06.689 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:25:06.790 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:25:07.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:07.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:07.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:07.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:07.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:07.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:07.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:07.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:07.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:07.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:07.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.655+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:07.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:07.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:07.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:08.062 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/76236964 2023-10-14T00:25:08.067 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:25:08.070 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243108 2023-10-14T00:25:08.070 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:25:08.071 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/76236964 ]] 2023-10-14T00:25:08.071 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/76236964 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\7\6\2\3\6\9\6\4 ]] 2023-10-14T00:25:08.071 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:25:08.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:08.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:08.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:08.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:08.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:08.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:08.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:08.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:08.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:08.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:08.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:08.155+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:08.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:08.167+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:09.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:09.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:09.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:09.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:09.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:09.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:09.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:09.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:09.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.471+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:09.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:09.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:09.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:09.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:09.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:09.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:09.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:09.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:09.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.771+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:09.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.771+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:09.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:09.771+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:10.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:10.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:10.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:10.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:10.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:10.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:10.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:10.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:10.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:10.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:10.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:10.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:10.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:10.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:10.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:10.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:10.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:10.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:10.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:10.231+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:10.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:10.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:10.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:10.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:11.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:11.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:11.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:11.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:11.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:11.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:11.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:11.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:11.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:11.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:11.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:11.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:11.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:11.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:11.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:11.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:11.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:11.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:11.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:11.271+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:11.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:11.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:11.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:11.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:12.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:12.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:12.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:12.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:12.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:12.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:12.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:12.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:12.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:12.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:12.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:12.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:12.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:12.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:12.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:12.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:12.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:12.859+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:12.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:12.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:12.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:12.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:12.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:12.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:13.684 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:25:13.683+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:25:15.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:25:15.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:15.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:15.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:15.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:15.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:15.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:15.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:15.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:15.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:15.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.286+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:15.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:15.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:15.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:16.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:25:16.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:25:16.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:16.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:16.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:16.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:16.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:16.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:16.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:16.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:16.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.230+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:16.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:16.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:16.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:25:16.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:25:16.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:16.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:16.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:16.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:16.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:16.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:16.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:16.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:16.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:16.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:16.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.726+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:16.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:16.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:16.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:18.088 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:25:18.089 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:25:18.089 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:25:18.095 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:25:19.062 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:25:19.062+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:25:19.601 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/76236964 2023-10-14T00:25:19.601 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:25:19.622 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243119 2023-10-14T00:25:19.622 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:25:19.622 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/76236964 ]] 2023-10-14T00:25:19.623 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/76236964 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\7\6\2\3\6\9\6\4 ]] 2023-10-14T00:25:19.623 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:25:20.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:20.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:20.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:20.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:20.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:20.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:20.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:20.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:20.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:20.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.090+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:20.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:20.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:20.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:20.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:20.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:20.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:20.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:20.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:20.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.854+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:20.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.878+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:20.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.878+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:20.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:25:20.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:20.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:20.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:21.948 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:25:21.946+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:25:22.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:22.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:22.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:22.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:22.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:22.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:22.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:22.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:22.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:22.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:22.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:22.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:22.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:22.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:22.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:22.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:22.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:22.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:22.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:22.654+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:22.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:22.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:22.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:22.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:23.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:23.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:23.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:23.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:23.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:23.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:23.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:23.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:23.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:23.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:23.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:23.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:23.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:23.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:23.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:23.786+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:23.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:23.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:23.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:23.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:25.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:25.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:25.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:25.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:25.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:25.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:25.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:25.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:25:25.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:25:25.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:25.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:25.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:25.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:25.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:25.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:25.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:25.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:25.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:25.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:25.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:25.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:25.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:25.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:25.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:25.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:25.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.794+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:25.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.814+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:25.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:25.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:25.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:27.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:27.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:27.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:27.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:27.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:27.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:27.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:27.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:27.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.094+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:27.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:27.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:27.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:27.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:27.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:27.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:27.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:27.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:27.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:27.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:27.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:27.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.810+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:27.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:27.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:27.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:29.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:25:29.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:29.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:29.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:29.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:29.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:29.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:29.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:29.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:29.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:29.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:29.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.398+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:29.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:29.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:29.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:29.633 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:25:29.634 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:25:29.634 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:25:29.634 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:25:30.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:30.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:30.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:30.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:30.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:30.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:30.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:30.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:30.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:30.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:30.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:30.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:30.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:30.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:30.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:30.446+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:30.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:30.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:30.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:30.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:31.059 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/76236964 2023-10-14T00:25:31.060 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:25:31.060 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243131 2023-10-14T00:25:31.061 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:25:31.061 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/76236964 ]] 2023-10-14T00:25:31.061 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/76236964 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\7\6\2\3\6\9\6\4 ]] 2023-10-14T00:25:31.061 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:25:31.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:31.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:31.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:31.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:31.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:31.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:31.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:31.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:31.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:31.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.894+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:31.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:31.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:31.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:25:31.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:25:31.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:31.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:32.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:32.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:32.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:32.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:32.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:32.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:32.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:32.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:32.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.054+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:32.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:32.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:32.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:32.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:32.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:32.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:32.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:32.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:32.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:32.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:32.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:32.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.578+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:32.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:25:32.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:25:32.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:32.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:32.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:32.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:32.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:32.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:32.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:32.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:32.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:32.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:32.702+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:35.053 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:25:35.050+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:25:35.128 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:25:35.126+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:25:35.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:35.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:35.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:35.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:35.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:35.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:35.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:35.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:35.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:35.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:35.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:35.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:35.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:35.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:35.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:35.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:35.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:35.606+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:35.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:35.618+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:35.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:35.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:35.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:35.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:37.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:37.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:37.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:37.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:37.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:37.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:37.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:37.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:37.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:37.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:37.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:37.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:37.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:37.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:37.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:37.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:37.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:37.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:37.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:37.974+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:37.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:37.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:37.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:37.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:41.086 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:25:41.086 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:25:41.092 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:25:41.106 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:25:42.261 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/76236964 2023-10-14T00:25:42.262 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:25:42.263 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243142 2023-10-14T00:25:42.263 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:25:42.263 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/76236964 ]] 2023-10-14T00:25:42.264 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/76236964 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\7\6\2\3\6\9\6\4 ]] 2023-10-14T00:25:42.264 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:25:45.024 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:25:45.022+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:25:45.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:45.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:45.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:45.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:45.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:45.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:45.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:45.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:45.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:45.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:45.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.114+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:45.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:45.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:45.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:45.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:45.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:45.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:45.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:45.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:45.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:45.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:45.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:45.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.286+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:45.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:45.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:45.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:46.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:46.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:46.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:46.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:46.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:46.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:46.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:46.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:46.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:46.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:46.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:46.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:46.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:46.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:46.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:46.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:46.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:46.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:46.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:46.570+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:46.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:46.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:46.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:46.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:48.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:48.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:48.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:48.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:48.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:48.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:48.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:48.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:48.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.362+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:48.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:48.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:48.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:48.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:48.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:48.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:48.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:48.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:48.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:48.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.726+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:48.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:48.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:48.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:49.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:25:49.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:25:49.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:49.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:49.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:49.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:49.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:49.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:49.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:49.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:49.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:49.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:49.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.790+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:49.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:49.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:49.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:50.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:25:50.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:50.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:50.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:50.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:50.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:50.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:50.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:50.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:50.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:50.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.714+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:50.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:50.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:50.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:51.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:51.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:51.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:51.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:51.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:51.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:51.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:51.474+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:51.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:51.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:51.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:51.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:25:51.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:51.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:52.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:51.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:52.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:51.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:52.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:52.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:52.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:52.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:52.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:52.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:52.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.050+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:52.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:52.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:52.275 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:25:52.275 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:25:52.280 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:25:52.288 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:25:52.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:52.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:52.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:52.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:52.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:52.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:52.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:52.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:52.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:52.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:52.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.994+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:52.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:52.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:52.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:53.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:53.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:53.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:53.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:53.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:53.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:53.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:53.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:53.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:53.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.394+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:53.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:53.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:53.496 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1363504459 2023-10-14T00:25:53.497 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:25:53.498 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243153 2023-10-14T00:25:53.498 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:25:53.498 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1363504459 ]] 2023-10-14T00:25:53.498 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1363504459 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\7\6\2\3\6\9\6\4 ]] 2023-10-14T00:25:53.498 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/1363504459 2023-10-14T00:25:53.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:25:53.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:53.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:53.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:53.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:53.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:53.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:53.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:53.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:53.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:53.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.970+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:53.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:54.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:25:54.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:53.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:25:54.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:54.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:54.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:54.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:54.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:54.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:54.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:54.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:54.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:54.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:54.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:54.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:54.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:54.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:54.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:54.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:54.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:54.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:54.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:54.082+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:54.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:54.082+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:55.840 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/1363504459 until 2023-10-14T01:25:55.126915+0000 (3600 sec) 2023-10-14T00:25:55.880 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:25:55.881 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/1363504459 2023-10-14T00:25:56.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:56.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:56.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:56.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:56.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:56.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:25:56.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:56.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.882+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:56.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.882+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:56.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:56.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:56.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:56.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.926+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:56.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:56.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:56.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:56.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:57.052 INFO:tasks.workunit.client.0.smithi191.stderr:listed 25 entries 2023-10-14T00:25:57.104 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/1363504459 2023-10-14T00:25:57.104 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:25:58.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:58.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:58.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:58.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:58.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:58.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:58.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:58.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:58.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:58.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:58.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:58.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:58.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:58.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:58.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:58.914+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:25:58.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:58.918+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:25:58.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:58.918+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:25:59.309 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:25:59.306+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:25:59.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:59.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:25:59.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:59.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:25:59.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:59.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:25:59.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:59.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:25:59.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:59.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:25:59.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:59.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:25:59.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:59.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:25:59.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:59.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:25:59.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:59.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:25:59.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:59.478+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:00.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:59.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:00.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:25:59.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:00.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:00.018 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.018+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.019 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.018+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75168380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.034 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.034+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.035 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.034+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.035 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.034+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.035 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.034+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75153e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.035 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.034+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75153580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.035 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.034+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75152280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:00.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.050+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:00.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:00.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:00.063 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.062+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.063 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.062+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.063 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.062+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75149980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.064 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.062+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f1b00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.098 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.090+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.099 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.090+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.099 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.090+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.099 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.090+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f1500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:26:00.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:00.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:00.125 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.122+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.125 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.122+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a9600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.155 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.154+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.155 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.154+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.156 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.154+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476b000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.156 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.154+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751adc80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.165 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.162+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.165 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.162+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.166 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.166+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.166 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.166+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.166 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.166+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565c700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.167 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.166+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565c880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.168 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.166+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.168 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.166+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a9080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:00.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:00.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:00.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:00.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:00.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:00.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:00.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:00.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.210+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:00.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:00.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:00.213 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.210+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.214 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.210+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.214 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.210+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565ca00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.214 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.210+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565d100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.229 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.222+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.229 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.222+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565d300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.229 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.226+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.229 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.226+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565dd00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.229 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.226+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.230 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:00.226+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565db80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:00.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:00.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:00.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:00.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:00.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:00.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:00.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:00.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:00.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:00.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.462+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:00.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:00.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:00.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:01.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:01.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:01.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:01.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:01.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:01.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:01.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:01.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:01.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:01.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.386+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:01.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:01.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:01.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:01.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:01.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.566+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:01.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.578+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:01.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:01.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:01.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:26:01.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:01.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:01.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:01.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:01.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:01.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:01.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.738+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:01.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:01.738+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:02.382 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:26:02.382+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:26:03.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:03.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:03.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:03.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:03.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:03.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:03.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:03.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:03.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.278+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:03.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:03.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:03.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:03.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:03.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:03.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:03.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:03.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:03.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:03.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:03.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:03.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.594+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:03.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.594+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:03.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.594+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:03.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:26:03.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:03.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:03.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:03.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:03.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:03.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:03.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:03.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:03.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:03.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:03.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.894+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:03.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:03.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:03.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:04.873 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:26:04.869+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:26:06.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:06.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:06.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:06.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:06.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:06.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:06.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:06.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:06.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:06.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:06.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:06.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:06.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:06.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:06.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:06.377+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:06.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:06.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:06.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:06.393+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:06.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:06.393+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:06.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:06.393+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:07.106 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:26:07.106 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:26:07.106 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:26:07.129 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:26:08.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:08.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:08.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:08.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:08.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:08.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:08.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:08.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:08.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:08.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:08.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:08.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:08.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:08.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:08.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:08.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:08.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:08.365+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:08.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:08.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:08.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:08.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:08.580 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1363504459 2023-10-14T00:26:08.581 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:26:08.582 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243168 2023-10-14T00:26:08.582 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:26:08.582 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1363504459 ]] 2023-10-14T00:26:08.582 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1363504459 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\3\6\3\5\0\4\4\5\9 ]] 2023-10-14T00:26:08.582 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:26:08.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:08.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:09.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:09.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:09.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:09.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:09.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:09.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:09.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:09.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:09.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:09.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:09.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:09.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:09.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:09.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:09.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:09.029+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:09.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:09.037+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:09.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:09.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:09.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:09.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:09.096 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:26:09.093+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:26:09.154 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:26:09.153+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:26:10.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:10.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:10.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:10.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:10.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:10.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:10.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:10.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:10.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:10.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.713+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:10.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:10.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:10.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:26:10.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:26:10.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:10.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:10.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:10.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:10.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:10.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:10.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:10.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:10.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:10.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:10.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.901+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:10.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.917+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:10.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:10.917+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:11.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:11.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:11.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:11.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:11.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:11.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:11.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:11.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:11.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:11.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:11.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:11.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:11.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:11.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:11.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:11.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:11.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:11.873+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:11.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:11.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:11.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:11.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:13.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:13.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:13.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:13.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:13.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:13.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:13.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:13.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:13.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:13.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:13.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:13.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:13.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:13.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:13.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:13.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:13.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:13.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:13.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:13.345+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:13.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:13.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:13.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:13.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:13.536 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:26:13.533+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:26:16.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:16.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:16.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:16.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:16.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:16.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:16.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.253+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:16.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:16.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:16.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:16.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:16.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:16.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:16.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.985+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:16.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.989+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:16.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:16.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:16.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:17.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:17.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:17.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:17.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:17.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:17.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:17.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:17.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:17.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.377+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:17.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.377+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:17.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.377+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:17.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:17.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:17.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:17.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:17.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:17.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:17.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:17.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.929+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:17.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:17.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:17.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:26:17.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:17.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:18.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:18.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:18.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:18.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:18.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:18.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:18.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:18.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:18.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:18.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:18.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:18.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:18.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:18.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:18.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:18.045+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:18.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:18.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:18.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:18.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:18.607 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:26:18.611 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:26:18.614 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:26:18.624 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:26:19.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:26:19.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:19.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:19.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:19.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:19.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:19.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:19.564 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:26:19.557+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:26:19.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:19.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:19.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:19.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:19.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.629+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:19.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:19.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:19.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:19.908 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1363504459 2023-10-14T00:26:19.908 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:26:19.909 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243179 2023-10-14T00:26:19.909 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:26:19.909 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1363504459 ]] 2023-10-14T00:26:19.910 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1363504459 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\3\6\3\5\0\4\4\5\9 ]] 2023-10-14T00:26:19.910 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:26:21.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:21.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:21.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:21.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:21.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:21.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:21.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:21.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:21.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:21.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.373+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:21.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:21.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:21.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:21.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:21.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:21.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:21.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:21.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:21.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.809+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:21.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.821+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:21.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.829+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:21.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:21.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:21.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:21.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:21.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:21.841+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:22.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:22.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:22.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:22.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:22.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:22.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:22.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:22.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:22.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:22.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:22.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.253+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:22.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:22.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:22.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:22.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:22.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:22.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:22.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:22.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:22.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:22.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.977+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:23.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:22.997+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:23.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:23.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:23.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:23.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:23.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:23.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:23.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:23.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:23.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:23.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.393+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:23.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.401+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:23.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:23.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:23.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:23.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:23.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:23.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:23.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:23.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:23.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:23.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.917+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:23.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.933+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:23.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:23.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:23.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:25.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:25.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:25.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:25.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:25.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:25.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:25.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:25.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:25.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:25.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:25.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:25.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:25.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:25.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:25.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:25.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:25.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:25.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:25.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:25.149+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:25.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:25.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:25.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:25.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:27.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:27.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:27.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:27.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:27.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:27.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:27.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:27.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:27.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:27.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:27.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:27.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:27.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:27.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:27.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:27.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:27.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:27.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:27.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:27.241+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:27.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:27.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:28.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:28.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:28.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:28.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:28.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:28.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:28.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:28.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:28.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:28.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:28.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:28.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:28.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:28.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:28.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:28.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:28.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:28.329+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:28.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:28.349+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:28.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:28.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:28.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:28.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:29.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:26:29.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:29.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:29.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:29.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:29.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:29.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:29.911 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:26:29.911 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:26:29.914 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:26:29.916 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:26:29.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:29.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:29.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:29.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.969+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:29.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.977+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:29.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:29.977+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:31.537 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1363504459 2023-10-14T00:26:31.537 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:26:31.538 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243191 2023-10-14T00:26:31.538 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:26:31.538 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1363504459 ]] 2023-10-14T00:26:31.539 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1363504459 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\3\6\3\5\0\4\4\5\9 ]] 2023-10-14T00:26:31.539 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:26:31.761 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:26:31.757+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:26:32.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:32.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:32.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:32.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:32.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:32.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:32.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:32.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.397+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:32.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.397+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:32.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.397+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:32.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.397+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:32.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.397+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:32.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:32.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:32.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:32.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:32.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:32.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.889+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:32.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.917+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:32.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.929+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:32.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:32.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:32.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:34.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:34.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:34.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:34.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:34.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:34.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:34.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:34.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:34.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.545+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:34.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:34.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:34.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:34.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:34.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:34.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:34.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:34.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:34.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:34.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:34.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:34.773+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:36.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:36.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:36.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:36.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:36.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:36.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:36.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:36.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:36.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:36.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:36.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:36.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:36.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:36.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:36.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:36.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:36.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:36.253+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:36.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:36.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:36.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:36.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:36.544 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:26:36.541+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:26:38.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:38.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:38.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:38.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:38.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.305+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:38.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:38.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:38.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:38.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:38.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:38.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:38.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:38.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:38.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:38.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:38.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.485+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:38.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:38.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:38.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:38.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:38.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:38.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:38.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:38.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:38.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:38.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:39.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.997+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:39.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:39.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:38.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:39.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:39.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:39.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:39.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:39.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:39.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:39.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:39.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:39.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:39.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:39.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:39.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:39.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:39.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:39.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:39.417+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:40.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:40.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:40.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:40.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:40.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:40.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:40.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:40.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:40.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:40.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:40.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:40.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:40.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:40.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:40.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:40.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:40.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:40.881+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:40.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:40.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:40.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:40.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:41.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:41.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:41.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:41.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:41.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:41.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:41.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:41.165+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:41.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:41.173+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:41.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:41.185+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:41.542 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:26:41.543 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:26:41.544 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:26:41.547 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:26:42.933 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1363504459 2023-10-14T00:26:42.935 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:26:42.936 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243202 2023-10-14T00:26:42.936 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:26:42.937 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1363504459 ]] 2023-10-14T00:26:42.937 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1363504459 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\3\6\3\5\0\4\4\5\9 ]] 2023-10-14T00:26:42.937 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:26:42.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:42.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:26:43.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:43.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:43.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:43.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:43.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:43.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:43.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:43.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:43.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:43.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:43.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.081+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:43.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:43.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:43.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:44.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:44.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:44.791 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:26:44.789+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:26:44.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:44.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:44.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:44.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:44.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:44.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:44.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:44.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:44.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.829+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:44.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:44.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:44.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:45.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:45.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:45.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:45.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:45.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:45.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:45.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:45.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:45.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:45.757+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:45.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:45.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:45.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:45.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:46.867 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:26:46.865+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:26:47.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:47.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:47.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:47.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:47.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:47.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:47.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:47.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:47.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:47.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:47.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:47.405+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:47.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:47.405+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:47.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:47.421+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:47.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:47.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:47.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:47.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:48.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:48.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:48.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:48.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:48.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:48.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:48.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:48.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:48.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:48.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:48.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:48.357+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:48.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:48.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:48.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:48.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:51.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:51.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:51.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:51.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:51.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:51.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:51.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:51.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:51.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:51.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:51.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:51.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:51.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:51.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:51.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:51.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:51.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:51.301+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:51.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:51.301+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:51.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:51.301+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:52.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:52.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:52.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:52.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:52.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:52.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:52.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:52.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:52.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:52.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:52.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:52.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:52.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:52.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:52.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:52.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:52.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:52.161+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:52.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:52.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:52.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:52.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:52.941 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:26:52.943 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:26:52.953 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:26:52.958 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:26:53.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:53.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:53.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:53.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:53.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:53.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:53.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:53.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:53.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:53.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:53.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:53.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:53.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:53.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:53.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:53.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:53.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:53.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:53.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:53.373+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:53.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:53.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:53.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:53.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:54.205 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3080644989 2023-10-14T00:26:54.206 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:26:54.207 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243214 2023-10-14T00:26:54.207 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:26:54.207 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3080644989 ]] 2023-10-14T00:26:54.207 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3080644989 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\3\6\3\5\0\4\4\5\9 ]] 2023-10-14T00:26:54.208 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/3080644989 2023-10-14T00:26:54.872 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:54.869+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da7504e900 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:54.890 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:54.889+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da7504ed80 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:54.911 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:54.909+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da7504f2c0 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:54.938 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:54.937+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da73f0a480 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:54.976 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:54.973+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da73f0b500 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:55.006 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:55.005+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da73f0af00 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:55.013 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:55.009+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da73f11b00 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:55.014 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:55.009+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da73f11200 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:55.014 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:55.013+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da745bf500 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:55.026 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:55.025+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da745be540 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:55.030 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:55.029+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da745bf740 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:55.032 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:55.029+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da745bf8c0 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:55.033 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:55.029+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da745beb40 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:55.033 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:55.029+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da745bf980 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:55.033 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:26:55.029+0000 7f3dc575f640 -1 librbd::api::Mirror: image_info_list: failed to list mirror image statuses: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:26:55.856 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/3080644989 until 2023-10-14T01:26:55.185279+0000 (3600 sec) 2023-10-14T00:26:55.940 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:26:55.948 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/3080644989 2023-10-14T00:26:56.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:26:56.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:26:56.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:26:56.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:26:56.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:26:56.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:26:56.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:26:56.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:26:56.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:26:56.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:26:56.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:26:56.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.241+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:26:56.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:26:56.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:26:56.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:26:57.113 INFO:tasks.workunit.client.0.smithi191.stderr:listed 26 entries 2023-10-14T00:26:57.183 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/3080644989 2023-10-14T00:26:57.183 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:27:00.104 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:27:00.100+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:27:00.116 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:27:00.112+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:27:02.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:27:02.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:02.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:02.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:02.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:02.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:02.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:02.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:02.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:02.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:02.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:02.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.168+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:02.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:02.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:02.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:27:02.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:27:02.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:02.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:02.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:02.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:02.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:02.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:02.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:02.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:02.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:02.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.236+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:02.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:02.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:02.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:02.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:02.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:02.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:02.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:02.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:02.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:02.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:02.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:02.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.912+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:02.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:02.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:02.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:03.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:03.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:03.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:03.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:03.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:03.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:03.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:03.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:03.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:03.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:03.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.240+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:03.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:03.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:03.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:03.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:03.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:03.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:03.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:03.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:03.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:03.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:03.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.936+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:03.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:03.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:03.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:03.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:04.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:04.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:04.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:04.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:04.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:04.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:04.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:04.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:04.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.124+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:04.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:04.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:04.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:27:04.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:04.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:04.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:04.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:04.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:04.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:04.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:04.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:04.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:04.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.752+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:04.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:04.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:04.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:05.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:05.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:05.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:05.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:05.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:05.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:05.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:05.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:05.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:05.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:05.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:05.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:05.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:05.268+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:05.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:05.272+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:05.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:05.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:05.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:05.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:06.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:06.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558895e9b930 2023-10-14T00:27:07.185 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:27:07.186 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:27:07.192 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:27:07.203 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:27:08.113 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1404028810 2023-10-14T00:27:08.113 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:27:08.120 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243228 2023-10-14T00:27:08.120 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:27:08.120 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1404028810 ]] 2023-10-14T00:27:08.120 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1404028810 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\0\8\0\6\4\4\9\8\9 ]] 2023-10-14T00:27:08.121 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/1404028810 2023-10-14T00:27:08.879 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:08.876+0000 7f3dc8f66640 -1 librbd::ImageWatcher: 0x55da74ac8c00 image watch failed: 94396749572096, (107) Transport endpoint is not connected 2023-10-14T00:27:08.880 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:08.876+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da74ac8c00 handle_error: handle=94396749572096: (107) Transport endpoint is not connected 2023-10-14T00:27:08.880 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:08.876+0000 7f3dc8f66640 -1 librbd::ImageWatcher: 0x55da74ac9b00 image watch failed: 94396761541632, (107) Transport endpoint is not connected 2023-10-14T00:27:08.880 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:08.876+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da74ac9b00 handle_error: handle=94396761541632: (107) Transport endpoint is not connected 2023-10-14T00:27:08.910 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:08.908+0000 7f3dc8f66640 -1 librbd::ImageWatcher: 0x55da74ac9200 image watch failed: 94396761539584, (107) Transport endpoint is not connected 2023-10-14T00:27:08.910 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:08.908+0000 7f3dc8f66640 -1 librbd::Watcher: 0x55da74ac9200 handle_error: handle=94396761539584: (107) Transport endpoint is not connected 2023-10-14T00:27:08.964 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:08.960+0000 7f3dc8765640 -1 librbd::watcher::RewatchRequest: 0x55da74a42ff0 handle_unwatch client blocklisted 2023-10-14T00:27:08.964 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:08.960+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da74ac8c00 handle_rewatch: client blocklisted 2023-10-14T00:27:09.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:27:09.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:09.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:09.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:09.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:09.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:09.824 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/1404028810 until 2023-10-14T01:27:09.037669+0000 (3600 sec) 2023-10-14T00:27:09.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:09.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:09.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:09.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:09.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:09.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:09.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:09.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:09.861 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:27:09.861 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/1404028810 2023-10-14T00:27:09.872 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:09.868+0000 7f3dc8765640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:27:09.876 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:09.868+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da75368a90 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:27:09.876 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:09.868+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da7566f1e0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:27:09.895 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:09.892+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:27:09.895 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:09.892+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da7566e840 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:27:09.895 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:09.892+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da75594b40 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:27:09.990 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:27:09.988+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74966fc0 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:27:10.555 INFO:tasks.workunit.client.0.smithi191.stderr:listed 27 entries 2023-10-14T00:27:10.586 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/1404028810 2023-10-14T00:27:10.586 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:27:13.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:13.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:13.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:13.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:13.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:13.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:13.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:13.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:13.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:13.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:13.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:13.284+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:13.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:13.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:13.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:13.332+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:13.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:13.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:13.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:13.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:14.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:14.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:14.057 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:27:14.056+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:27:14.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:14.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:14.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:14.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:14.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.080+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:14.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:14.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.132+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:14.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:14.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:14.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:14.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:14.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:14.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:14.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:15.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:15.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:15.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.008+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:15.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:15.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:15.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:15.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:15.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:15.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:15.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:15.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:15.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.476+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:15.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:15.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:15.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:16.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:16.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:16.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:16.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:16.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:16.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:16.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:16.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:16.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:16.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:16.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:16.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:16.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:16.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:16.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:16.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:16.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:16.528+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:16.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:16.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:16.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:16.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:17.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:17.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:17.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:17.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:17.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:17.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:17.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:17.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:17.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:17.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:17.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:17.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:17.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:17.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:17.136+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:17.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:17.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:17.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:17.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:19.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:27:19.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:19.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:19.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:19.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:19.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:19.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:19.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:19.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.348+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:19.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:19.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:19.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:19.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:19.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:19.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:19.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:19.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:19.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:19.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:19.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.896+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:19.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:19.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.944+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:19.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:19.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:19.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:20.592 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:27:20.593 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:27:20.595 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:27:20.614 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:27:21.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:21.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:21.792 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1404028810 2023-10-14T00:27:21.792 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:27:21.793 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243241 2023-10-14T00:27:21.793 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:27:21.793 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1404028810 ]] 2023-10-14T00:27:21.793 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1404028810 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\0\4\0\2\8\8\1\0 ]] 2023-10-14T00:27:21.794 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:27:21.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:21.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:21.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:21.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:21.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:21.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:21.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:21.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:21.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:21.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:21.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:21.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:21.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:21.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:21.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:21.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:21.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:21.892+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:21.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:21.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:21.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:21.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:23.045 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:27:23.044+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:27:24.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:24.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:24.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:24.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:24.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:24.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:24.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:24.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:24.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:24.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:25.025 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:27:25.024+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:27:25.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:25.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:25.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:25.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.132+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:25.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:25.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:25.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:25.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:25.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:25.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:25.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:25.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:25.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:25.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:25.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.812+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:25.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:25.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.820+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:25.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:25.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:25.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:26.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:26.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:26.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:26.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:26.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:26.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:26.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:26.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:26.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:26.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:26.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:26.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:26.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:26.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:26.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:26.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:26.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:26.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:26.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:26.884+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:26.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:26.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:26.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:26.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:27.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:27.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:27.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:27.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:27.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:27.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:27.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:27.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:27.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:27.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:27.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:27.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:27.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:27.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:27.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:27.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:27.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:27.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:27.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:27.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:27.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:27.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:28.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:28.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:28.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:28.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:28.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:28.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:29.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:27:29.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:29.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:29.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:29.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:29.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:29.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:29.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:29.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:29.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:29.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:29.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.444+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:29.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:29.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:29.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:30.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:27:30.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:30.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:30.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:30.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:30.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:30.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:30.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:30.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:30.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:30.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.616+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:30.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:30.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:30.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:31.796 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:27:31.798 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:27:31.801 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:27:31.802 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:27:32.880 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:27:32.880+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:27:33.039 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1404028810 2023-10-14T00:27:33.039 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:27:33.040 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243253 2023-10-14T00:27:33.040 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:27:33.041 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1404028810 ]] 2023-10-14T00:27:33.041 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1404028810 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\0\4\0\2\8\8\1\0 ]] 2023-10-14T00:27:33.041 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:27:39.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:27:39.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:39.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:39.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:39.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:39.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:39.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:39.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:39.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:39.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:39.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.608+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:39.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:39.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:39.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:40.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:40.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:40.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:40.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:40.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:40.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:40.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:40.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:40.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:40.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:40.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:40.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:40.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:40.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:40.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:40.108+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:40.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:40.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:40.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:40.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:43.050 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:27:43.050 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:27:43.052 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:27:43.052 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:27:43.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:43.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:43.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:43.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:43.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:43.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:43.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:43.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.188+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:43.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:43.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:43.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:43.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:43.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:43.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:43.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:43.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.628+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:43.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:43.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:43.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:44.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:44.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:44.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:44.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:44.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:44.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:44.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:44.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:44.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:44.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:44.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:44.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:44.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:44.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:44.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:44.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:44.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:44.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:44.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:44.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:44.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:44.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:44.335 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1404028810 2023-10-14T00:27:44.342 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:27:44.343 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243264 2023-10-14T00:27:44.343 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:27:44.343 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1404028810 ]] 2023-10-14T00:27:44.343 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1404028810 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\0\4\0\2\8\8\1\0 ]] 2023-10-14T00:27:44.344 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:27:45.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:27:45.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:45.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:45.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:45.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:45.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:45.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:45.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:45.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:45.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:45.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.116+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:45.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:45.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:45.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:45.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:45.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:45.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:45.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:45.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:45.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:45.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:45.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:45.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.672+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:45.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:45.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:45.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:45.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:45.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:45.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:45.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:45.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:46.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:46.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:47.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:47.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:47.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:47.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:47.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:47.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:47.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.080+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:47.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.084+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:47.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:47.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:47.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:27:47.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:27:47.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:47.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:47.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:47.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:47.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:47.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:47.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:47.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:47.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:47.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.200+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:47.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:47.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.208+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:47.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:47.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:47.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:47.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:47.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:47.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:47.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:47.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:47.784+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:48.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:48.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:48.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:48.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:48.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:48.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:48.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:48.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:48.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:48.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:48.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:48.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:48.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:27:48.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:48.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:48.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:48.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:49.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:48.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:49.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:49.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:49.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:49.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:49.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:49.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:49.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:49.052+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:49.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:49.052+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:49.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:49.052+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:49.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:49.052+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:49.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:49.052+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:50.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:50.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:50.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:50.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:50.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:50.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:50.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:50.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:50.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:50.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:50.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:50.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:50.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:50.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:50.600 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:27:50.600+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:27:51.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:51.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:51.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:51.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:51.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:51.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:51.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:51.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:51.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:51.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:51.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:51.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:51.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:51.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:51.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:51.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:51.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:51.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:51.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:51.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:51.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:51.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:51.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:51.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:51.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:51.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.552+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:51.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.560+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:51.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.560+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:51.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:51.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:51.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:51.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:51.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:51.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:51.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:51.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:52.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:52.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:52.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:52.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:52.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:52.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:52.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:52.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:52.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:52.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:52.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:52.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:52.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:52.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:52.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:52.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:52.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:52.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:52.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:52.900+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:52.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:52.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:53.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:53.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:53.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:53.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:53.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:53.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.276+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:53.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.276+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:53.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.276+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:53.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:53.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:53.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:53.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:53.373 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:27:53.372+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:27:53.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:53.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:53.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:53.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:53.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.420+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:53.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:53.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:53.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:53.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:53.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:53.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:53.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:53.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:53.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:53.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:53.872+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:54.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:54.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:54.350 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:27:54.351 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:27:54.353 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:27:54.377 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:27:54.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:54.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:54.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:54.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:54.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:54.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:54.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.460+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:54.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.460+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:54.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.460+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:54.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.460+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:54.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.460+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:54.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:54.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:54.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:54.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:54.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:54.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:54.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:54.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:54.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:54.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:54.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.936+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:54.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:54.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:54.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:27:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:27:54.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:54.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:55.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:55.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:54.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:55.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:55.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:55.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:55.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:55.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:55.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:55.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:55.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:55.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:55.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:55.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:55.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:55.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:55.084+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:55.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:55.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:55.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:55.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:55.295 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:27:55.296+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:27:55.482 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1404028810 2023-10-14T00:27:55.482 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:27:55.483 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243275 2023-10-14T00:27:55.483 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:27:55.484 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1404028810 ]] 2023-10-14T00:27:55.484 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1404028810 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\0\4\0\2\8\8\1\0 ]] 2023-10-14T00:27:55.484 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:27:56.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:56.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:56.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:56.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:56.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:56.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.112+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:56.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.112+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:56.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.112+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:56.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.112+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:56.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:27:56.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:56.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:56.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:56.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:56.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:56.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:56.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:56.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:56.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:56.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:56.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.524+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:56.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:56.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:56.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:27:56.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:56.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:56.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:56.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:56.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:56.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:56.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:56.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:56.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:56.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:56.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.624+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:56.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:56.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:56.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:57.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:57.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:57.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:57.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:57.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:57.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:57.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:57.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:57.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:57.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:57.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:57.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:57.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:57.212+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:57.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:57.212+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:57.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:57.212+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:58.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:58.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:58.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:58.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:58.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:58.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:58.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:58.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:58.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:58.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:58.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:58.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:58.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:58.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:58.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:58.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:58.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:58.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:58.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:58.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:58.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.348+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:58.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:58.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:58.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:27:59.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:27:59.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:27:59.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:27:59.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:27:59.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:27:59.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:27:59.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:27:59.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:27:59.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:27:59.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:27:59.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:27:59.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:27:59.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.879+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:27:59.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:27:59.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:27:59.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:00.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:00.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:00.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:00.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:00.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:00.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:00.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.527+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:00.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.527+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:00.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:00.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:00.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:00.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:00.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:00.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:00.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:00.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:00.751+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:01.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:28:01.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:01.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:01.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:01.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:01.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:01.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:01.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:01.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:01.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:01.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.983+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:01.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:01.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:01.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:01.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:28:02.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:28:02.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:02.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:02.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:02.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:02.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:02.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:02.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:02.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:02.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:02.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.131+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:02.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:02.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:02.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:03.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:03.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:03.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:03.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:03.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:03.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:03.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:03.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:03.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:03.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.315+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:03.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:03.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:03.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:03.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:03.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:03.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:03.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:03.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:03.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.815+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:03.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:03.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:03.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:05.484 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:28:05.485 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:28:05.485 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:28:05.486 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:28:06.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:06.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:06.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:06.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:06.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:06.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:06.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:06.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:06.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:06.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:07.001 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1404028810 2023-10-14T00:28:07.006 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:28:07.007 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243287 2023-10-14T00:28:07.008 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:28:07.008 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1404028810 ]] 2023-10-14T00:28:07.008 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1404028810 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\0\4\0\2\8\8\1\0 ]] 2023-10-14T00:28:07.008 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:28:07.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:07.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:07.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:07.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:07.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:07.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:07.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:07.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:07.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:07.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:07.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:07.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:07.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:07.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:07.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:07.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:07.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:07.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:07.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:07.543+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:07.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:07.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:07.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:07.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:09.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:28:09.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:28:09.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:09.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:09.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:09.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:09.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:09.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:09.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:09.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:09.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:09.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.319+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:09.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:09.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:09.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:28:09.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:28:09.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:09.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:09.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:09.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:09.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:09.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:09.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:09.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:09.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:09.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.391+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:09.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.391+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:09.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:09.391+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:12.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:12.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:12.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:12.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:12.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:12.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:12.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:12.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:12.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:12.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:12.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:12.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:12.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:12.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:12.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:12.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:12.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:12.091+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:12.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:12.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:12.274 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:28:12.275+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:28:14.573 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:28:14.571+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:28:14.803 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:28:14.803+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:28:17.011 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:28:17.013 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:28:17.019 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:28:17.019 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:28:17.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:17.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:17.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:17.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:17.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:17.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:17.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:17.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:17.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:17.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:17.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:17.523+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:17.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:17.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:17.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:17.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:17.621 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:28:17.619+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:28:18.124 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3232052750 2023-10-14T00:28:18.125 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:28:18.125 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243298 2023-10-14T00:28:18.126 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:28:18.126 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3232052750 ]] 2023-10-14T00:28:18.126 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3232052750 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\0\4\0\2\8\8\1\0 ]] 2023-10-14T00:28:18.126 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/3232052750 2023-10-14T00:28:19.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:28:19.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:28:19.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:19.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:19.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:19.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:19.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:19.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:19.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:19.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:19.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:19.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.915+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:19.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:19.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:19.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:20.811 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/3232052750 until 2023-10-14T01:28:20.139079+0000 (3600 sec) 2023-10-14T00:28:20.877 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/3232052750 2023-10-14T00:28:20.879 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:28:21.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:28:21.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:28:21.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:21.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:21.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:21.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:21.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:21.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:21.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:21.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:21.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:21.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.131+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:21.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:21.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:21.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:21.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:21.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:21.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:21.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:21.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:21.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:21.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:21.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.923+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:21.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:21.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:21.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:21.930 INFO:tasks.workunit.client.0.smithi191.stderr:listed 28 entries 2023-10-14T00:28:21.983 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/3232052750 2023-10-14T00:28:21.983 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:28:22.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:22.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:22.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:22.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:22.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:22.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:22.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:22.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:22.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:22.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:22.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:22.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:22.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:22.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:22.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:22.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.755+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:22.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:22.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:22.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:23.699 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:28:23.699+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:28:24.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:24.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:24.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:24.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:24.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:24.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:24.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:24.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:24.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:24.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:24.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:24.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:24.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:24.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:24.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:24.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:24.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:24.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:24.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:24.363+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:24.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:24.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:24.814 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:28:24.815+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:28:25.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:25.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:25.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:25.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:28:25.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:25.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:25.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:25.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:25.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:25.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:25.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:25.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:25.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:25.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:25.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:25.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:25.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:25.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:25.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:25.567+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:25.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:25.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:27.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:28:27.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:27.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:27.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:27.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:27.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:27.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:27.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:27.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:27.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:27.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.307+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:27.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:27.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:27.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:27.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:27.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:27.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:27.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:27.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:27.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:27.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:27.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:27.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.907+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:27.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:27.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:27.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:29.181 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:28:29.179+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:28:30.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:30.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:30.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:30.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:30.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:30.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:30.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:30.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:30.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:30.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.319+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:30.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:30.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:30.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:30.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:30.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:30.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:30.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:30.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:30.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:30.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.799+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:30.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:30.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:30.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:30.888 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:28:30.887+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:28:31.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:28:31.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:28:31.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:31.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:31.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:31.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:31.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:31.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:31.120 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:28:31.115+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:28:31.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:31.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.139+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:31.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.155+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:31.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.155+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:31.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.155+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:31.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.155+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:31.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:31.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:31.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:31.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:31.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:31.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.971+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:31.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.991+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:31.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.999+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:32.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:32.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:31.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:32.022 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:28:32.024 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:28:32.043 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:28:32.051 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:28:32.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:32.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:32.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:32.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:32.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:32.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:32.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:32.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:32.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:32.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:32.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:32.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:32.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:32.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:32.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:32.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:32.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:32.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:32.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:32.819+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:32.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:32.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:32.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:32.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:33.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:33.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:33.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:33.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:33.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:33.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.363+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:33.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:33.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:33.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:33.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:33.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:33.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:33.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.427+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:33.465 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3232052750 2023-10-14T00:28:33.467 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:28:33.468 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243313 2023-10-14T00:28:33.468 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:28:33.469 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3232052750 ]] 2023-10-14T00:28:33.469 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3232052750 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\2\3\2\0\5\2\7\5\0 ]] 2023-10-14T00:28:33.469 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:28:33.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:33.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:33.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:33.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:33.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:33.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.727+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:33.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:33.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:33.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:35.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:35.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:35.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:35.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:35.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:35.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:35.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:35.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.755+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:35.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:35.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:28:35.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:35.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:35.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:35.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:35.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:35.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.831+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:35.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:35.835+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:36.058 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:28:36.055+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:28:36.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:36.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:36.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:36.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:36.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:36.191+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:36.195 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:28:36.195+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:28:36.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:36.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:36.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:36.223+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:36.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:36.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:36.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:36.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:38.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:38.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:38.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:38.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:38.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:38.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:38.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:38.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:38.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:38.723+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:39.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:28:39.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:39.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:39.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:39.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:39.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:39.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:39.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:39.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:39.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:39.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.107+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:39.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:39.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:39.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:40.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:28:40.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:28:40.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:40.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:40.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:40.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:40.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:40.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:40.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:40.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:40.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:40.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.315+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:40.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:40.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:40.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:40.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:40.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:40.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:40.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:40.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:40.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:40.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:40.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:40.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.627+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:40.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:40.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:40.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:42.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:42.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:28:43.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:28:43.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:43.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:43.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:43.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:43.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:43.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:43.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:43.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:43.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:43.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.067+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:43.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:43.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:43.470 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:28:43.470 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:28:43.471 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:28:43.474 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:28:43.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:43.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:43.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:43.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:43.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:43.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:43.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:43.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:43.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:43.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.815+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:43.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:43.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:43.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:45.030 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3232052750 2023-10-14T00:28:45.030 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:28:45.031 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243325 2023-10-14T00:28:45.031 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:28:45.032 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3232052750 ]] 2023-10-14T00:28:45.032 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3232052750 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\2\3\2\0\5\2\7\5\0 ]] 2023-10-14T00:28:45.032 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:28:45.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:45.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:45.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:45.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:45.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:45.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:45.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:45.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:45.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:45.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.495+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:45.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:45.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:45.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:45.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:45.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:45.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:45.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:45.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:45.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:45.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:45.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.967+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:45.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:45.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:45.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:46.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:28:46.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:46.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:46.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:46.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:46.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:46.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:46.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:46.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.131+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:46.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:46.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:46.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:46.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:46.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:46.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:46.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:46.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:46.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.399+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:46.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:46.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:46.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:49.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:49.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:49.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:49.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:49.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:49.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:49.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:49.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:49.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:49.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:49.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:49.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:49.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:49.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:49.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:49.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:49.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:49.163+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:49.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:49.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:49.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:49.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:50.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:50.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:50.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:50.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:50.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:50.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:50.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:50.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:50.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:50.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:50.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:50.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:50.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:50.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:50.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:50.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:50.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:50.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:50.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:50.487+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:50.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:50.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:50.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:50.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:51.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:51.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:51.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:51.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:51.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:51.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:51.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:51.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:51.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:51.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:51.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:51.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:51.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:51.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:51.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:51.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:51.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:51.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:51.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:51.191+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:53.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:53.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:53.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:53.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:53.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:53.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:53.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.399+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:53.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:53.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:53.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:53.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:53.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:53.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:53.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:53.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:53.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:53.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.631+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:53.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.631+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:53.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.631+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:28:53.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:53.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:53.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:53.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:53.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:53.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:53.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:54.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.003+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:54.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.019+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:54.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:54.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:28:54.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:28:54.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:54.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:54.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:54.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:54.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:54.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:54.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:54.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.151+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:54.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:54.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:55.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:55.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:28:55.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:55.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:28:55.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:55.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:55.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:55.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:55.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:55.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:55.046 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:28:55.052 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:28:55.062 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:28:55.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:55.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:55.085 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:28:55.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:55.103+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:56.643 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3232052750 2023-10-14T00:28:56.648 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:28:56.665 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243336 2023-10-14T00:28:56.666 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:28:56.666 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3232052750 ]] 2023-10-14T00:28:56.666 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3232052750 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\2\3\2\0\5\2\7\5\0 ]] 2023-10-14T00:28:56.666 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:28:57.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:57.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:28:57.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:57.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:28:57.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:57.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:28:57.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:57.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:28:57.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:57.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:28:57.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:57.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:28:57.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:57.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:28:57.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:57.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:28:57.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:57.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:28:57.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:57.259+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:28:57.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:57.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:28:57.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:28:57.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:00.001 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:28:59.999+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.002 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:28:59.999+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.014 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.011+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.014 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.011+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.015 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.011+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a9600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.015 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.011+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565de80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.021 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.019+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.021 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.019+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a8a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.022 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.023+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.022 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.023+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565d500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.037 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.035+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.037 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.035+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565d980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.039 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.039+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.039 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.039+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75712800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.044 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.043+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.044 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.043+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75712980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.095 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.095+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.096 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.095+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.096 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.095+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75712d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.096 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.095+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75712b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.096 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.095+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.097 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.095+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.097 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.095+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75712680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.097 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.095+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565da00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.103 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.103+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.103 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.103+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75712f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.138 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.135+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.138 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.135+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.139 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.135+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75713180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.139 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.135+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75713380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.139 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.139+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.139 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.139+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75713580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.139+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.140 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.139+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75713780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.166 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.167+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.167 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.167+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75713980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.167 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.167+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.168 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.167+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75713b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.168 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.167+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.168 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:29:00.167+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75713d80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:29:00.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:00.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:00.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:00.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:00.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:00.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:00.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:00.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:00.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:00.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.383+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:00.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:00.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:00.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:00.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:00.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:00.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:00.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:00.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:00.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:00.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.455+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:00.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:00.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.499+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:00.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.499+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:00.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.499+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:00.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:00.499+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:01.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:01.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:01.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:01.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:01.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:01.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:01.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:01.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:01.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:01.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:01.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:01.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:01.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:01.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:01.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.822+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:01.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:01.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:01.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:02.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:02.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:02.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:02.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:02.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:02.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:02.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:02.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:02.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:02.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:03.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:03.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:03.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:03.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:03.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:03.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:03.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:03.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:03.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.150+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:03.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.158+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:03.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:03.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:03.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:03.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.882+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:03.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.882+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:03.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:03.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.894+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:03.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:29:03.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:03.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:03.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:03.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:03.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:03.938+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:06.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:29:06.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:06.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:06.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:06.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:06.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:06.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:06.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:06.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:06.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:06.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:06.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.522+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:06.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:06.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:06.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:06.689 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:29:06.689 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:29:06.690 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:29:06.714 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:29:07.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:07.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:07.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:07.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:07.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:07.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:07.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:07.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:07.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:07.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:07.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:07.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:07.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:07.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:07.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:07.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:07.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:07.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:07.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:07.870+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:07.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:07.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:07.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:07.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:08.409 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3232052750 2023-10-14T00:29:08.416 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:29:08.417 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243348 2023-10-14T00:29:08.417 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:29:08.417 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3232052750 ]] 2023-10-14T00:29:08.418 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3232052750 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\2\3\2\0\5\2\7\5\0 ]] 2023-10-14T00:29:08.418 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:29:08.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:08.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:08.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:08.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:08.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:08.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:08.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:08.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:08.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:08.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:08.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:08.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:08.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:08.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:08.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:08.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:08.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:08.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:08.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:08.850+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:08.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:08.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:08.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:08.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:12.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:12.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:12.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:12.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:12.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:12.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:12.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:12.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:12.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:12.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:12.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:12.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:12.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:12.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:12.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:12.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:12.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:12.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:12.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:12.638+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:12.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:12.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:12.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:12.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:13.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:13.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:13.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:13.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:13.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:13.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:13.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:13.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:13.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:13.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:13.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.590+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:13.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:13.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:13.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:16.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:16.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:16.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:16.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:16.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:16.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:16.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:16.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:16.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:16.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:16.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.218+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:16.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:16.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:16.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:29:16.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:16.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:29:16.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:16.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:16.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:16.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:16.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:16.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:16.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:16.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:16.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:16.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.494+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:16.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:16.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:16.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:17.842 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:29:17.842+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:29:17.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:17.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:29:17.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:17.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:17.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:17.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:17.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:17.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:17.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:17.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:18.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:18.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:18.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:18.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:18.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:18.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:18.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.034+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:18.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:18.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:18.081 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:29:18.078+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:29:18.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:29:18.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:18.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:18.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:18.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:18.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:18.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:18.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:18.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:18.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:18.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.306+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:18.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:18.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:18.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:18.423 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:29:18.432 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:29:18.433 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:29:18.436 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:29:19.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:19.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:19.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:19.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:19.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:19.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:19.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:19.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:19.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:19.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:19.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:19.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:19.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:19.258+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:19.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:19.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:19.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:19.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:19.818 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3232052750 2023-10-14T00:29:19.819 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:29:19.819 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243359 2023-10-14T00:29:19.820 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:29:19.820 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3232052750 ]] 2023-10-14T00:29:19.820 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3232052750 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\2\3\2\0\5\2\7\5\0 ]] 2023-10-14T00:29:19.820 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:29:22.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:29:22.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:22.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:29:22.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:22.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:22.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:22.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:22.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:22.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:22.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:22.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.594+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:22.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.594+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:22.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.594+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:22.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.594+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:22.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:22.594+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:23.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:23.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:23.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:23.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:23.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:23.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:23.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:23.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:23.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:23.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:23.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.102+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:23.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:23.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:23.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:24.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:24.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:24.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:24.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:24.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:24.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:24.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:24.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:24.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:24.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:24.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:24.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:24.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:24.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:24.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:24.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:24.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:24.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:24.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:24.442+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:24.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:24.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:24.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:24.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:25.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:25.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:25.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:25.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:25.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:25.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:25.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:25.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:25.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:25.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:25.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:25.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:25.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:25.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:25.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:25.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:25.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:25.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:25.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:25.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:25.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:25.170+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:26.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:26.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:26.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:26.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:26.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:26.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:26.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:26.510+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:26.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:26.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:26.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:26.526+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:26.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:26.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:26.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:26.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:26.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:26.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:26.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:26.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:26.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:26.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:26.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:26.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:27.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:27.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:27.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:27.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:27.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:27.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:27.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:27.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:27.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:27.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:27.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:27.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:27.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:27.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:27.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:27.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:27.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:27.754+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:27.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:27.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:27.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:27.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:29.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:29:29.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:29.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:29.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:29.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:29.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:29.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:29.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:29.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:29.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:29.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.342+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:29.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.342+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:29.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.342+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:29.839 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:29:29.841 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:29:29.843 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:29:29.847 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:29:29.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:29.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:29.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:29.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:29.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:29.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:30.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:30.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:30.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:30.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:30.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:30.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:30.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:30.018+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:30.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:30.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:30.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:30.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:31.134 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1401424761 2023-10-14T00:29:31.146 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:29:31.147 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243371 2023-10-14T00:29:31.148 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:29:31.148 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1401424761 ]] 2023-10-14T00:29:31.148 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1401424761 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\2\3\2\0\5\2\7\5\0 ]] 2023-10-14T00:29:31.148 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/1401424761 2023-10-14T00:29:32.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:32.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:32.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:32.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:32.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:32.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:32.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:32.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:32.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.226+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:32.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:29:32.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:32.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:32.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:32.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:32.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:32.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:32.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:32.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:32.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:32.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:32.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:32.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:32.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:32.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:32.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:32.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.670+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:32.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:32.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:32.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:33.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:33.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:33.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:33.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:33.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:33.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:33.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:33.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:33.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:33.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:33.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:33.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:33.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:33.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:33.853 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/1401424761 until 2023-10-14T01:29:33.201358+0000 (3600 sec) 2023-10-14T00:29:33.895 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:29:33.908 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/1401424761 2023-10-14T00:29:34.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:34.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:34.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:34.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:34.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:34.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:34.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:34.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:34.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:34.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:34.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:34.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:34.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:34.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:34.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:34.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:34.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:34.662+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:34.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:34.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:34.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:34.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:34.920 INFO:tasks.workunit.client.0.smithi191.stderr:listed 29 entries 2023-10-14T00:29:34.951 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/1401424761 2023-10-14T00:29:34.952 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:29:35.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:35.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:35.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:35.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:35.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:35.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:35.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:35.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:35.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:35.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:35.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:35.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:35.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:35.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:35.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:35.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:35.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:35.450+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:35.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:35.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:35.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:35.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:36.128 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:29:36.126+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:29:37.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:37.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:29:37.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:37.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:37.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:37.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:37.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:37.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:37.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:37.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:37.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:37.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.110+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:37.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:37.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:37.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:39.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:39.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:39.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:39.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:39.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:39.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:39.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:39.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:39.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:39.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:39.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:39.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:39.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:39.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:39.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:39.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:40.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:29:40.097 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:29:40.094+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:29:40.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:40.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:40.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:40.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:40.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:40.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:40.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:40.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:40.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:40.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.186+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:40.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:40.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:40.234 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:29:40.230+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:29:40.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:40.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:40.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:40.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:40.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:40.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:40.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:40.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.298+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:40.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.298+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:40.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.298+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:40.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.298+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:40.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.298+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:40.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:29:40.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:40.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:40.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:40.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:40.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:40.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:40.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:40.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:40.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:40.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.734+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:40.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:40.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:40.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:29:40.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:40.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:29:40.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:40.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:40.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:40.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:40.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:40.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:40.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:40.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:40.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:40.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.850+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:40.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:40.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:40.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:41.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:41.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:41.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:41.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:41.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:41.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:41.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:41.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:41.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:41.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.118+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:41.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:41.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:41.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:41.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:41.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:41.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:41.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:41.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.430+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:41.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.458+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:41.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:41.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:41.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:44.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:44.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:44.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:44.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:44.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:44.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:44.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:44.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:44.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:44.238+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:44.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:44.238+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:44.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:44.238+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:44.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:44.238+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:44.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:44.238+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:44.955 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:29:44.956 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:29:44.957 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:29:44.969 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:29:45.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:45.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:45.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:45.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:45.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:45.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:45.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:45.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:45.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:45.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:45.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:45.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:45.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:45.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:45.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:45.378+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:45.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:45.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:45.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:45.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:46.372 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1401424761 2023-10-14T00:29:46.378 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:29:46.379 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243386 2023-10-14T00:29:46.379 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:29:46.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1401424761 ]] 2023-10-14T00:29:46.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1401424761 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\0\1\4\2\4\7\6\1 ]] 2023-10-14T00:29:46.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:29:46.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:29:46.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:46.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:46.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:46.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:46.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:46.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:46.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:46.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:46.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:46.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.626+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:46.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.650+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:46.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.650+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:46.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:46.650+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:47.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:47.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:47.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:47.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:47.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:47.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:47.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.298+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:47.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:47.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.338+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:47.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:47.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:47.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:47.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:47.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:47.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:47.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:47.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:47.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:47.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:47.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.730+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:47.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:47.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:47.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:49.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:29:49.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:49.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:29:49.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:49.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:49.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:49.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:49.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:49.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:49.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:49.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:49.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:49.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.118+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:49.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:49.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:49.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:50.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:50.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:50.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:50.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:50.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:50.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:50.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:50.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:50.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:50.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.834+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:50.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:50.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:50.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:50.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:50.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:51.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:51.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:51.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:51.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:51.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:51.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:51.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:51.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:51.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:51.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:51.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:51.050+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:52.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:52.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:52.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:52.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:52.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:52.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:52.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:52.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:52.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:52.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:52.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:52.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:52.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:52.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:52.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:52.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:52.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:52.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:52.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:52.334+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:52.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:52.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:52.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:52.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:54.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:29:54.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:54.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:54.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:54.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:54.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:54.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:54.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:54.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.526+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:54.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:54.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:54.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:54.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:54.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:54.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:54.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.982+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.982+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.982+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.982+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:54.982+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:56.395 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:29:56.395 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:29:56.396 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:29:56.397 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:29:58.023 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1401424761 2023-10-14T00:29:58.025 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:29:58.026 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243398 2023-10-14T00:29:58.026 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:29:58.027 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1401424761 ]] 2023-10-14T00:29:58.027 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1401424761 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\0\1\4\2\4\7\6\1 ]] 2023-10-14T00:29:58.027 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:29:58.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:58.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:58.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:58.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:58.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:58.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:58.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:58.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:58.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:58.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:58.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:58.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:58.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:58.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:58.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:58.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:58.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:58.238+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:58.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:58.282+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:58.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:58.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:58.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:58.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:29:59.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:29:59.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:29:59.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:29:59.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:29:59.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:29:59.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:29:59.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:29:59.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:29:59.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:29:59.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.750+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:29:59.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.750+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:29:59.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.750+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:29:59.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.750+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:29:59.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:29:59.750+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:00.003 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.002+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.004 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.002+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da747cd300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.022 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.022+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.023 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.022+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75169300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.054 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.054+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.054 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.054+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.055 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.054+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da751ad800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.055 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.054+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75153f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.074 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.074+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.074 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.074+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.074 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.074+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da73f29080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.075 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.074+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75712680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.090 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.086+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.090 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.086+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.090 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.090+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75713200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.090 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.090+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75712f80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.114 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.114+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.114 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.114+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75713480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.115 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.114+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.115 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.114+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.115 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.114+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.115 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.114+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75713600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.116 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.114+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75713400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.116 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.114+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da752a9e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.133 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.130+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.134 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.130+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.134 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.130+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.134 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.130+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.135 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.130+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75713a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.135 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.130+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da755f2000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.135 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.130+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da755f2200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.135 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.130+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da755f2400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.145 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.142+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.142+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.142+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da755f2600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.146 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.142+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75712680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.147 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.146+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.147 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.146+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.147 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.146+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:00.147 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:00.146+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da73f28c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:01.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:30:01.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:01.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:01.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:01.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:01.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:01.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:01.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:01.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:01.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:01.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.694+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:01.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:01.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:01.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:03.906 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:30:03.906+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:30:04.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:04.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:04.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:04.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:04.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:04.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:04.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:04.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:04.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:04.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:04.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.102+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:04.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:04.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:04.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:06.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:30:06.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:06.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:06.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:06.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:06.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:06.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:06.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:06.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:06.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:06.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:06.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.254+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:06.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:06.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:06.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:08.028 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:30:08.033 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:30:08.033 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:30:08.046 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:30:08.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:30:08.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:30:08.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:08.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:08.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:08.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:08.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:08.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:08.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:08.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:08.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:08.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:08.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.429+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:08.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:08.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:08.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:08.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:08.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:08.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:08.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:08.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:08.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.853+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:08.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:08.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.909+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:08.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:08.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:08.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:09.446 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1401424761 2023-10-14T00:30:09.446 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:30:09.446 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243409 2023-10-14T00:30:09.447 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:30:09.447 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1401424761 ]] 2023-10-14T00:30:09.447 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1401424761 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\0\1\4\2\4\7\6\1 ]] 2023-10-14T00:30:09.447 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:30:09.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:09.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:09.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:09.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:09.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:09.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:09.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:09.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:09.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:09.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:09.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:09.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:09.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:09.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:09.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:09.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:09.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:09.673+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:09.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:09.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:09.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:09.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:12.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:12.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:12.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:12.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:12.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:12.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:12.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:12.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:12.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.329+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:12.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.333+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:12.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:12.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:12.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:12.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:15.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:15.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:15.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:15.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:15.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:15.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:15.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:15.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:15.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:15.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:15.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:15.173+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:15.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:15.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:15.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:15.181+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:15.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:15.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:15.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:15.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:17.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:30:17.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:30:17.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:17.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:17.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:17.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:17.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:17.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:17.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:17.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:17.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:17.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:17.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.157+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:17.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:17.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:17.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:19.450 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:30:19.452 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:30:19.453 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:30:19.453 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:30:19.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:19.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:19.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:19.849+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:20.593 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1401424761 2023-10-14T00:30:20.593 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:30:20.594 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243420 2023-10-14T00:30:20.595 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:30:20.595 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1401424761 ]] 2023-10-14T00:30:20.595 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1401424761 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\0\1\4\2\4\7\6\1 ]] 2023-10-14T00:30:20.595 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:30:21.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:21.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:21.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:21.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:21.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:21.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:21.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:21.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:21.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:21.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.417+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:21.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.429+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:21.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:21.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:21.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:24.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:24.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:24.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:24.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:24.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:24.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:24.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:24.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:24.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:24.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:24.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:24.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:24.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:24.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:24.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:24.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:24.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:24.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:24.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:24.705+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:24.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:24.705+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:24.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:24.705+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:26.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:26.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:26.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:26.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:26.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:26.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:26.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:26.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:26.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:26.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:26.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:26.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:26.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:26.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:26.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:26.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:26.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:26.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:26.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:26.341+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:28.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:30:28.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:28.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:28.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:28.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:28.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:28.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:28.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:28.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:28.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:28.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.613+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:28.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:28.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:28.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:30:28.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:28.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:28.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:28.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:28.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:28.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:28.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:28.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:28.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:28.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.785+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:28.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:28.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:28.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:28.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:28.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:28.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:28.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:28.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:28.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:28.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:28.977+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:30.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:30.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:30.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:30.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:30.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:30.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:30.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.437+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:30.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:30:30.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:30:30.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:30.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:30.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:30.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:30.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:30.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:30.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:30.603 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:30:30.604 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:30:30.604 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:30:30.629 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:30:30.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:30:30.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:30.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:30.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:30.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:30.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:30.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:30.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:30.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:30.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:30.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.969+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:30.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:30.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:30.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:31.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:31.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:31.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:31.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:31.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:31.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:31.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:31.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:31.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:31.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:31.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:31.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:31.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:31.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:31.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:31.461+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:31.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:31.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:31.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:31.493+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:31.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:31.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:31.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:31.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:32.007 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1401424761 2023-10-14T00:30:32.007 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:30:32.008 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243432 2023-10-14T00:30:32.008 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:30:32.008 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1401424761 ]] 2023-10-14T00:30:32.009 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1401424761 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\0\1\4\2\4\7\6\1 ]] 2023-10-14T00:30:32.009 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:30:32.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:30:32.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:32.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:32.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:32.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:32.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:32.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:32.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:32.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:32.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.357+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:32.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:32.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:32.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:32.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:32.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:32.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:32.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:32.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:32.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.861+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:32.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:32.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:32.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:34.050 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:30:34.045+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:30:34.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:34.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:34.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:34.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:34.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:34.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:34.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:34.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:34.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:34.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:34.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:34.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:34.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:34.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:34.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:34.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:34.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:34.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:34.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:34.269+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:34.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:34.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:34.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:34.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:35.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:35.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:35.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:35.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:35.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:35.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:35.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:35.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:35.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:35.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:35.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:35.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:35.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:35.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:35.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:35.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:35.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:35.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:35.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:35.445+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:35.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:35.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:35.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:35.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:36.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:30:36.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:36.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:36.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:36.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:36.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:36.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:36.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:36.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:36.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:36.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:36.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.901+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:36.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:36.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:36.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:37.751 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:30:37.745+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:30:38.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:38.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:30:38.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:38.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:38.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:38.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:38.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:38.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:38.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:38.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:38.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:38.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:38.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:38.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:38.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:38.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:38.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:38.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:38.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:38.789+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:38.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:38.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:38.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:38.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:41.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:41.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:41.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:41.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:41.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:41.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:41.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:41.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:41.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:41.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.109+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:41.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:41.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:41.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:41.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:41.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:41.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:41.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:41.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:41.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:41.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:41.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:41.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:41.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.661+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:41.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:41.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:41.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:42.009 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:30:42.009 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:30:42.018 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:30:42.032 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:30:43.452 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/384413792 2023-10-14T00:30:43.452 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:30:43.453 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243443 2023-10-14T00:30:43.453 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:30:43.453 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/384413792 ]] 2023-10-14T00:30:43.454 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/384413792 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\0\1\4\2\4\7\6\1 ]] 2023-10-14T00:30:43.454 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/384413792 2023-10-14T00:30:43.523 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:30:43.521+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:30:43.524 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:30:43.521+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:30:44.991 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:44.989+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da74aea540 handle_get_snapcontext: failed to get snapcontext: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.006 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.005+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da74aeb500 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.008 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.005+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da74aebe00 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.009 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.005+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da74aea240 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.010 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.009+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da73f11b00 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.010 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.009+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da74876240 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.011 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.009+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da74877d40 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.014 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.013+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da74876e40 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.018 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.017+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da73f11200 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.018 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.017+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da747a0480 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.019 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.017+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da73f0af00 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.019 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.017+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da73f0a480 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.019 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.017+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da7504fbc0 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.020 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.017+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da747a1440 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.020 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.017+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da745bfd40 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.021 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:30:45.017+0000 7f3dc575f640 -1 librbd::api::Mirror: image_info_list: failed to list mirror image statuses: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:30:45.938 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/384413792 until 2023-10-14T01:30:45.312510+0000 (3600 sec) 2023-10-14T00:30:46.023 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:30:46.046 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/384413792 2023-10-14T00:30:46.128 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:30:46.125+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:30:47.109 INFO:tasks.workunit.client.0.smithi191.stderr:listed 30 entries 2023-10-14T00:30:47.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:47.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:47.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:47.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:47.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:47.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:47.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:47.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:47.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:47.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:47.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:47.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:47.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:47.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:47.180 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/384413792 2023-10-14T00:30:47.181 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:30:47.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:47.197+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:47.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:47.197+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:47.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:47.197+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:47.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:47.197+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:48.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:48.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:48.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:48.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:48.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:48.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:48.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:48.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:48.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:48.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:48.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:48.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:48.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:48.665+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:48.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:48.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:48.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:48.685+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:48.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:48.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:48.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:48.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:49.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:49.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:49.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:49.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:49.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:49.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:49.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:49.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:49.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:49.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:49.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:49.105+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:49.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:49.105+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:49.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:49.105+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:49.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:49.105+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:49.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:49.105+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:50.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:50.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:50.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:50.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:50.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:50.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:50.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:50.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:50.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:50.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.221+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:50.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:50.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:50.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:50.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:50.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:50.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:50.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:51.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:51.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:51.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:51.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:51.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:51.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.069+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:51.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:51.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:51.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:51.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:51.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:51.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:51.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:51.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:51.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:51.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:51.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:51.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:51.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:51.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:51.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:51.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.653+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:51.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:51.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:51.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:51.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:51.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:51.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:51.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:51.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:51.885+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:53.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:53.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:53.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:53.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:53.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:53.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:53.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:53.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:53.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:53.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:53.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.121+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:53.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:53.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:53.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:53.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:53.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:53.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:53.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:53.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:53.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:53.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:53.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:53.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.781+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:53.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:53.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:53.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:53.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:53.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:53.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:53.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:54.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:53.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:54.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:54.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:54.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:54.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:54.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:54.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:54.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:54.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:54.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:54.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.417+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:54.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:30:54.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:30:54.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:54.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:54.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:54.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:54.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:54.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:54.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:54.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.517+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:54.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:54.517+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:55.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:55.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:30:55.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:55.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:30:55.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:55.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:55.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:55.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:55.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:55.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:55.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:55.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:55.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:55.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:55.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:55.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:55.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:55.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:55.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:55.897+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:55.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:55.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:55.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:55.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:56.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:56.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:56.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:56.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:56.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:56.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:56.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:56.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:56.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:56.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:56.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:56.229+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:56.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:56.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:56.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:56.245+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:56.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:56.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:56.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:56.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:56.667 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:30:56.665+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:30:57.220 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:30:57.224 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:30:57.225 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:30:57.226 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:30:57.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:57.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:57.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:57.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:57.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:57.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:57.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:57.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:57.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:57.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:57.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:57.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:57.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:57.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:57.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:57.617+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:57.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:57.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:57.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:57.653+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:30:57.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:57.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:30:57.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:57.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:30:58.669 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4060154092 2023-10-14T00:30:58.669 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:30:58.670 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243458 2023-10-14T00:30:58.670 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:30:58.671 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4060154092 ]] 2023-10-14T00:30:58.671 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4060154092 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\8\4\4\1\3\7\9\2 ]] 2023-10-14T00:30:58.671 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/4060154092 2023-10-14T00:30:58.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:58.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:58.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:58.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:58.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:58.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:30:58.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:58.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:30:58.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:58.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:30:58.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:58.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:30:58.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:58.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:30:58.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:58.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:30:58.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:58.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:30:58.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:58.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:30:58.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:58.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:30:59.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:30:59.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:00.038 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.037+0000 7f3dc8f66640 -1 librbd::image::RefreshRequest: failed to retrieve parent: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.039 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.037+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to refresh image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.039 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.037+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74cc5580 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.046 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.041+0000 7f3dc8765640 -1 librbd::image::GetMetadataRequest: 0x55da73f0b500 handle_metadata_list: failed to retrieve image metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.046 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.041+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.046 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.041+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to refresh image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.047 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.045+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75149880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.080 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.080 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.080 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.080 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.081 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.081 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.081 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.081 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751acb00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.081 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75149280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.081 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ac180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.082 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75152e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.082 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ce5900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.082 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7476b080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.082 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.077+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565c200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:31:00.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:31:00.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:31:00.179 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.173+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.180 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.173+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565c400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.180 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.177+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.180 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.177+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74f82200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.188 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.185+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.188 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.185+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ce4680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:00.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:00.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:00.246 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.205+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.246 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.205+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a8680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.247 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.205+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.247 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.205+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a8780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.247 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.205+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.247 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.205+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.248 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.205+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.248 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.205+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75712a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.248 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.205+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75713f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.248 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.205+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565de00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.250 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.249+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.250 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.249+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75713300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:00.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:00.253 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.249+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.253 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.249+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75713800 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:00.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:00.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:00.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:00.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.261+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:00.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:00.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:00.270 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.269+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.271 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:31:00.269+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565c400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:31:00.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:00.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:00.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:00.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:00.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:00.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:00.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:00.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:00.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:00.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.897+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:00.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:00.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:00.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:00.981 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/4060154092 until 2023-10-14T01:31:00.257494+0000 (3600 sec) 2023-10-14T00:31:01.049 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/4060154092 2023-10-14T00:31:01.057 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:31:01.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:01.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:01.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:01.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:01.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:01.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:01.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:01.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:01.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:01.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:01.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:01.853+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:01.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:01.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:01.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:01.857+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:01.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:01.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:01.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:01.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:02.063 INFO:tasks.workunit.client.0.smithi191.stderr:listed 31 entries 2023-10-14T00:31:02.124 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/4060154092 2023-10-14T00:31:02.124 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:31:02.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:31:02.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:02.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:02.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:02.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:02.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:02.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:02.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:02.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:02.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:02.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.649+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:02.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:02.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:02.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:02.761 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:02.757+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:31:03.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:03.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:03.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:03.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:03.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:03.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:03.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.113+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:03.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.117+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:03.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.129+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:03.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:03.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:03.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:03.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:03.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:03.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:03.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:03.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:03.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:03.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.533+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:03.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:03.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:03.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:03.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:03.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:03.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:03.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:03.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:03.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:03.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.761+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:03.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:03.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:03.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:03.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:03.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:03.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:03.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:03.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:04.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:04.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:04.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:04.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:04.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:04.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:04.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:04.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:04.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:04.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:04.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:04.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:04.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:04.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:04.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:04.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:04.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:04.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:07.716 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:07.713+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:31:07.733 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:07.725+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:31:08.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:08.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:08.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:08.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:08.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:08.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:08.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:08.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:08.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:08.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:08.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:08.069+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:08.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:08.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:08.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:08.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:09.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.001+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:09.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:09.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:09.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:09.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:09.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:09.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:09.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:09.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:09.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.721+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:09.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:09.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:09.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:09.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:09.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:09.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:09.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:09.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:09.925+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:11.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:11.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:11.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:11.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:11.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:11.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:11.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:11.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:11.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:11.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:11.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:11.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:11.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:11.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:11.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:11.717+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:12.127 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:31:12.132 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:31:12.136 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:31:12.137 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:31:13.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:13.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:13.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:13.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:13.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:13.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:13.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:13.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:13.518 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4060154092 2023-10-14T00:31:13.518 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:31:13.519 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243473 2023-10-14T00:31:13.520 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:31:13.520 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4060154092 ]] 2023-10-14T00:31:13.520 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4060154092 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\0\6\0\1\5\4\0\9\2 ]] 2023-10-14T00:31:13.520 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:31:14.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:31:14.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:14.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:14.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:14.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:14.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:14.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:14.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:14.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.361+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:14.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.361+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:14.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.361+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:14.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:14.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:14.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:31:14.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:31:14.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:14.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:14.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:14.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:14.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:14.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:14.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:14.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:14.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:14.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.717+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:14.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:14.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:14.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:31:14.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:31:14.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:14.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:14.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:14.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:14.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:14.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:14.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:14.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:14.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:14.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.789+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:14.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:14.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:14.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:15.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:15.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:15.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:15.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:15.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:15.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:15.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:15.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:15.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:15.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:15.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:15.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:15.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:15.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:15.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:15.321+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:15.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:15.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:15.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:15.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:16.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:31:16.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:31:16.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:16.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:16.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:16.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:16.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:16.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:16.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:16.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:16.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:16.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.341+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:16.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:16.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:16.530 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:16.529+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:31:16.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:16.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:16.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:16.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:16.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:16.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:16.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:16.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:16.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.645+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:16.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:16.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:16.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:18.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:18.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:18.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:18.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:18.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:18.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:18.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:18.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.100+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:18.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:18.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:31:18.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:18.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:18.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:18.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:18.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:18.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:18.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:18.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.456+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:18.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:18.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:18.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:19.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:31:19.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:31:19.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:19.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:19.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:19.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:19.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:19.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:19.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:19.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:19.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:19.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.448+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:19.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:19.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:19.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:31:19.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:31:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:31:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:19.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:19.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:19.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:19.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:19.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:19.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:19.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.880+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:19.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:19.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:19.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:19.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:19.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:19.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:19.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:19.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:19.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:19.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:19.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:19.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:19.980+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:20.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:20.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:21.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:21.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:21.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:21.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:21.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:21.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:21.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:21.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.104+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:21.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:21.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:21.170 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:21.168+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:31:21.171 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:21.168+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:31:21.504 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:21.500+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:31:21.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:21.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:21.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:21.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:21.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:21.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:21.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:21.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:21.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:21.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:21.944+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:22.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:31:22.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:22.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:22.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:22.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:22.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:22.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:22.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:22.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:22.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:22.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.332+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:22.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:22.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:22.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:23.458 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:23.456+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:31:23.536 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:31:23.537 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:31:23.539 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:31:23.540 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:31:23.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:31:23.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:23.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:23.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:23.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:23.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:23.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:23.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:23.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:23.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:23.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.788+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:23.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:23.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:23.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:24.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:31:24.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:31:24.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:24.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:24.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:24.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:24.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:24.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:24.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:24.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:24.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.208+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:24.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.208+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:24.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.208+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:24.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.208+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:24.542 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4060154092 2023-10-14T00:31:24.543 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:31:24.543 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243484 2023-10-14T00:31:24.544 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:31:24.544 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4060154092 ]] 2023-10-14T00:31:24.544 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4060154092 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\0\6\0\1\5\4\0\9\2 ]] 2023-10-14T00:31:24.544 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:31:24.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:24.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:24.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:24.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:24.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:24.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.956+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:24.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:24.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:24.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:25.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:25.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:25.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:25.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:25.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:25.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:25.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:25.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:25.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:25.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:25.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:25.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:25.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.944+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:25.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:25.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:25.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:27.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:27.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:27.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:27.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:27.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:27.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:27.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:27.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:27.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:27.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.124+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:27.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:27.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:27.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:27.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:27.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:27.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:27.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:27.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:27.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:27.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:27.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:27.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.468+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:27.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:27.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:27.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:27.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:27.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:27.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:27.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:27.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:27.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:27.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:28.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:28.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:28.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:28.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:28.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:28.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:28.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:28.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:28.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:28.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:28.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:28.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:28.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:28.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:28.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:28.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:28.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:28.892+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:28.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:28.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:28.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:28.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:29.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:29.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:29.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:29.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:29.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:29.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:29.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:29.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:29.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:29.072+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:29.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:29.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:29.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:29.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:29.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:29.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:29.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:29.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:29.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:29.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:29.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:29.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:31.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:31.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:31.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:31.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:31.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:31.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:31.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:31.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:31.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:31.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:31.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:31.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:31.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:31.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:31.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:31.244+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:31.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:31.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:31.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:31.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:33.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:33.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:33.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:33.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:33.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:33.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:33.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:33.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.168+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:33.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:33.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:33.592 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:33.592+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:31:33.642 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:33.636+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:31:33.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:33.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:33.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:33.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:33.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:33.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.696+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:33.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:33.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:33.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:34.551 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:31:34.556 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:31:34.574 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:31:34.597 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:31:35.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:35.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:35.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:35.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:35.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:35.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:35.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:35.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:35.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:35.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:35.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:35.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:35.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:35.176+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:35.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:35.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:35.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:35.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:35.854 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4060154092 2023-10-14T00:31:35.856 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:31:35.864 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243495 2023-10-14T00:31:35.864 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:31:35.864 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4060154092 ]] 2023-10-14T00:31:35.864 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4060154092 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\0\6\0\1\5\4\0\9\2 ]] 2023-10-14T00:31:35.865 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:31:36.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:36.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:36.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:36.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:36.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:36.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:36.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:36.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:36.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:36.964+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:36.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:36.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:36.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:36.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:39.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:39.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:39.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:39.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:39.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:39.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:39.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:39.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:39.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:39.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:39.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:39.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:39.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:39.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:39.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:39.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:39.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:39.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:39.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:39.780+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:39.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:39.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:39.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:39.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:39.793 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:39.796+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:31:40.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:40.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:40.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:40.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:40.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:40.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:40.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:40.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.356+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:40.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:40.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:40.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:40.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:40.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:40.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:41.681 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:31:41.680+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:31:45.872 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:31:45.872 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:31:45.877 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:31:45.918 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:31:45.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:45.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:31:45.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:45.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:31:46.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:46.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:46.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:46.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:46.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:46.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:46.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:46.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:46.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:46.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:46.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:46.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:46.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:46.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:46.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:46.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:46.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:46.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:46.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:46.124+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:46.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:46.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:46.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:46.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:47.168 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4060154092 2023-10-14T00:31:47.169 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:31:47.170 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243507 2023-10-14T00:31:47.170 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:31:47.170 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4060154092 ]] 2023-10-14T00:31:47.171 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4060154092 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\0\6\0\1\5\4\0\9\2 ]] 2023-10-14T00:31:47.171 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:31:47.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:47.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:47.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:47.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:47.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:47.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.760+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:47.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:47.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.800+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:47.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:47.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:31:47.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:47.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:47.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:47.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:47.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:47.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:47.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:47.816+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:48.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:48.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:48.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:48.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:48.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:48.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:48.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:48.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:48.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:48.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:48.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:48.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:48.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:48.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:48.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:48.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:48.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:48.692+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:48.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:48.712+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:48.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:48.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:48.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:48.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:50.334 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:50.336+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:31:52.477 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:31:52.476+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:31:54.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:54.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:54.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:54.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:54.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:54.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:54.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:54.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:54.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:54.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:54.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:54.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:54.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:54.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:54.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:54.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:54.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:54.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:54.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:54.572+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:54.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:54.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:54.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:54.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:56.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:56.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:56.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:56.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:56.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:56.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:56.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:56.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:56.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.776+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:56.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:56.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:56.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:56.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:56.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:56.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:56.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:56.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:56.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:56.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:56.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:57.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:57.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:57.000+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:57.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:57.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:57.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:57.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:57.177 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:31:57.178 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:31:57.180 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:31:57.181 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:31:57.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:57.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:57.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:57.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:31:57.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:57.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:57.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:57.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:57.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:57.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:31:57.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:57.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:58.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:58.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:58.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:58.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:58.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:58.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:31:58.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:58.084+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:58.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:58.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:58.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:58.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:31:58.560 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4060154092 2023-10-14T00:31:58.561 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:31:58.561 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243518 2023-10-14T00:31:58.562 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:31:58.562 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4060154092 ]] 2023-10-14T00:31:58.562 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4060154092 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\0\6\0\1\5\4\0\9\2 ]] 2023-10-14T00:31:58.562 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:31:59.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:59.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:31:59.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:59.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:31:59.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:59.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:31:59.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:59.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:31:59.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:59.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:31:59.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:59.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:31:59.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:59.668+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:31:59.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:59.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:31:59.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:31:59.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:00.194 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:00.192+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:32:00.244 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:00.244+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:02.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:02.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:02.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:02.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:02.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:02.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:02.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.284+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:02.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:02.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.320+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:02.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:02.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:02.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:02.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:02.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:02.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:02.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:02.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:02.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:02.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.916+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:02.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:02.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:02.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:04.272 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:04.272+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:06.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:06.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:06.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:06.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:06.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:06.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:06.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:06.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:06.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:06.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:06.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:06.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:06.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:06.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:06.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:06.692+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:06.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:06.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:06.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:06.704+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:06.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:06.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:06.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:06.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:07.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:07.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:07.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:07.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:07.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:07.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:07.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:07.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:07.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:07.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:07.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:07.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:07.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:07.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:07.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:07.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:07.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:07.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:07.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:07.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:08.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:08.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:08.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:08.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:08.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:08.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:08.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:08.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:08.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:08.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:08.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:08.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:08.592 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:32:08.594 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:32:08.612 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:32:08.638 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:32:09.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:09.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:09.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:09.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:09.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:09.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:09.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:09.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:09.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:09.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:09.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:09.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:09.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:09.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:09.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:09.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:09.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:09.740+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:09.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:09.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:09.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:09.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:09.916 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1490587570 2023-10-14T00:32:09.916 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:32:09.917 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243529 2023-10-14T00:32:09.917 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:32:09.917 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1490587570 ]] 2023-10-14T00:32:09.917 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1490587570 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\0\6\0\1\5\4\0\9\2 ]] 2023-10-14T00:32:09.918 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/1490587570 2023-10-14T00:32:10.011 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:10.008+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:10.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:10.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:10.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:10.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:10.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:10.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:10.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.496+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:10.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.496+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:10.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.496+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:10.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:10.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:10.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:10.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:10.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:10.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:10.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:11.217 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:11.216+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:11.982 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/1490587570 until 2023-10-14T01:32:11.239844+0000 (3600 sec) 2023-10-14T00:32:11.998 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:11.999+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:12.028 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:32:12.028 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/1490587570 2023-10-14T00:32:12.134 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:12.135+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:13.395 INFO:tasks.workunit.client.0.smithi191.stderr:listed 32 entries 2023-10-14T00:32:13.462 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/1490587570 2023-10-14T00:32:13.462 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:32:13.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:13.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:32:13.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:13.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:13.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:13.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:13.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:13.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:13.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:13.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:13.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:13.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.587+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:13.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:13.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:13.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:13.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:13.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:13.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:13.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:13.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:13.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:13.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:13.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:13.708 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:13.707+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:13.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:13.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:32:13.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:13.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:13.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:13.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:13.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:13.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:13.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:13.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:15.040 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:15.027+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:15.567 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:15.567+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:15.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:15.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:15.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:15.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:15.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:15.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:15.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:15.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:15.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:15.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:15.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:15.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:15.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:15.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:15.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:15.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:15.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:15.919+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:15.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:15.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:15.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:15.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:16.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:16.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:32:16.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:32:16.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:16.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:16.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:16.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:16.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:16.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:16.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:16.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.971+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:16.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:16.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.979+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:16.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:16.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:16.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:17.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:32:17.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:32:17.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:17.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:17.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:17.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:17.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:17.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:17.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:17.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:17.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.191+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:17.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.195+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:17.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:17.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:17.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:19.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:19.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:19.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:19.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:19.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:19.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:19.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:19.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:19.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:19.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:19.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:19.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:19.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:19.851+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:19.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:19.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:19.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:20.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:20.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:20.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:20.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:20.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:20.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:20.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:20.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:20.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:20.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:20.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.439+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:20.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:20.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:20.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:20.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:32:20.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:20.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:20.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:20.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:20.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:20.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:20.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:20.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:20.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:20.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.703+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:20.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:20.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:20.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:21.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:21.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:21.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:21.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:32:21.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:21.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:21.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:21.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:21.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:21.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:21.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:21.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:21.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:21.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:21.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:21.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:22.663 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:32:22.663+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:32:22.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:22.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:22.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:22.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:22.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:22.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:22.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:22.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:22.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:22.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:22.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:22.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:22.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:22.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:22.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:22.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:22.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:22.899+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:22.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:22.899+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:22.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:22.899+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:23.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:23.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:23.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:23.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:23.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:23.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:23.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:23.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:23.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:23.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.227+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:23.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:23.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:23.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:23.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:32:23.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:23.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:23.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:23.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:23.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:23.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:23.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:23.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:23.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.327+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:23.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:23.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:23.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:23.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:23.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:23.464 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:32:23.466 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:32:23.467 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:32:23.468 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:32:24.793 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1490587570 2023-10-14T00:32:24.797 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:32:24.799 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243544 2023-10-14T00:32:24.799 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:32:24.799 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1490587570 ]] 2023-10-14T00:32:24.799 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1490587570 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\9\0\5\8\7\5\7\0 ]] 2023-10-14T00:32:24.799 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:32:26.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:26.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:26.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:26.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:26.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:26.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:26.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:26.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:26.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:26.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:26.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:26.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:26.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:26.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:27.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:27.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.011+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:27.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:27.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:27.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:27.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:27.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:27.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:27.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:27.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:27.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:27.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:27.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:27.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.495+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:27.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:27.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:27.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:28.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:28.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:32:28.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:28.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:32:28.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:28.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:28.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:28.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:28.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:28.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:28.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:28.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:28.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:28.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:28.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:28.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:28.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:28.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:28.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:28.255+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:28.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:28.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:28.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:28.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:29.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:32:29.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:29.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:29.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:29.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:29.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:29.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:29.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:29.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:29.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:29.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.431+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:29.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:29.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:29.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:30.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:30.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:32:30.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:32:30.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:30.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:30.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:30.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:30.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:30.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:30.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:30.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:30.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.251+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:30.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:30.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:30.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:32.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:32:32.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:32.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:32.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:32.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:32.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:32.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:32.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:32.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:32.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:32.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.371+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:32.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:32.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:32.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:32:32.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:32.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:32.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:32.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:32.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:32.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:32.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.487+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:32.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:32.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:32.503+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:33.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:33.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:32:33.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:33.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:33.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:33.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:33.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:33.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:33.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:33.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:33.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:33.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.399+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:33.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:33.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:33.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:33.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:33.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:33.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:33.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:33.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:33.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:33.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:33.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.711+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:33.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:33.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:33.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:33.732 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:33.731+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:32:33.733 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:33.731+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:34.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:34.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:34.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:34.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:34.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:34.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:34.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:34.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:34.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:34.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:34.801 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:32:34.801 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:32:34.802 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:32:34.824 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:32:36.468 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1490587570 2023-10-14T00:32:36.477 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:32:36.483 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243556 2023-10-14T00:32:36.483 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:32:36.484 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1490587570 ]] 2023-10-14T00:32:36.484 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1490587570 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\9\0\5\8\7\5\7\0 ]] 2023-10-14T00:32:36.484 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:32:36.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:36.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:32:36.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:32:36.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:36.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:36.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:36.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:36.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:36.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:36.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:36.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:36.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:36.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.855+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:36.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:36.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:36.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:38.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:38.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:38.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:38.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:38.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:38.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:38.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:38.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:38.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:38.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:38.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:38.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:38.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:38.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:38.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:38.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:38.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:38.591+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:38.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:38.635+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:38.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:38.635+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:38.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:38.635+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:39.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:39.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:39.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:39.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:39.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:39.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:39.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:39.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:39.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:39.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:39.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:39.483+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:39.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:39.503+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:39.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:39.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:43.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:43.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:43.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:43.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:43.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:43.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:43.153 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:43.151+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:43.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:43.187+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:43.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:43.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:43.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:43.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:44.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:44.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:44.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:44.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:44.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:44.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:44.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:44.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:44.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:44.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:44.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:44.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:44.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:44.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:44.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:44.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:44.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:44.567+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:44.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:44.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:44.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:44.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:45.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.483+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:45.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:45.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:45.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:45.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:45.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:45.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:45.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:45.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:45.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.579+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:45.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:45.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:45.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:32:45.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:32:45.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:45.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:45.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:45.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:45.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:45.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:45.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:45.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.915+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:45.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:45.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:45.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:46.502 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:32:46.503 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:32:46.510 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:32:46.515 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:32:46.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:46.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:46.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:46.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:46.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:46.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:46.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:46.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:46.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:46.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:46.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:46.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:46.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:46.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:46.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:46.683+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:46.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:46.691+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:46.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:46.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:46.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:46.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:47.064 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:47.063+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:47.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:47.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:47.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:47.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:47.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:47.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:47.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:47.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:47.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:47.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:47.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.679+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:47.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:47.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:32:47.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:47.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:47.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:47.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:47.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:47.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:47.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:47.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:47.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:47.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.787+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:47.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:32:47.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:32:47.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:47.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:47.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:47.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:47.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:47.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:47.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:47.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:47.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:47.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:47.879+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:47.894 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1490587570 2023-10-14T00:32:47.895 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:32:47.896 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243567 2023-10-14T00:32:47.897 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:32:47.897 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1490587570 ]] 2023-10-14T00:32:47.897 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1490587570 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\9\0\5\8\7\5\7\0 ]] 2023-10-14T00:32:47.897 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:32:48.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:48.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:48.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:48.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:48.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:48.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:48.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:48.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:48.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:48.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:48.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:48.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:48.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:48.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:48.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:48.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:48.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:48.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:48.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:48.243+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:48.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:48.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:48.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:48.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:48.468 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:48.467+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:49.393 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:32:49.391+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:32:49.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:49.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:49.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:49.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:49.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:49.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:49.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:49.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:49.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:49.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:50.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:50.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:50.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:50.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:50.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:50.039+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:50.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:50.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:50.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:50.079+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:50.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:50.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:50.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:50.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:52.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:52.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:52.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:52.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:52.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:52.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:52.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:52.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:52.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:52.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:52.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:52.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:52.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:52.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:52.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:52.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:52.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:52.563+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:52.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:52.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:52.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:52.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:53.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:53.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:53.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:53.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:53.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:53.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:53.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:53.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:53.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:53.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:53.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:53.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:53.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:53.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:53.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:53.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:53.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:53.726+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:53.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:53.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:53.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:53.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:54.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:54.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:32:54.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:54.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:54.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:54.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:54.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:54.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:54.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:54.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:54.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:54.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:54.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:54.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:54.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:54.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:54.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:54.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:54.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:54.370+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:54.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:54.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:54.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:54.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:56.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:56.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:56.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:56.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:56.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:56.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:56.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:56.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:56.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:56.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:56.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:56.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:32:56.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:56.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:56.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:57.900 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:32:57.900 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:32:57.903 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:32:57.908 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:32:58.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:58.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:32:58.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:58.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:32:58.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:58.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:32:58.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:58.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:32:58.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:58.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:32:58.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:58.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:32:58.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:58.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:32:58.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:58.838+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:32:58.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:58.854+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:32:58.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:58.854+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:32:58.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:32:58.854+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:32:59.208 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1490587570 2023-10-14T00:32:59.208 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:32:59.209 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243579 2023-10-14T00:32:59.209 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:32:59.209 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1490587570 ]] 2023-10-14T00:32:59.210 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1490587570 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\9\0\5\8\7\5\7\0 ]] 2023-10-14T00:32:59.210 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:33:00.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:00.074 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.046+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.075 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.046+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.075 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.046+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.075 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.046+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.075 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.046+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75168c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.076 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.046+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75713980 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.076 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.046+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da751f0f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.076 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.046+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75713e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.076 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.046+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.076 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.046+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75212080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.077 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.046+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.077 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.046+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75212680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:00.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:00.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:00.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:00.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:00.079 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.070+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.079 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.070+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75212500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:00.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:00.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:00.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.070+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:00.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:00.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:00.081 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.074+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.082 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.074+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75212c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.114 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.114+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.115 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.114+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75212a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.134 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.130+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.135 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.130+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75212880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.174 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.170+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.174 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.170+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.175 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.170+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75212300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.175 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.170+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75212e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.210 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.206+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.210 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.206+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75213080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.227 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.226+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.227 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.226+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75213280 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.238 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.234+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.238 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.234+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.239 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.234+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.239 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.234+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75213480 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.239 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.238+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75213680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.239 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.238+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75213880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.240 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.238+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.240 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.238+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.240 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.238+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.241 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.238+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75213a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.241 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.238+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75213c80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.241 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:33:00.238+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75213e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:33:00.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:00.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:00.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:00.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:00.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:00.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:00.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:00.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:00.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:00.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.458+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:00.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:00.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:00.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:00.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:00.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:00.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:00.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:00.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:00.606+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:01.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:01.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:01.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:01.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:01.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:01.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:01.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:01.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:01.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:01.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:01.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:01.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:01.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:01.946+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:01.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:01.946+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:02.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:02.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:02.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:02.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:02.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:02.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:02.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:02.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:02.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.498+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:02.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:02.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:02.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:02.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:02.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:02.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:02.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:02.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:02.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:02.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:02.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:02.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:02.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:02.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:02.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:02.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:02.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:02.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:02.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:02.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:02.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.874+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:02.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:02.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:03.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:03.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:03.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:03.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:03.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:03.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:03.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:03.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:03.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:03.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:03.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:03.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:03.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:03.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:03.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:03.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:03.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:03.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:03.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:03.734+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:03.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:03.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:03.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:03.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:04.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:04.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:04.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:04.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:04.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:04.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:04.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:04.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:04.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.318+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:04.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.318+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:04.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.318+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:04.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.318+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:04.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.318+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:04.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:04.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:04.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:04.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:04.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:04.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:04.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:04.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.822+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:04.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:04.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:04.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:04.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:04.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:04.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:04.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:04.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:04.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:04.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:04.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:04.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.954+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:04.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:04.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:04.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:05.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:05.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:05.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:05.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:05.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:05.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:05.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:05.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:05.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.466+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:05.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:05.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:05.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:05.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:05.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:05.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:05.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:05.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:05.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:05.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:05.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:05.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:05.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.722+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:05.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:05.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:05.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:05.947 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:33:05.946+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:33:06.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:06.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:06.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:06.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:06.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:06.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.838+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:06.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.838+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:06.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.838+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:06.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.838+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:06.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.838+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:06.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:06.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:06.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:06.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:06.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:06.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:06.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:06.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:06.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:06.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:06.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.966+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:06.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:06.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:06.978+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:07.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:07.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:07.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:07.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:07.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:07.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:07.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:07.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:07.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:07.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:07.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:07.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:07.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:07.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:07.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:07.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:07.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:07.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:07.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:07.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:07.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:07.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:07.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:07.430+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:08.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:08.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:08.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:08.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:08.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:08.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:08.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:08.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:08.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:08.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:08.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:08.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:08.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:08.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:08.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:08.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:08.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:08.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:08.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:08.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:08.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:08.982+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:09.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:09.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:09.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:09.002+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:09.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:09.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:09.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:09.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:09.220 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:33:09.222 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:33:09.224 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:33:09.240 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:33:10.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:10.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:10.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:10.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:10.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:10.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:10.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:10.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:10.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:10.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.490+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:10.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:10.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:10.653 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/1490587570 2023-10-14T00:33:10.656 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:33:10.659 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243590 2023-10-14T00:33:10.659 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:33:10.659 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/1490587570 ]] 2023-10-14T00:33:10.660 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/1490587570 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\9\0\5\8\7\5\7\0 ]] 2023-10-14T00:33:10.660 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:33:10.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:10.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:10.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:10.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:10.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:10.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:10.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:10.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:10.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:10.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:10.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:10.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:10.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.866+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:10.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:10.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:10.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:11.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:11.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:11.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:11.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:11.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:11.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:11.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:11.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:11.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:11.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:11.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.490+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:11.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:11.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:11.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:11.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:11.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:11.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:11.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:11.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:11.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:11.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:11.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.862+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:11.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:11.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:12.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:12.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:12.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:12.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:12.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:12.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:12.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:12.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:12.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:12.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:12.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:12.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:12.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:12.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:12.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:12.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:12.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:12.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:12.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:12.906+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:12.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:12.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:12.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:12.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:15.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:15.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:15.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:15.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:15.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:15.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:15.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:15.390+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:16.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:16.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:16.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:16.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:16.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:16.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:16.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:16.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:16.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.102+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:16.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:16.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:16.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:16.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:16.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:16.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:16.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:16.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:16.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:16.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:16.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.314+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:16.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:16.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:16.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:17.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:17.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:17.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:17.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:17.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:17.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:17.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:17.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:17.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:17.846+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:17.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:17.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:17.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:17.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:19.198 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:33:19.194+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:33:19.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:19.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:19.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:19.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:19.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:19.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:19.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:19.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:19.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:19.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:19.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:19.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:19.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:19.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:19.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:19.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:19.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:19.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:19.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:19.738+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:19.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:19.738+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:19.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:19.738+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:20.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:20.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:20.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:20.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:20.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:20.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:20.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:20.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:20.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:20.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:20.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:20.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:20.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:20.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:20.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:20.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:20.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:20.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:20.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:20.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:20.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:20.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:20.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:20.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:20.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:20.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:20.661 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:33:20.670 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:33:20.671 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:33:20.678 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:33:20.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:20.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:20.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:20.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:20.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:20.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:20.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:21.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:20.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:21.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.006+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:21.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:21.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:21.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:21.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:21.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:21.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:21.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:21.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:21.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:21.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:21.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:21.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:21.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:21.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.282+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:21.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:21.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:21.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:21.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:21.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:21.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:21.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:21.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:21.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:21.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:21.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:21.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:21.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.918+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:21.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.926+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:21.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:21.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:21.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:21.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:21.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:21.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:21.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:21.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:21.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:21.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:21.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:21.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:22.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:22.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:22.018 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4130539932 2023-10-14T00:33:22.019 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:33:22.020 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243602 2023-10-14T00:33:22.021 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:33:22.021 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4130539932 ]] 2023-10-14T00:33:22.021 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4130539932 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\1\4\9\0\5\8\7\5\7\0 ]] 2023-10-14T00:33:22.021 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/4130539932 2023-10-14T00:33:22.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:22.018+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:23.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:23.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:23.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:23.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:23.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:23.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:23.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:23.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.882+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:23.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.882+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:23.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.894+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:23.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:23.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:23.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:23.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:23.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:23.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:23.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:23.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:23.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:23.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:23.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:23.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:23.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:23.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:23.910+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:23.978 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/4130539932 until 2023-10-14T01:33:23.301244+0000 (3600 sec) 2023-10-14T00:33:24.035 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:33:24.049 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/4130539932 2023-10-14T00:33:25.203 INFO:tasks.workunit.client.0.smithi191.stderr:listed 33 entries 2023-10-14T00:33:25.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:25.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:25.255 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/4130539932 2023-10-14T00:33:25.256 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:33:25.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:25.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:25.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:25.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:25.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:25.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:25.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:25.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:25.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:25.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.278+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:25.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.302+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:25.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.302+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:25.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:25.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:25.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:25.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:25.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:25.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:25.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:25.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.526+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:25.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:25.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:25.542+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:30.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:30.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:30.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:30.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:30.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:30.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:30.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:30.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:30.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:30.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:30.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:30.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:30.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.410+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:30.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:30.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:30.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:32.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:32.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:32.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:32.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:32.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:32.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:32.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:32.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:32.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:32.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.410+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:32.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:32.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:32.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:32.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:32.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:32.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:32.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:32.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:33.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:33.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:33.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:33.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:33.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:33.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:33.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:33.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:33.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:33.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:33.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:33.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:33.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.110+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:33.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:33.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:33.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:33.363 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:33:33.362+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:33:35.258 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:33:35.261 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:33:35.269 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:33:35.297 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:33:36.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:36.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:36.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:36.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:36.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:36.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:36.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:36.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:36.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:36.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:36.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:36.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:36.752 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4130539932 2023-10-14T00:33:36.754 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:33:36.755 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243616 2023-10-14T00:33:36.755 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:33:36.755 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4130539932 ]] 2023-10-14T00:33:36.756 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4130539932 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\1\3\0\5\3\9\9\3\2 ]] 2023-10-14T00:33:36.756 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:33:36.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:36.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:36.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:36.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:36.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:36.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:36.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:36.754+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:37.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:37.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:37.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:37.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:37.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:37.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:37.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:37.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:37.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:37.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:37.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.529+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:37.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:37.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:37.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:37.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:37.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:37.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:37.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:37.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:37.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:38.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:37.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:38.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:38.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:38.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:38.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:38.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:38.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:39.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:39.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:39.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:39.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:39.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:39.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:39.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:39.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:39.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:39.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:39.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:39.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:39.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:39.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:39.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:39.517+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:39.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:39.517+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:42.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:42.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:42.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:42.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:42.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:42.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:42.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:42.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:42.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:42.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:42.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:42.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:42.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:42.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:42.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:42.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.809+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:42.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.809+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:42.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:42.809+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:43.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:43.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:43.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:43.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:43.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:43.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:43.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:43.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:43.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:43.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:43.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:43.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:43.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.745+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:43.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:43.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:43.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:43.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:43.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:43.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:43.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:43.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:43.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:43.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:43.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.917+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:43.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.921+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:43.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:43.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:43.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:43.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:43.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:43.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:43.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:43.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:44.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:44.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:43.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:44.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:44.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:44.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:44.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:44.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:44.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:44.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:44.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:44.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:44.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:44.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:44.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:44.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.053+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:44.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:44.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:44.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:46.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:46.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:46.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:46.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:46.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:46.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:46.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:46.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.461+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:46.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:46.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.489+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:46.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:46.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:46.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:46.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:33:46.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:46.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:46.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:46.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:46.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:46.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:46.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:46.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:46.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:46.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:46.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.613+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:46.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:46.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:46.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:46.761 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:33:46.767 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:33:46.767 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:33:46.793 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:33:47.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:47.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:47.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:47.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:47.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:47.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:47.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:47.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:47.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:47.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:47.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:47.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:47.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:47.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:47.983 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:33:47.981+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:33:47.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:47.989+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:47.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:47.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:48.171 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4130539932 2023-10-14T00:33:48.177 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:33:48.178 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243628 2023-10-14T00:33:48.178 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:33:48.179 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4130539932 ]] 2023-10-14T00:33:48.179 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4130539932 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\1\3\0\5\3\9\9\3\2 ]] 2023-10-14T00:33:48.179 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:33:51.007 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:33:51.005+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:33:51.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:51.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:51.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:51.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:51.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:51.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:51.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:51.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:51.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:51.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.201+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:51.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:51.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:51.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:51.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:51.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:51.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:51.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:51.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.357+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:51.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:51.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:51.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:52.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:52.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:52.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:52.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:52.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:52.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:52.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:52.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:52.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:52.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:52.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:52.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:52.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:52.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:52.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:52.769+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:52.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:52.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:52.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:52.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:53.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:53.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:53.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:53.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:53.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:53.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.665+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:53.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:53.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.701+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:53.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.701+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:53.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.701+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:53.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:53.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:53.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:53.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:53.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:53.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:53.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:53.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:53.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.945+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:53.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:53.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:53.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:54.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:54.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:54.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:54.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:54.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:54.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:54.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:54.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:54.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.641+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:54.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:54.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:54.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:54.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:54.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:54.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:54.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:54.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:54.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:57.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:57.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:57.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:57.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:57.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:57.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:57.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:57.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:57.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:57.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:57.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:57.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:57.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:57.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.601+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:57.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:57.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:57.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:58.181 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:33:58.181 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:33:58.183 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:33:58.190 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:33:58.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:33:58.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:58.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:58.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:58.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:58.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:58.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:58.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:58.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:58.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:58.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.693+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:58.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:58.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:58.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:33:58.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:33:58.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:33:58.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:33:58.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:33:58.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:33:58.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:33:58.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:33:58.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:33:58.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:33:58.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.957+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:33:58.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:33:58.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:33:58.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:33:59.634 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4130539932 2023-10-14T00:33:59.634 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:33:59.635 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243639 2023-10-14T00:33:59.635 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:33:59.635 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4130539932 ]] 2023-10-14T00:33:59.635 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4130539932 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\1\3\0\5\3\9\9\3\2 ]] 2023-10-14T00:33:59.636 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:34:00.090 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.085+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.091 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.085+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.133 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.125+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.134 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.125+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.134 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.125+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.134 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.125+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.134 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.125+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.135 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.125+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c74b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.135 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.125+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75168e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.135 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.125+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565de00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.136 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.125+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f4380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.136 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.125+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f4080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.136 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.133+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.136 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.133+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.136 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.133+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f4a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.137 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.133+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f4900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.159 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.157+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.159 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.157+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.160 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.157+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f5000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.160 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.157+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f4e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.184 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.181+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.185 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.181+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.204 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.201+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.204 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.201+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74c74b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.204 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.201+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.204 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.201+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75168e00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.210 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.205+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.210 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.205+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565de00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.211 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.209+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.211 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.209+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f4380 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.212 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.209+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.212 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.209+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.212 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.209+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.212 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.209+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f4080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.213 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.209+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f4a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.213 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.209+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f4900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.213 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.209+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.213 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.209+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.213 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.209+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f5000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:00.214 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:00.209+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f4e80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:01.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:01.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:01.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:01.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:01.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:01.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:01.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:01.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:01.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:01.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.281+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:01.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:01.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:01.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:34:01.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:01.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:01.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:01.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:01.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:01.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:01.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.793+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:01.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:01.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:01.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:03.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:03.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:03.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:03.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:03.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:03.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:03.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:03.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.665+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:03.762 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:34:03.757+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:34:03.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:03.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:03.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:34:03.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:03.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:03.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:03.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:03.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:03.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:03.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:03.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:03.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:04.282 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:34:04.277+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:34:05.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:05.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:05.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:05.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:05.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:05.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:05.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:05.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:05.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:05.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:05.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:05.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:05.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:05.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:06.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:05.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:06.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:05.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:06.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:06.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:06.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:06.029+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:06.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:06.029+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:06.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:06.029+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:07.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:07.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:07.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:07.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:07.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:07.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:07.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:07.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:07.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:07.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:07.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:07.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:07.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:07.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:07.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:07.517+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:07.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:07.541+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:07.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:07.541+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:07.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:07.541+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:09.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:09.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:09.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:09.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:09.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:09.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:09.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:09.589+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:09.642 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:34:09.643 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:34:09.643 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:34:09.676 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:34:10.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:10.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:10.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:10.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:10.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:10.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:10.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:10.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:10.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:10.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.285+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:10.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:10.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:10.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:10.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:10.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:10.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:10.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:10.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.669+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:10.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.669+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:10.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.669+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:10.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:10.669+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:11.114 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4130539932 2023-10-14T00:34:11.117 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:34:11.118 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243651 2023-10-14T00:34:11.118 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:34:11.119 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4130539932 ]] 2023-10-14T00:34:11.119 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4130539932 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\1\3\0\5\3\9\9\3\2 ]] 2023-10-14T00:34:11.119 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:34:11.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:11.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:11.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:11.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:11.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:11.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:11.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:11.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:11.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:11.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:11.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:11.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:11.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:11.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:11.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:11.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:11.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:11.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:11.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:11.673+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:11.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:11.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:11.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:11.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:13.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:13.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:13.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:13.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:13.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:13.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:13.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:13.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:13.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:13.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:13.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:13.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:13.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:13.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:13.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:13.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:13.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:13.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:13.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:13.265+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:13.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:13.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:13.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:13.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:15.222 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:34:15.217+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:34:16.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:34:16.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:34:16.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:16.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:16.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:16.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:16.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:16.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:16.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:16.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:16.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:16.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.477+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:16.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:16.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:16.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:18.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:34:18.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:18.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:18.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:18.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:18.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:18.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:18.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:18.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:18.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:18.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.233+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:18.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:34:18.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:18.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:18.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:18.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:18.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:18.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:18.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:18.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:18.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:18.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:18.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:18.277+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:21.126 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:34:21.126 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:34:21.127 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:34:21.128 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:34:22.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:34:22.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:22.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:22.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:22.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:22.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:22.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:22.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:22.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:22.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:22.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.236+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:22.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:22.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:22.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:22.383 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4130539932 2023-10-14T00:34:22.384 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:34:22.384 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243662 2023-10-14T00:34:22.385 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:34:22.385 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4130539932 ]] 2023-10-14T00:34:22.385 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4130539932 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\1\3\0\5\3\9\9\3\2 ]] 2023-10-14T00:34:22.385 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:34:24.842 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:34:24.836+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:34:25.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:25.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:25.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:25.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:25.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:25.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:25.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:25.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:25.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:25.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:25.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:25.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:25.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:25.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:25.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:25.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:25.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:25.496+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:25.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:25.516+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:25.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:25.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:25.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:25.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:26.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:26.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:26.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:26.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:26.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:26.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:26.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:26.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:26.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.204+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:26.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:26.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:26.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:26.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:26.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:26.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:26.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:26.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:26.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:26.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:26.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.352+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:26.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:26.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:26.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:26.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:26.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:26.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:26.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:27.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:27.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:27.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:27.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:27.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:27.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:27.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:27.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:27.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:27.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:27.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:27.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:27.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:27.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:27.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:27.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:27.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:27.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:27.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:27.516+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:27.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:27.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:27.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:27.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:28.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:28.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:28.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:28.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:28.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:28.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:28.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:28.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:28.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:28.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:28.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:28.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:28.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:28.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:30.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:30.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:34:30.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:30.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:30.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:30.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:30.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:30.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:30.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:30.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:30.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:30.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.164+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:30.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:30.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:30.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:30.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:30.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:30.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:30.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:30.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:30.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:30.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:30.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:30.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.820+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:30.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:30.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:30.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:32.388 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:34:32.388 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:34:32.391 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:34:32.391 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:34:32.947 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:34:32.944+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:34:33.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:33.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:33.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:33.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:33.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:33.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:33.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:33.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:33.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:33.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:33.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.616+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:33.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:33.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:33.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:34:33.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:33.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:33.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:33.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:33.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:33.769 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4249645525 2023-10-14T00:34:33.770 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:34:33.770 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243673 2023-10-14T00:34:33.771 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:34:33.771 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4249645525 ]] 2023-10-14T00:34:33.771 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4249645525 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\1\3\0\5\3\9\9\3\2 ]] 2023-10-14T00:34:33.771 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/4249645525 2023-10-14T00:34:33.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:33.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:33.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.804+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:33.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:33.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:33.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:34.264 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:34:34.256+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:34:35.185 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:35.184+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da747a00c0 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:35.188 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:35.188+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da73f10b40 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:35.188 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:35.188+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da73f10180 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:35.189 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:35.188+0000 7f3dc8765640 -1 librbd::mirror::GetInfoRequest: 0x55da73f11200 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:35.195 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:34:35.196+0000 7f3dc575f640 -1 librbd::api::Mirror: image_info_list: failed to list mirror image statuses: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:34:35.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:35.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:35.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:35.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:35.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:35.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:35.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:35.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:35.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:35.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:35.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:35.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:34:35.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:35.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:35.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:35.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:34:35.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:35.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:35.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:35.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:35.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:35.952+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:35.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:35.952+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:36.155 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/4249645525 until 2023-10-14T01:34:35.478499+0000 (3600 sec) 2023-10-14T00:34:36.210 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:34:36.210 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/4249645525 2023-10-14T00:34:37.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:37.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:34:37.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:37.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:37.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:37.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:37.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:37.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:37.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:37.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:37.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:37.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:37.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:37.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:37.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:37.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:37.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:37.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:37.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:37.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:37.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:37.296+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:37.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:37.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:37.384 INFO:tasks.workunit.client.0.smithi191.stderr:listed 34 entries 2023-10-14T00:34:37.426 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/4249645525 2023-10-14T00:34:37.426 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:34:38.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:38.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:38.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:38.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:38.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:38.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:38.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:38.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:38.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:38.948+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:38.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:38.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:38.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:38.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:39.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:39.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:39.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:39.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:39.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:39.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:39.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:39.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:39.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:39.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.584+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:39.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.584+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:39.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:39.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:34:39.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:39.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:39.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:39.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:39.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:39.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:39.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:39.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:39.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.656+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:39.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.656+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:39.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.656+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:39.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:34:39.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:39.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:39.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:39.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:39.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:39.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:39.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:39.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.772+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:39.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:39.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:39.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:40.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:40.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:40.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:40.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:34:40.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:40.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:40.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:40.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:40.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:40.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:40.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:40.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:40.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:40.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:40.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:40.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:40.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:42.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:42.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:42.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:42.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:42.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:42.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:42.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:42.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:42.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.388+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:42.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:42.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:42.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:42.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:42.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:42.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:42.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:42.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:42.496+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:43.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:34:43.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:43.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:43.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:43.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:43.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:43.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:43.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:43.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:43.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.428+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:43.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:43.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:43.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:43.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:43.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:43.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:43.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:43.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:43.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:43.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:43.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:43.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:43.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:43.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:43.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:44.615 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:34:44.616+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:34:44.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:44.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:34:44.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:44.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:44.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:44.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:34:44.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:44.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:44.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:44.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:44.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:44.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:44.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:44.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:44.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:44.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:44.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:44.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:44.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:44.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:44.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:44.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:44.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:44.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:45.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:45.000+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:45.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:45.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:45.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:45.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:46.963 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:34:46.960+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:34:47.429 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:34:47.430 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:34:47.433 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:34:47.435 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:34:47.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:47.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:47.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:47.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:47.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:47.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:47.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:47.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:47.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:47.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:47.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:47.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:47.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:47.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:47.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:47.760+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:47.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:47.760+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:47.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:47.760+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:48.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:48.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:48.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:48.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:48.877 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4140905281 2023-10-14T00:34:48.877 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:34:48.878 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243688 2023-10-14T00:34:48.879 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:34:48.879 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4140905281 ]] 2023-10-14T00:34:48.879 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4140905281 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\2\4\9\6\4\5\5\2\5 ]] 2023-10-14T00:34:48.879 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/4140905281 2023-10-14T00:34:48.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:48.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:48.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:48.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:48.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:48.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:48.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:48.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:50.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:50.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:50.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:50.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:50.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:50.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:50.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:50.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.696+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:50.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:50.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:50.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:50.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:50.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:50.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:50.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:51.020 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/4140905281 until 2023-10-14T01:34:50.238317+0000 (3600 sec) 2023-10-14T00:34:51.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:51.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:51.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:51.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:51.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:51.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:51.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:51.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:51.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:51.044+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:51.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:51.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:51.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:51.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:51.107 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/4140905281 2023-10-14T00:34:51.108 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:34:51.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:51.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:51.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:51.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:52.415 INFO:tasks.workunit.client.0.smithi191.stderr:listed 35 entries 2023-10-14T00:34:52.490 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/4140905281 2023-10-14T00:34:52.490 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:34:53.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:53.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:53.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:53.352+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:55.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:55.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:55.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:55.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:55.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:55.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:55.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:55.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:55.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:55.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:55.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:55.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:55.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:55.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:55.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:55.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:55.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:55.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:55.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:55.804+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:55.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:55.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:55.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:55.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:34:56.592 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:34:56.588+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:34:57.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:34:57.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:34:57.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:34:57.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:34:57.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:34:57.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:34:57.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:34:57.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:34:57.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:34:57.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:34:57.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.720+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:34:57.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:34:57.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:34:57.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:00.104 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.096+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.104 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.096+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da7565dc80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.104 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.096+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.105 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.096+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da74ce5080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.105 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.100+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.105 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.100+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da747cd680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.105 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.100+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.105 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.100+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75169300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.120 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.120+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.120 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.120+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.120 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.120+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75213a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.120 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.120+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da748f4b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.120 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.120+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.121 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.120+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.121 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.120+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da748f5300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.121 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.120+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da748f5180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.129 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.128+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.129 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.128+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da748f5880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.131 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.128+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.131 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.128+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.131 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.128+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.132 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.128+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.132 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.128+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da748f5700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.132 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.128+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da7565dc80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.133 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.128+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da74ce5080 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.133 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.128+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da747cd680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.133 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.128+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.133 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.128+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75169300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.152 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.152+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.152 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.152+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da75213a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.163 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.164+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.163 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.164+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da748f4b80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.170 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.168+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.170 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.168+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da748f5300 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.172 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.172+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.173 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.172+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da748f5180 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.179 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.180+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.180 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.180+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da748f5880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.188 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.188+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.188 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:35:00.188+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da748f5700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:35:00.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:00.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:00.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:00.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:00.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:00.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.284+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:00.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:00.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.336+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:00.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:00.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:00.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:00.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:00.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:00.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:00.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:00.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.704+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:00.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:00.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:00.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:00.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:00.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:00.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:00.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:00.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:00.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:00.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:01.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.996+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:01.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:01.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:00.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:01.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:01.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:01.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:01.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:01.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:01.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:01.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:01.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:01.495 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:35:01.496+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:35:01.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.496+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:01.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.508+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:01.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:01.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:01.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:01.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:01.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:01.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:01.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:01.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:01.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:01.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:01.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:01.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:02.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:02.008+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:02.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:02.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:02.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:02.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:02.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:02.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:02.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:02.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:02.504 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:35:02.504 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:35:02.505 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:35:02.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:02.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:02.520 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:35:02.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:02.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:02.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:02.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:02.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:02.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:02.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:02.572+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:02.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:02.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:02.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:02.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:03.803 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4140905281 2023-10-14T00:35:03.805 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:35:03.807 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243703 2023-10-14T00:35:03.807 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:35:03.807 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4140905281 ]] 2023-10-14T00:35:03.807 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4140905281 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\1\4\0\9\0\5\2\8\1 ]] 2023-10-14T00:35:03.808 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:35:04.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:35:04.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:35:04.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:35:04.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:04.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:04.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:04.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:04.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:04.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:04.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:04.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:04.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:04.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.892+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:04.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:04.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:04.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:04.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:35:05.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:35:05.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:05.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:05.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:05.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:05.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:05.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:05.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:05.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:05.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:05.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.132+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:05.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:05.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:05.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:07.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:07.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:07.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:07.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:07.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:07.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:07.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:07.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.643+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:07.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:07.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:07.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:07.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:07.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:07.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:07.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:07.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:07.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:07.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:07.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:07.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:07.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:07.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.863+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:07.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:07.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:07.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:08.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:35:08.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:08.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:08.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:08.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:08.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:08.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:08.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:08.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:08.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:08.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.099+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:08.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:08.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:08.526 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:35:08.523+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:35:08.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:08.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:08.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:08.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:08.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:08.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:08.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:08.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:08.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.791+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:08.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.791+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:08.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:08.791+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:09.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:09.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:09.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:09.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:09.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:09.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:09.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:09.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:09.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:09.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.087+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:09.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:09.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:09.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:09.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:09.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:09.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:09.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:09.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:09.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:09.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:09.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:09.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.611+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:09.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.611+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:09.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:09.611+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:10.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:10.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:10.371 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:35:10.371+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:35:10.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:10.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:10.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:10.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:10.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:10.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.447+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:10.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:10.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:10.547 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:35:10.547+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:35:10.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:10.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:10.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:10.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:10.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:10.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:10.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:10.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.891+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:10.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:10.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:10.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:12.138 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:35:12.135+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:35:12.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:12.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:12.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:12.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:12.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:12.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:12.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:12.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:12.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:12.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:12.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:12.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:13.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:13.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:13.820 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:35:13.820 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:35:13.821 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:35:13.852 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:35:13.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:13.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:13.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:13.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:13.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:13.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:13.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:13.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:13.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:13.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:13.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:13.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:13.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:13.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:13.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:13.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:13.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:13.919+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:13.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:13.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:13.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:13.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:15.173 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4140905281 2023-10-14T00:35:15.177 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:35:15.179 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243715 2023-10-14T00:35:15.179 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:35:15.179 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4140905281 ]] 2023-10-14T00:35:15.180 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4140905281 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\1\4\0\9\0\5\2\8\1 ]] 2023-10-14T00:35:15.180 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:35:18.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:35:18.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:18.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:18.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:18.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:18.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:18.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:18.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:18.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:18.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:18.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.719+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:18.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:18.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:18.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:21.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:21.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:21.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:21.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:21.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:21.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:21.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:21.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:21.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:21.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:21.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:21.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:21.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:21.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:21.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:21.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:21.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:21.531+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:21.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:21.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:21.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:21.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:22.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:22.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:23.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:23.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:23.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:23.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:23.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:23.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:23.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:23.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:35:23.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:35:23.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:23.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:23.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:23.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:23.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:23.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:23.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:23.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:25.181 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:35:25.182 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:35:25.183 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:35:25.184 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:35:26.810 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4140905281 2023-10-14T00:35:26.810 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:35:26.811 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243726 2023-10-14T00:35:26.811 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:35:26.811 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4140905281 ]] 2023-10-14T00:35:26.811 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4140905281 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\1\4\0\9\0\5\2\8\1 ]] 2023-10-14T00:35:26.812 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:35:27.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:27.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:27.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:27.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:27.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:27.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:27.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:27.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:27.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:27.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:27.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:27.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:27.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:27.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:27.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:27.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:27.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:27.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:27.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:27.671+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:27.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:27.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:27.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:27.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:30.905 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:35:30.903+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:35:31.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:31.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:31.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:31.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:31.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:31.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.159+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:31.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:31.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.175+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:31.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:31.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:35:31.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:35:31.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:31.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:31.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:31.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:31.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:31.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:31.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:31.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:31.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:31.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.315+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:31.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:31.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:33.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:33.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:33.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:33.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:33.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:33.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:33.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:33.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:33.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:33.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:33.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:33.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:33.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:33.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:33.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:33.875+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:33.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:33.875+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:33.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:33.875+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:34.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:34.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:34.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:34.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:34.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:34.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:34.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:34.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:34.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:34.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:34.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:34.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:34.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:34.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:34.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:34.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:34.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:34.707+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:34.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:34.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:34.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:34.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:35.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:35.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:35:35.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:35.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:35.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:35.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:35.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:35.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:35.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:35.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:35.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:35.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:35.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:35.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:35.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:35.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:35.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:35.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:35.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:35.691+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:35.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:35.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:35.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:35.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:36.832 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:35:36.836 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:35:36.836 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:35:36.837 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:35:37.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:35:37.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:37.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:37.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:37.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:37.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:37.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:37.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:37.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:37.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.991+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:38.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.995+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:38.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:38.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:37.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:38.307 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4140905281 2023-10-14T00:35:38.310 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:35:38.311 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243738 2023-10-14T00:35:38.312 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:35:38.312 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4140905281 ]] 2023-10-14T00:35:38.312 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4140905281 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\1\4\0\9\0\5\2\8\1 ]] 2023-10-14T00:35:38.312 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:35:39.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:39.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:39.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:39.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:39.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:39.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:39.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:39.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:39.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:39.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:39.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:39.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:39.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:39.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:39.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:39.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:39.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:39.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:39.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:39.767+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:39.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:39.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:39.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:39.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:42.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:42.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:42.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:42.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:42.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:42.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:42.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:42.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:42.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:42.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:42.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:42.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:42.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:42.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:42.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:42.787+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:42.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:42.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:42.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:42.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:43.612 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:35:43.611+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:35:43.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:43.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:35:43.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:43.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:35:43.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:43.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:44.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:44.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:44.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:44.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:44.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:44.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:44.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:44.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:44.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.043+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:44.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:44.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:44.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:35:44.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:44.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:44.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:44.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:44.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:44.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:44.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:44.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.583+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:44.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:44.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:44.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:45.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:35:45.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:45.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:45.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:45.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:45.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:45.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:45.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:45.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:45.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:45.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.527+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:45.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.527+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:45.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:45.527+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:47.225 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:35:47.223+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:35:47.997 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:35:47.995+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:35:48.315 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:35:48.316 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:35:48.318 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:35:48.331 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:35:49.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:49.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:49.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:49.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:49.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:49.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:49.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:49.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:49.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:49.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.523+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:49.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:49.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:49.669 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/4140905281 2023-10-14T00:35:49.670 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:35:49.675 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243749 2023-10-14T00:35:49.675 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:35:49.676 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/4140905281 ]] 2023-10-14T00:35:49.676 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/4140905281 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\1\4\0\9\0\5\2\8\1 ]] 2023-10-14T00:35:49.676 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:35:49.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:35:49.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:35:49.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:35:49.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:49.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:49.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:49.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:49.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:49.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:49.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:49.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:49.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:49.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.983+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:49.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:49.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:49.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:50.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:35:50.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:35:50.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:35:50.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:50.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:50.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:50.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:50.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:50.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:50.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:50.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:50.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:50.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.059+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:50.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:50.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:50.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:50.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:50.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:50.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:50.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:50.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:50.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.515+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:50.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:50.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.543+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:50.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:50.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:50.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:50.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:50.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:50.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:50.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:50.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:50.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:50.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:50.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.819+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:50.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:50.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:50.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:54.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:54.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:54.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:54.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:54.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:54.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:54.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:54.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:54.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:54.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:54.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:54.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:54.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:54.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:54.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:54.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:54.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:54.251+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:54.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:54.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:54.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:54.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:55.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:55.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:55.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:55.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:55.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:55.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:55.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:55.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:55.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:55.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:55.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:55.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:55.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:55.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:55.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:55.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:55.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:55.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:55.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:55.522+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:55.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:55.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:55.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:55.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:56.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:56.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:56.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:56.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:56.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:56.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:56.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:56.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:56.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:56.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.102+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:56.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:56.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:35:56.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:35:56.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:56.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:56.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:56.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:56.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:56.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.722+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:56.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:56.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:56.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:58.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:35:58.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:35:58.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:35:58.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:58.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:58.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:58.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:58.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:58.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:58.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.138+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:58.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:58.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:58.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:35:58.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:58.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:35:58.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:35:58.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:58.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:58.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.486+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:35:58.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:35:58.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:35:58.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:35:58.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:35:58.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:35:58.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:35:59.683 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:35:59.688 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:35:59.691 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:35:59.700 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:36:00.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:36:00.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:36:00.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:00.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:00.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:00.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:00.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:00.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:00.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:00.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:00.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:00.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:00.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.226+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:00.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:00.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:00.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:01.109 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/885920144 2023-10-14T00:36:01.110 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:36:01.111 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243761 2023-10-14T00:36:01.112 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:36:01.112 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/885920144 ]] 2023-10-14T00:36:01.112 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/885920144 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\4\1\4\0\9\0\5\2\8\1 ]] 2023-10-14T00:36:01.112 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/885920144 2023-10-14T00:36:02.081 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.078+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da74aea240 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.081 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.078+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da756106e0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.082 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.078+0000 7f3dc7f64640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da757ae9c0 handle_get_mirror_peers: failed to retrieve mirror peers: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.083 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.078+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da758b2160 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.083 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.078+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da74aeb380 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.083 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.078+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da7587bce0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.083 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.078+0000 7f3dc7f64640 -1 librbd::mirror::GetInfoRequest: 0x55da74aea780 handle_get_mirror_image: failed to retrieve mirroring state: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.083 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.078+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da74ca8580 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.098 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.094+0000 7f3dc7f64640 -1 librbd::ImageWatcher: 0x55da74a60600 image watch failed: 94396754648064, (107) Transport endpoint is not connected 2023-10-14T00:36:02.098 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.094+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da74a60600 handle_error: handle=94396754648064: (107) Transport endpoint is not connected 2023-10-14T00:36:02.102 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.098+0000 7f3dc7f64640 -1 librbd::watcher::RewatchRequest: 0x55da74a3ce60 handle_unwatch client blocklisted 2023-10-14T00:36:02.102 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.098+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da74a60600 handle_rewatch: client blocklisted 2023-10-14T00:36:02.123 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.118+0000 7f3dc7f64640 -1 librbd::ImageWatcher: 0x55da75257800 image watch failed: 94396756606976, (107) Transport endpoint is not connected 2023-10-14T00:36:02.123 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.118+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da75257800 handle_error: handle=94396756606976: (107) Transport endpoint is not connected 2023-10-14T00:36:02.123 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.118+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.123 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.118+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75794400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.124 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.118+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.124 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.118+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da748f5a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.124 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.118+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.124 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.118+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da748f5c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.124 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.118+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.125 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.118+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75153880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.125 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.122+0000 7f3dc7f64640 -1 librbd::watcher::RewatchRequest: 0x55da748579a0 handle_unwatch client blocklisted 2023-10-14T00:36:02.126 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.122+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da75257800 handle_rewatch: client blocklisted 2023-10-14T00:36:02.132 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.130+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.133 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.130+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75794400 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.211 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.206+0000 7f3dc7f64640 -1 librbd::ImageWatcher: 0x55da7506e000 image watch failed: 94396754642944, (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.211 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.206+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da7506e000 handle_error: handle=94396754642944: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.211 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.206+0000 7f3dc7f64640 -1 librbd::ImageWatcher: 0x55da75358300 image watch failed: 94396754647040, (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.212 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.206+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da75358300 handle_error: handle=94396754647040: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.244 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.242+0000 7f3dc7f64640 -1 librbd::watcher::RewatchRequest: 0x55da74791810 handle_unwatch client blocklisted 2023-10-14T00:36:02.245 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.242+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da7506e000 handle_rewatch: client blocklisted 2023-10-14T00:36:02.245 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.242+0000 7f3dc7f64640 -1 librbd::watcher::RewatchRequest: 0x55da749573b0 handle_unwatch client blocklisted 2023-10-14T00:36:02.245 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.242+0000 7f3dc7f64640 -1 librbd::Watcher: 0x55da75358300 handle_rewatch: client blocklisted 2023-10-14T00:36:02.286 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.282+0000 7f3dc7f64640 -1 librbd::image::OpenRequest: failed to retrieve initial metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.287 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.282+0000 7f3dc7f64640 -1 librbd::ImageState: 0x55da75794000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.287 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.282+0000 7f3dc8765640 -1 librbd::ImageWatcher: 0x55da75358f00 image watch failed: 94396761590784, (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.287 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.282+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da75358f00 handle_error: handle=94396761590784: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:02.384 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.378+0000 7f3dc8765640 -1 librbd::watcher::RewatchRequest: 0x55da73d3a910 handle_unwatch client blocklisted 2023-10-14T00:36:02.384 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:02.378+0000 7f3dc8765640 -1 librbd::Watcher: 0x55da75358f00 handle_rewatch: client blocklisted 2023-10-14T00:36:02.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:02.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:02.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:02.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:02.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:02.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:02.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:02.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:02.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:02.634+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:02.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:02.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:02.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:02.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:03.033 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/885920144 until 2023-10-14T01:36:02.321297+0000 (3600 sec) 2023-10-14T00:36:03.044 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc7f64640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.044 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc7f64640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da757ae680 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.045 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da7587b8c0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.046 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc8765640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.046 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc7f64640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.046 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc7f64640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.047 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da757ae4e0 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.047 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da7566b4a0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.047 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc7f64640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da757ae8f0 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.047 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da753826e0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.047 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc8765640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da757ae820 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.048 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da75383600 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.048 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.049 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da750931e0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.049 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.042+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da758af0c0 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.049 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.046+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.049 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.046+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.049 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.046+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da7587b8c0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.050 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.046+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da74dc0840 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.050 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.046+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da74f3fb80 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.050 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.046+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da758b8c80 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.050 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.046+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da740c0840 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.050 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.046+0000 7f3dc7f64640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74844ba0 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.051 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.046+0000 7f3dc7f64640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74c708a0 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.076 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.074+0000 7f3dc7f64640 -1 librbd::SnapshotCreateRequest: failed to notify unquiesce: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.076 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.074+0000 7f3dc7f64640 -1 librbd::mirror::snapshot::CreatePrimaryRequest: 0x55da757ae340 handle_create_snapshot: failed to create mirror snapshot: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.077 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.074+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da75382420 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.085 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.082+0000 7f3dc7f64640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.086 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.082+0000 7f3dc7f64640 -1 librbd::io::AioCompletion: 0x55da753826e0 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.086 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.082+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da74dc0ec0 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.086 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.082+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74c89500 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.102 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.098+0000 7f3dc8765640 -1 librbd::image::RefreshRequest: failed to retrieve mutable metadata: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.103 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.098+0000 7f3dc8765640 -1 librbd::io::AioCompletion: 0x55da7566e000 fail: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.103 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.098+0000 7f3dc8765640 -1 librbd::exclusive_lock::PreReleaseRequest: 0x55da758b8780 handle_set_require_lock: failed to set lock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.112 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:36:03.113 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/885920144 2023-10-14T00:36:03.244 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:36:03.242+0000 7f3dc8765640 -1 librbd::managed_lock::ReleaseRequest: 0x55da74d91920 handle_unlock: failed to unlock: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:36:03.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:36:03.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:03.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:03.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:03.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:03.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:03.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:03.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:03.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:03.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:03.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:03.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.514+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:03.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:03.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:03.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:03.622 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:36:03.614+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:36:03.984 INFO:tasks.workunit.client.0.smithi191.stderr:listed 36 entries 2023-10-14T00:36:04.020 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/885920144 2023-10-14T00:36:04.021 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:36:05.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:05.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:05.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:05.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:05.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:05.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:05.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:05.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:05.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:05.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:05.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:05.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:05.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:05.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:06.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:06.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:06.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:06.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:06.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:06.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:06.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:06.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.718+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:06.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.718+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:06.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.718+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:06.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.718+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:06.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.718+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:06.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:06.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:06.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:06.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:06.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:06.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:06.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:06.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.950+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:06.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.966+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:06.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.974+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:06.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:06.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:06.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:08.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:08.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:36:08.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:08.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:08.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:08.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:08.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:08.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:08.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:08.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:08.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:08.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:08.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:08.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:08.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:08.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:08.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:08.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:08.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:08.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:08.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:08.694+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:08.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:08.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:09.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:09.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:09.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:09.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:09.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:09.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:09.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:09.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:09.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:09.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:09.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:09.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:09.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:09.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:09.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:09.946+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:10.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:10.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:10.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:10.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:10.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:10.418+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:11.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:11.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:11.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:11.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:11.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:11.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:11.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:11.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:11.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:11.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:11.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:11.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:11.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:11.274+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:11.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:11.274+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:11.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:11.274+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:11.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:11.274+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:11.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:11.274+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:11.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:11.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:14.028 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:36:14.033 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:36:14.035 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:36:14.045 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:36:14.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:36:14.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:14.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:14.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:14.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:14.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:14.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:14.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:14.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:14.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:14.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:14.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.638+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:14.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:14.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:14.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:15.453 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/885920144 2023-10-14T00:36:15.454 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:36:15.454 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243775 2023-10-14T00:36:15.455 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:36:15.455 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/885920144 ]] 2023-10-14T00:36:15.455 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/885920144 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\8\8\5\9\2\0\1\4\4 ]] 2023-10-14T00:36:15.455 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:36:16.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:36:16.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:16.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:16.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:16.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:16.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:16.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:16.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:16.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:16.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:16.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.226+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:16.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:16.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:16.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:16.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:16.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:16.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:16.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:16.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:16.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:16.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:16.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:16.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:16.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.670+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:16.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:16.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:16.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:18.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:36:18.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:18.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:18.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:18.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:18.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:18.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:18.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:18.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:18.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:18.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:18.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.422+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:18.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:18.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:18.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:19.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:19.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:19.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:19.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:19.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:19.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:19.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:19.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:19.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:19.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:19.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:19.250+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:19.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:19.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:19.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:19.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:20.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:20.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:20.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:20.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:20.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:20.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:20.190 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:36:20.186+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:36:20.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:20.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:20.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:20.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:20.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:20.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:21.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:36:21.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:21.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:21.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:21.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:21.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:21.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:21.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:21.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:21.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:21.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:21.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.242+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:21.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:21.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:22.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:21.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:36:22.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:36:22.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:22.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:22.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:22.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:22.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:22.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:22.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:22.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:22.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.082+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:22.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.082+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:22.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.082+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:22.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:36:22.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:36:22.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:22.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:22.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:22.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:22.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:22.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:22.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:22.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:22.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.190+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:22.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:22.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:22.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:23.389 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:36:23.378+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:36:25.456 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:36:25.457 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:36:25.457 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:36:25.462 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:36:25.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:25.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:26.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:26.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:26.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:26.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:26.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:26.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:26.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:26.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:26.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:26.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:26.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:26.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:26.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:26.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:26.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:26.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:26.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:26.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:26.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:26.030+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:26.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:26.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:26.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:26.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:26.875 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/885920144 2023-10-14T00:36:26.876 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:36:26.882 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243786 2023-10-14T00:36:26.882 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:36:26.882 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/885920144 ]] 2023-10-14T00:36:26.882 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/885920144 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\8\8\5\9\2\0\1\4\4 ]] 2023-10-14T00:36:26.883 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:36:28.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:36:28.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:28.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:28.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:28.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:28.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:28.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:28.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:28.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:28.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:28.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:28.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.234+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:28.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:28.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:28.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:28.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:28.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:28.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:28.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:28.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:28.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:28.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:28.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.510+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:28.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.514+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:28.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:28.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:28.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:29.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:29.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:29.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:29.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:29.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:29.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.474+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:29.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.486+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:29.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:29.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:29.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:29.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:29.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:29.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:29.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:29.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:29.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:29.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:29.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:29.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.826+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:29.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:29.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:29.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:30.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:30.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:30.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:30.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:30.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:30.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:30.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:30.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:30.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:30.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:30.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:30.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:30.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:30.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:30.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:30.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:30.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:30.130+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:30.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:30.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:30.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:30.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:31.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:31.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:36:31.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:31.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:31.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:31.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:31.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:31.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:31.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:31.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:31.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:31.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:31.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:31.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:31.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:31.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:31.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:31.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:31.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:31.746+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:31.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:31.766+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:32.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:32.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:32.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:32.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:32.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:32.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:32.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:32.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:32.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:32.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:33.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:33.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:33.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:33.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:33.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:33.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:33.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:33.074+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:33.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:33.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:33.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:33.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:34.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:34.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:34.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:34.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:34.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:34.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:34.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:34.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:34.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:34.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:34.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:34.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:34.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:34.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:34.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:34.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:34.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:34.182+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:34.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:34.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:34.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:34.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:34.216 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:36:34.210+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:36:35.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:36:35.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:35.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:35.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:35.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:35.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:35.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:35.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:35.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:35.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:35.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.306+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:35.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:35.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:35.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:36.883 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:36:36.884 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:36:36.885 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:36:36.900 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:36:37.176 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:36:37.166+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:36:37.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:37.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:37.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:37.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:37.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:37.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:37.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:37.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:37.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:37.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:37.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:37.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:37.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:37.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:37.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:37.934+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:37.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:37.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:38.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:38.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:38.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:38.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:38.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:38.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:38.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:38.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:38.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:38.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.114+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:38.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:38.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:38.194 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/885920144 2023-10-14T00:36:38.194 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:36:38.198 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243798 2023-10-14T00:36:38.198 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:36:38.199 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/885920144 ]] 2023-10-14T00:36:38.199 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/885920144 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\8\8\5\9\2\0\1\4\4 ]] 2023-10-14T00:36:38.199 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:36:38.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:38.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:38.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:38.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:38.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:38.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:38.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:38.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:38.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.498+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:38.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.498+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:38.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.502+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:38.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:38.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:38.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:36:38.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:38.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:38.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:38.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:38.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:38.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:38.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:38.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:38.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.754+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:38.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:38.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:38.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:39.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:39.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:39.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:39.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:39.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:39.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:39.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:39.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:39.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:39.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.282+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:39.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:39.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:39.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:39.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:39.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:39.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:39.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:39.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:40.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:40.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:40.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:40.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:40.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:40.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:40.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:40.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:40.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:40.090+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:40.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:40.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:40.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:40.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:44.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:44.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:44.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:44.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:44.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:44.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:44.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:44.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:44.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:44.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.841+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:44.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.853+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:44.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.873+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:44.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:44.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:44.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:45.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:45.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:45.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:45.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:45.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:45.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:45.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:45.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:45.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:45.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.289+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:45.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:45.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:45.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:45.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:46.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:46.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:46.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:46.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:46.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:46.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:46.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:46.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:46.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:46.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.137+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:46.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:46.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:46.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:46.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:46.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:46.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:46.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:46.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:46.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:46.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:46.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:46.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:46.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.837+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:46.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:46.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:46.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:47.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:47.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:47.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:47.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:47.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:47.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:47.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:47.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:47.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:47.733+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:47.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:47.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:47.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:47.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:48.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:48.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:48.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:48.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:48.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:48.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:48.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:48.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:48.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:48.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:48.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:48.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:48.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:48.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:48.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:48.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:48.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:48.137+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:48.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:48.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:48.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:48.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:48.201 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:36:48.201 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:36:48.206 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:36:48.219 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:36:49.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:36:49.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:49.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:49.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:49.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:49.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:49.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:49.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:49.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:49.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:49.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:49.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.421+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:49.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:49.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:49.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:36:49.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:49.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:49.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:49.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:49.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:49.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:49.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:49.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:49.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:49.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:49.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.505+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:49.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:49.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:49.604 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/885920144 2023-10-14T00:36:49.615 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:36:49.616 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243809 2023-10-14T00:36:49.616 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:36:49.616 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/885920144 ]] 2023-10-14T00:36:49.617 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/885920144 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\8\8\5\9\2\0\1\4\4 ]] 2023-10-14T00:36:49.617 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:36:49.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:49.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:49.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:49.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:49.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:49.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:49.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:49.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:49.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:49.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.761+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:49.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:49.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:49.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:51.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:36:51.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:36:51.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:51.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:51.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:51.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:51.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:51.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:51.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:51.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:51.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.497+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:51.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:51.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.565+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:51.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:51.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:51.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:51.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:51.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:51.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:51.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:51.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:51.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:52.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:52.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:52.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:52.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:52.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:52.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:52.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:52.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:52.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:52.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:52.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:52.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:52.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:52.669+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:52.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:52.681+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:52.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:52.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:52.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:52.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:57.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:57.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:57.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:57.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:57.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:57.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:57.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:57.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:57.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:57.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:57.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.565+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:57.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:57.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:57.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:36:57.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:36:57.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:36:57.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:57.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:57.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:57.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:57.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:36:57.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:57.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:57.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:57.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.869+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:57.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:36:57.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:57.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:36:59.641 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:36:59.641 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:36:59.642 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:36:59.642 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:36:59.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:59.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:59.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:59.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:59.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:59.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:59.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:59.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.773+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:36:59.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:36:59.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:36:59.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:36:59.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:59.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:59.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:36:59.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.797+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:59.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.797+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:36:59.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:36:59.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:36:59.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:36:59.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:36:59.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:01.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:01.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:01.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:01.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:01.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:01.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:01.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:01.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:01.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:01.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:01.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:01.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:01.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:01.097+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:01.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:01.117+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:01.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:01.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:01.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:01.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:01.164 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/885920144 2023-10-14T00:37:01.164 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:37:01.165 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243821 2023-10-14T00:37:01.165 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:37:01.166 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/885920144 ]] 2023-10-14T00:37:01.166 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/885920144 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\8\8\5\9\2\0\1\4\4 ]] 2023-10-14T00:37:01.166 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:37:02.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:02.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:02.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:02.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:02.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:02.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:02.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:02.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:02.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:02.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:02.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:02.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:02.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:02.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:02.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:02.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:02.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:02.281+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:02.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:02.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:02.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:02.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:03.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:03.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:03.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:03.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:03.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:03.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:03.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:03.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:03.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:03.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.177+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:03.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:03.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:03.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:37:03.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:03.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:03.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:03.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:03.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:03.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:03.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:03.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.853+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:03.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.877+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:03.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:03.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:03.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:04.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:04.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:04.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:04.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:04.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:04.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:04.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:04.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:04.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.397+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:04.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.401+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:04.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:04.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:04.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:04.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:04.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:04.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:04.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:04.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:04.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:04.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.741+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:04.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:04.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:07.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:07.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:07.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:07.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:07.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:07.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:07.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.113+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:07.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:37:07.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:07.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:07.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:07.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:37:07.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:07.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:07.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:07.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:07.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:07.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:07.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:07.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:07.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:07.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.665+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:07.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.665+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:07.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.665+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:07.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:07.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:07.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:07.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:07.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:07.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:07.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:07.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.917+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:07.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.925+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:07.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:07.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:07.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:08.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:08.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:08.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:08.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:08.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:08.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:08.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.125+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:08.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:08.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:08.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:08.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:08.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:08.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:08.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:08.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:08.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:08.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.917+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:08.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.929+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:08.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:08.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:08.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:09.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:37:09.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:37:09.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:37:09.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:09.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:09.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:09.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:09.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:09.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:09.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:09.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:09.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:09.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.357+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:09.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:09.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:09.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:09.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:09.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:09.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:10.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:10.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:10.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:10.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:10.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:10.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:10.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:10.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:10.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:10.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:10.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:10.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:10.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:10.069+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:10.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:10.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:10.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:10.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:11.177 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:37:11.184 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:37:11.185 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:37:11.188 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:37:12.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:12.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:37:12.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:12.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:37:12.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:12.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:12.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:12.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:12.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:12.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:12.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:12.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:12.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:12.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:12.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:12.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:12.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:12.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:12.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:12.205+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:12.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:12.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:12.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:12.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:12.492 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3900852568 2023-10-14T00:37:12.492 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:37:12.493 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243832 2023-10-14T00:37:12.493 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:37:12.493 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3900852568 ]] 2023-10-14T00:37:12.493 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3900852568 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\8\8\5\9\2\0\1\4\4 ]] 2023-10-14T00:37:12.493 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/3900852568 2023-10-14T00:37:13.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:13.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:13.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:13.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:13.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:13.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.725+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:13.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:13.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:13.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:13.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:13.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:13.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:13.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:13.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:14.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:14.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:14.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:14.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:14.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.033+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:14.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:37:14.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:14.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:14.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:14.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:14.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:14.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:14.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:14.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:14.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:14.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.153+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:14.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:37:14.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:14.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:14.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:14.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:15.102 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/3900852568 until 2023-10-14T01:37:14.382213+0000 (3600 sec) 2023-10-14T00:37:15.139 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:37:15.140 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/3900852568 2023-10-14T00:37:16.229 INFO:tasks.workunit.client.0.smithi191.stderr:listed 37 entries 2023-10-14T00:37:16.294 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/3900852568 2023-10-14T00:37:16.294 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:37:16.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:37:16.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:37:16.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:16.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:16.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:16.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:16.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:16.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:16.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:16.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.617+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:16.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.637+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:16.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.645+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:16.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:16.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:16.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:18.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:18.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:18.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:18.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:18.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:18.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:18.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:18.629+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:18.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:18.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:18.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:18.637+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:19.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:37:19.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:37:19.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:19.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:19.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:19.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:19.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:19.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:19.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:19.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:19.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:19.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.957+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:19.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:19.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:19.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:20.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:37:20.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:20.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:20.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:20.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:20.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:20.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:20.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:20.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:20.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:20.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.109+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:20.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:20.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:20.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:20.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:20.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:20.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.541+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:20.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.541+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:20.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.549+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:20.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:20.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:20.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:21.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:21.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:37:21.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:21.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:37:21.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:21.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:21.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:21.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:21.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:21.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:21.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:21.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:21.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:21.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:21.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:21.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:21.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:21.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:21.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:21.317+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:21.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:21.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:21.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:21.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:24.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:37:24.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:37:24.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:24.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:24.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:24.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:24.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:24.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:24.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:24.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:24.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:24.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.773+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:24.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:24.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:24.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:26.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:26.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:26.326 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:37:26.327 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:37:26.331 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:37:26.340 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:37:26.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:37:26.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:37:26.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:26.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:26.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:26.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:26.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:26.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:26.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:26.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:26.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:26.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.665+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:26.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:26.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:26.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:26.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:26.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:26.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:26.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:26.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:26.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:26.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.789+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:26.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:26.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:26.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:26.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:26.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:26.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:26.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:27.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:27.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:27.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:27.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.049+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:27.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:27.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:27.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:37:27.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:27.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:27.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:27.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:27.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:27.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:27.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:27.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:27.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:27.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.745+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:27.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:27.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:27.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:27.922 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3900852568 2023-10-14T00:37:27.923 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:37:27.924 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243847 2023-10-14T00:37:27.925 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:37:27.925 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3900852568 ]] 2023-10-14T00:37:27.925 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3900852568 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\9\0\0\8\5\2\5\6\8 ]] 2023-10-14T00:37:27.925 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:37:28.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:28.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:28.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:28.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:28.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:28.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:28.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:28.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:28.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:28.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:28.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:28.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:28.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:28.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:28.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:28.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:28.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:28.976+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:28.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:28.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:28.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:28.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:29.048 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:37:29.044+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:37:29.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:29.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:29.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:29.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:29.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:29.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:29.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:29.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:29.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:29.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:29.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:29.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:29.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:29.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:29.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:29.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:29.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:29.424+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:29.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:29.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:29.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:29.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:31.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:31.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:37:31.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:31.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:31.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:31.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:31.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:31.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:31.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:31.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:31.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:31.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:31.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:31.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:31.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:31.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:31.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:31.624+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:31.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:31.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:31.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:31.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:31.950 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:37:31.944+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:37:32.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:32.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:32.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:32.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:32.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:32.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:32.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:32.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:32.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:32.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.228+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:32.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:37:32.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:37:32.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:32.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:32.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:32.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:32.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:32.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:32.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:32.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:32.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:32.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:32.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:32.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:32.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:32.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:32.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:33.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:33.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:33.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:33.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:33.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:33.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:33.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:33.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:33.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:33.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:33.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:33.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:33.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:33.888+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:33.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:33.896+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:33.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:33.904+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:36.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:36.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:36.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:36.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:36.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:36.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:36.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:36.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:36.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:36.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:36.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:36.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:36.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:36.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:36.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:36.452+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:37.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:37.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:37.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:37.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:37.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:37.844+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:37.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:37.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:37.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:37.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:37.932 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:37:37.932 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:37:37.935 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:37:37.948 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:37:37.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:37.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:38.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:38.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:38.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:38.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:38.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:38.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:38.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:38.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:38.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:38.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:38.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:38.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:38.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:38.060+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:38.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:38.080+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:38.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:38.100+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:38.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:38.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:38.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:38.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:39.185 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:37:39.184+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:37:39.458 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3900852568 2023-10-14T00:37:39.460 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:37:39.461 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243859 2023-10-14T00:37:39.462 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:37:39.462 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3900852568 ]] 2023-10-14T00:37:39.462 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3900852568 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\9\0\0\8\5\2\5\6\8 ]] 2023-10-14T00:37:39.462 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:37:39.546 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:37:39.544+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:37:39.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:39.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:39.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:39.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:39.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:39.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:39.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:39.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:39.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:39.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:39.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:39.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:39.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:39.640+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:39.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:39.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:39.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:39.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:42.005 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:37:42.004+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:37:45.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:45.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:45.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:45.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:45.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:45.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:45.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.632+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:45.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:45.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:45.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:45.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:45.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:45.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:45.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:45.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:45.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:45.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:45.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:45.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.852+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:45.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.852+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:45.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:45.852+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:46.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:46.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:46.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:46.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:46.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:46.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:46.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:46.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:46.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.932+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:46.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.932+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:46.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.932+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:46.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.932+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:46.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:37:46.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:37:46.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:46.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:46.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:46.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:46.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:46.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:46.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:46.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:46.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:46.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:47.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.016+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:47.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.016+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:47.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.016+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:47.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:37:47.725 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:37:47.724+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:37:47.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:47.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:47.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:47.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:47.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:47.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:47.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:47.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:47.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.824+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:47.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:47.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:47.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:48.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:48.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:48.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:48.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:48.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:48.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:48.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:48.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:48.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:48.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:48.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:48.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:48.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:48.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:48.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:48.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:48.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:48.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:48.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:48.760+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:48.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:48.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:48.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:48.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:49.468 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:37:49.469 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:37:49.474 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:37:49.475 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:37:50.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:50.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:50.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:50.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:50.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:50.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:50.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:50.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:50.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:50.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:50.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:50.440+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:50.803 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3900852568 2023-10-14T00:37:50.803 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:37:50.803 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243870 2023-10-14T00:37:50.804 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:37:50.804 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3900852568 ]] 2023-10-14T00:37:50.804 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3900852568 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\9\0\0\8\5\2\5\6\8 ]] 2023-10-14T00:37:50.804 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:37:51.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:51.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:51.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:51.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:51.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:51.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:51.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:51.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.056+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:51.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:51.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.068+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:51.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:51.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:51.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:37:51.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:51.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:51.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:51.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:51.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:51.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:51.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:51.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:51.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:51.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:51.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:51.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:37:51.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:51.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:51.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:51.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:51.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:51.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:51.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:51.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:51.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.656+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:51.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.656+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:51.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:51.656+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:52.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:52.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:52.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:52.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:52.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:52.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:52.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:52.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:52.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:52.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:52.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:52.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:52.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:52.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:52.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:52.732+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:52.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:52.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:52.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:52.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:53.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:53.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:53.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:53.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:53.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:53.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:53.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:53.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:53.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:53.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:53.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:53.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:53.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:53.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:53.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:53.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:53.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:53.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:53.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:53.816+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:53.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:53.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:53.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:53.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:55.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:55.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:55.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:55.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:55.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:55.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:55.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:55.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:55.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:55.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:55.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:55.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:55.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:55.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:55.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:55.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:55.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:55.340+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:55.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:55.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:55.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:55.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:56.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:37:56.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:56.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:56.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:56.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:56.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:56.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:56.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:56.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:56.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:56.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.988+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:56.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:37:56.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:56.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:37:58.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:37:58.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:58.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:58.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:58.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:58.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:58.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:58.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:37:58.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:58.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:58.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:37:58.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:37:58.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:58.331 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:37:58.328+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:37:58.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:58.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:37:59.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:59.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:37:59.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:59.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:37:59.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:59.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:37:59.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:59.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:37:59.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:59.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:37:59.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:59.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:59.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:59.072+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:59.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:59.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:37:59.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:59.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:37:59.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:37:59.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:00.008 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.000+0000 7f3dc8f66640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.008 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.000+0000 7f3dc8f66640 -1 librbd::ImageState: 0x55da7476a100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.009 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.004+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.009 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.004+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec5600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.009 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.008+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.010 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.008+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751ad880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.016 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.016+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.016 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.016+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da74ec4d00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.048 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.048+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.048 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.048+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da747cc200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.063 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.060+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.063 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.060+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a8200 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.064 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.060+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.065 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.060+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75148500 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.079 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.076+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.079 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.076+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da752a8680 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.083 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.080+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.083 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.080+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565d600 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.124 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.124+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.124 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.124+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.125 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.124+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f0a80 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.125 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.124+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da751f1780 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.125 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.124+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.125 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.124+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75169700 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.131 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.124+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.132 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.124+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565d900 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:00.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:00.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:00.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:00.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:00.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:00.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:00.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.160+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:00.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:00.210 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.208+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.211 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.208+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.211 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.208+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565ce00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.211 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.208+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da7565d000 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.211 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.208+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.212 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.208+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f5a00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.216 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.216+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.216 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.216+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f5c00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.223 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.220+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.223 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.220+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da748f5f00 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.223 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.220+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.224 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.220+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75213100 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.224 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.220+0000 7f3dc8765640 -1 librbd::image::OpenRequest: failed to retrieve name: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.224 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T00:38:00.220+0000 7f3dc8765640 -1 librbd::ImageState: 0x55da75212880 failed to open image: (108) Cannot send after transport endpoint shutdown 2023-10-14T00:38:00.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:00.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:00.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:00.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:00.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.460+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:00.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.460+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:00.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:00.460+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:00.825 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:38:00.836 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:38:00.844 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:38:00.848 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:38:01.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:01.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:01.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:01.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:01.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:01.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:01.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:01.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:01.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:01.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:01.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:01.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:01.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:01.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:01.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:01.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:01.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:01.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:01.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:01.208+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:01.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:01.208+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:01.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:01.208+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:02.518 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3900852568 2023-10-14T00:38:02.520 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:38:02.521 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243882 2023-10-14T00:38:02.522 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:38:02.522 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3900852568 ]] 2023-10-14T00:38:02.522 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3900852568 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\9\0\0\8\5\2\5\6\8 ]] 2023-10-14T00:38:02.522 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:38:04.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:38:04.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:04.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:04.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:04.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:04.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:04.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:04.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:04.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:04.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:04.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.120+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:04.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:04.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:04.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:38:04.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:04.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:04.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:04.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:04.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:04.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:04.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:04.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:04.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:04.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.328+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:04.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:04.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:04.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:06.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:38:06.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:06.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:06.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:06.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:06.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:06.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:06.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:06.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:06.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:06.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:06.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:06.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:08.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:08.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:08.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:08.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:08.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:08.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:08.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:08.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:08.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:08.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:08.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:08.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:08.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:08.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:08.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:08.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:08.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:08.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:08.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:08.764+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:08.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:08.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:08.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:08.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:09.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:09.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:09.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:09.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:09.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:09.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:09.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:09.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.652+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:09.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:09.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:09.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:09.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:09.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:09.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:09.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:09.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:09.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.708+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:09.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:09.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:12.523 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:38:12.520+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:38:12.523 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:38:12.532 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:38:12.528+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:38:12.536 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:38:12.548 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:38:12.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:38:12.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:12.569 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:38:12.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:12.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:12.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:12.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:12.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:12.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:12.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:12.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:12.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.656+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:12.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.656+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:12.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:12.656+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:13.250 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:38:13.248+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:38:13.979 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/3900852568 2023-10-14T00:38:13.980 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:38:13.981 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243893 2023-10-14T00:38:13.981 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:38:13.981 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/3900852568 ]] 2023-10-14T00:38:13.982 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/3900852568 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\9\0\0\8\5\2\5\6\8 ]] 2023-10-14T00:38:13.982 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:38:16.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:38:16.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:16.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:16.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:16.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:16.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:16.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:16.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.284+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:16.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.284+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:16.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.284+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:16.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:16.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:38:16.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:16.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:16.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:16.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:16.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:16.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:16.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:16.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.372+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:16.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.372+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:16.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.388+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:16.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:16.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:16.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:16.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:16.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:16.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:16.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:16.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:16.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:16.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:17.212 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:38:17.212+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:38:17.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:17.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:17.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:17.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:17.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:17.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:17.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:17.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:17.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:17.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.412+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:17.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:17.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:17.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:17.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:17.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:17.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:17.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:17.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:17.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:17.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.964+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:17.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:17.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:17.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:19.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:19.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:19.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:19.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:19.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:19.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:19.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.135+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:19.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:19.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:19.480 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:38:19.479+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:38:19.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:19.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:19.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:19.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:19.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:19.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:19.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:19.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:19.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.575+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:19.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:19.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:19.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:19.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:19.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:19.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:19.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:19.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:19.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:19.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.919+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:19.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:19.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:19.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:19.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:19.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:19.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:20.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:20.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:20.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:20.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:20.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:20.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:20.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:20.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:20.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.135+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:20.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:20.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:20.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:20.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:20.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:20.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:20.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:20.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:20.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:20.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:20.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:20.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.767+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:20.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.767+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:20.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:20.767+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:21.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:21.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:21.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:21.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:21.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:21.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:21.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:21.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:21.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:21.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:21.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:21.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:21.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:21.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:21.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:21.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:21.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:21.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:21.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:21.715+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:21.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:21.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:21.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:21.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:23.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:23.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:23.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:23.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:23.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:23.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:23.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:23.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:23.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:23.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:23.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:23.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:23.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:23.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:23.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:23.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:23.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:23.963+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:23.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:23.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:23.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:23.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:23.982 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:38:23.982 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:38:23.982 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:38:23.982 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:38:25.486 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:38:25.487 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:38:25.488 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243905 2023-10-14T00:38:25.488 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:38:25.488 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:38:25.488 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\3\9\0\0\8\5\2\5\6\8 ]] 2023-10-14T00:38:25.488 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist add 172.21.15.191:0/2424388657 2023-10-14T00:38:26.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:26.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:26.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:26.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:26.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:26.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:26.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:26.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:26.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:26.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:26.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:26.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:26.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:26.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:27.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:38:27.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:27.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:27.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:27.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:27.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:27.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:27.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:27.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:27.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:27.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.243+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:27.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:27.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:27.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:27.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:27.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:27.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:27.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:27.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:27.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.499+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:27.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:27.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.523+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:27.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:27.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:27.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:27.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:27.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:27.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:27.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:27.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:27.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:27.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:27.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.751+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:27.862 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:38:27.859+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:38:27.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:27.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:27.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:27.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:27.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:27.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:27.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:27.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:27.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.963+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:27.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:27.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:27.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:28.102 INFO:tasks.workunit.client.0.smithi191.stderr:blocklisting 172.21.15.191:0/2424388657 until 2023-10-14T01:38:27.421744+0000 (3600 sec) 2023-10-14T00:38:28.155 INFO:tasks.workunit.client.0.smithi191.stderr:+ ceph osd blocklist ls 2023-10-14T00:38:28.180 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep -q 172.21.15.191:0/2424388657 2023-10-14T00:38:28.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:28.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:28.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:28.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:28.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:28.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:28.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:28.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:28.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:28.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:28.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:28.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:28.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:28.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:28.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:28.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:28.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:28.415+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:29.295 INFO:tasks.workunit.client.0.smithi191.stderr:listed 38 entries 2023-10-14T00:38:29.353 INFO:tasks.workunit.client.0.smithi191.stderr:+ PREV_CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:38:29.354 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:38:30.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:30.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:30.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:30.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:30.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:30.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:30.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:30.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:30.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.335+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:30.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:30.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:30.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:38:30.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:30.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:30.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:30.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.483+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:30.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:30.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:30.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.511+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:30.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.511+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:30.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.511+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:30.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.511+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:30.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:30.511+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:31.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:38:31.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:31.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:31.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:31.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:31.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:31.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:31.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:31.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:31.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:31.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.335+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:31.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:31.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:31.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:34.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:34.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.483+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:34.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.483+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:34.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:34.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:34.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:34.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:34.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.535+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:34.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:34.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.567+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:34.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:34.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:34.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:38:34.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:34.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:34.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:34.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:34.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:34.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:34.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:34.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:34.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:34.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.711+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:34.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:34.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:34.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:34.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:34.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:34.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:34.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:34.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:34.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:34.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:34.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.823+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:34.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:34.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:34.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:35.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:35.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:35.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:35.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:35.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:35.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:35.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:35.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:35.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:35.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.179+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:35.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:35.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:35.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:35.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:35.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:35.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:35.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:35.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:35.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:35.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:35.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:35.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:35.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:35.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:35.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:35.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:39.363 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:38:39.374 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:38:39.376 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:38:39.376 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:38:40.566 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:38:40.566 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:38:40.567 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243920 2023-10-14T00:38:40.567 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:38:40.568 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:38:40.568 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:38:40.568 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:38:43.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:43.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:43.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:43.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:43.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:43.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:43.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:43.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:43.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:43.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:44.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:44.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:38:44.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:44.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:44.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:44.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:44.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:44.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:44.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:44.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.219+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:44.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:44.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:44.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:44.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:44.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:44.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:44.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:44.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:44.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:44.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.755+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:44.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:44.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:44.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:45.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:45.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:38:45.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:45.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:45.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:45.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:45.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:45.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:45.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:45.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:45.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:45.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.643+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:45.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:45.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:46.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:46.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:46.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:46.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:46.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:46.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:46.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:46.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:46.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:46.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:46.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:46.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:46.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:46.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:46.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:46.935+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:46.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:46.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:46.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:46.943+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:46.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:46.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:46.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:46.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:47.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:47.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:47.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:47.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:47.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:47.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:47.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:47.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:47.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:47.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:47.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:47.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:47.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:47.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:47.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:47.327+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:47.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:47.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:47.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:47.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:48.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:48.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:48.731 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:38:48.727+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:38:48.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:48.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:48.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:48.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:48.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:48.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:48.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:48.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:48.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:48.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:48.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:48.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:48.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:48.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:48.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:48.767+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:48.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:48.779+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:48.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:48.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:48.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:48.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:49.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.027+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:49.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:49.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:49.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:49.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:49.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:49.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:49.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:49.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:49.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:49.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:49.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:49.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:49.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:49.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:49.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:49.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:38:49.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:49.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:49.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:49.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:49.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:49.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:49.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:49.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:49.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:49.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.923+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:49.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:49.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:49.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:50.568 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:38:50.569 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:38:50.569 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:38:50.578 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:38:51.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:38:51.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:38:51.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:51.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:51.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:51.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:51.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:51.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:51.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:51.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:51.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.591+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:51.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.663+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:51.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:51.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:51.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:51.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:38:51.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:38:51.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:51.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:51.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:51.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:51.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:51.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:51.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:51.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:51.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.719+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:51.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:51.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:51.817 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:38:51.818 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:38:51.818 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243931 2023-10-14T00:38:51.819 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:38:51.819 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:38:51.819 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:38:51.819 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:38:54.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:54.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:54.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:54.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:54.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.263+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:54.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:54.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:54.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:54.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:54.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:54.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:54.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:54.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:54.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:54.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.795+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:54.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:54.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:54.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:55.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:55.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:55.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:55.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:55.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:55.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:55.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:55.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:55.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:55.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.159+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:55.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.159+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:55.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.159+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:55.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:55.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:56.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:55.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:56.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:56.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:56.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:56.015+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:56.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:56.015+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:56.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:56.015+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:56.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:56.015+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:56.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:56.015+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:38:57.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:57.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:57.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:57.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:57.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:57.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:57.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.195+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:57.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:57.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:57.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:57.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:57.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:57.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:57.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:57.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.263+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:57.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:38:57.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:57.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:57.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:57.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:57.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:57.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:57.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:57.295+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:59.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:59.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:38:59.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:59.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:38:59.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:59.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:38:59.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:59.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:38:59.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:59.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:38:59.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:59.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:38:59.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:59.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:38:59.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:59.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:38:59.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:59.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:38:59.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:59.231+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:38:59.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:59.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:38:59.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:38:59.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:00.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:00.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:00.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:00.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:00.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:00.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:00.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:00.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:00.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:00.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:00.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:00.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:00.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.227+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:00.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:00.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:00.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:00.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:00.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:00.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:00.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:00.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:00.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:00.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.759+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:00.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:00.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:00.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:00.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:00.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:00.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:00.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:00.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:00.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:00.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:00.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.935+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:00.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.955+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:00.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:00.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:00.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:01.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:01.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:01.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:01.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:01.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:01.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:01.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:01.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:01.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:01.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.099+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:01.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:01.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:01.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:01.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:01.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:01.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:01.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:01.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:01.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:01.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.315+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:01.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:01.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:01.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:01.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:01.823 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:39:01.823 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:39:01.823 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:39:01.836 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:39:02.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:02.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:02.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:02.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:02.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:02.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:02.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:02.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:02.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:02.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:02.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:02.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:02.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:02.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:02.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:02.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:02.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:02.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:02.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:02.675+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:02.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:02.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:02.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:02.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:03.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:03.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:03.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:03.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:03.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:03.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:03.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:03.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.098+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:03.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:03.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:03.249 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:39:03.249 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:39:03.250 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243943 2023-10-14T00:39:03.250 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:39:03.250 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:39:03.251 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:39:03.251 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:39:03.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:03.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:03.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:03.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:03.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:03.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:03.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:03.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:03.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:03.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.838+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:03.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.854+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:03.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:03.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:03.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:04.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:04.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:04.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:04.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:04.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:04.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:04.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:04.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:04.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:04.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:04.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:04.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:04.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:04.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:04.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:04.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:04.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:04.710+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:04.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:04.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:04.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:04.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:05.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:05.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:05.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:05.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:05.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:05.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:05.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:05.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:05.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:05.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:05.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:05.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:05.630 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:39:05.626+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:39:05.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.634+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:05.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:05.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:05.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:07.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:07.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:07.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:07.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:07.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:07.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:07.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:07.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:07.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:07.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:07.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:07.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:07.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:07.666+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:07.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:07.666+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:07.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:07.666+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:07.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:07.666+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:07.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:07.666+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:09.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:09.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:09.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:09.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:09.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:09.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:09.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:09.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:09.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:09.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:09.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.678+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:09.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:09.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:09.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:10.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:10.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:10.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:10.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:10.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:10.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:10.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:10.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:10.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:10.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:10.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:10.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:10.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:10.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:10.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:10.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:10.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:10.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:10.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:10.398+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:10.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:10.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:11.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:11.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:11.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:11.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:11.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:11.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:11.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:11.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:11.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:11.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:11.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:11.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:11.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:11.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:11.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:11.494+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:11.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:11.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:12.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:12.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:12.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:12.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:12.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:12.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:12.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:12.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:12.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:12.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.258+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:12.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:12.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:12.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:12.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:12.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:12.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:12.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:12.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:12.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:12.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:12.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:12.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:12.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:12.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.302+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:12.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.302+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:12.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.302+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:12.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.302+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:12.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:12.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:12.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:12.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:12.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:12.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:12.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:12.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:12.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:12.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.498+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:12.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.502+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:12.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:12.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:12.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:13.255 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:39:13.255 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:39:13.255 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:39:13.258 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:39:13.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:13.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:13.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:13.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:13.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:13.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:13.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:13.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.666+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:13.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:13.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.702+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:13.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:13.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:13.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:13.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:13.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:13.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:13.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:13.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:13.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:13.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:14.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:14.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.018+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:14.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:14.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:14.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:14.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:14.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:14.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:14.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:14.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:14.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:14.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:14.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.290+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:14.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.298+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:14.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.298+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:14.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:14.298+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:14.779 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:39:14.784 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:39:14.786 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243954 2023-10-14T00:39:14.786 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:39:14.786 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:39:14.786 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:39:14.786 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:39:15.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:15.882+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:15.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:15.882+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:15.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:15.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:15.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:15.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:15.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:15.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:15.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:15.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:15.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:15.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:15.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:15.934+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:15.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:15.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:15.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:15.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:16.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:16.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:16.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:16.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:16.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:16.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:16.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:16.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:16.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:16.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:16.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:16.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:16.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:16.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:16.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:16.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:16.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:16.638+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:16.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:16.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:16.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:16.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:17.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:17.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:17.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:17.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:17.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:17.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:17.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:17.356 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:39:17.354+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:39:17.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:17.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:17.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:17.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:17.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:17.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:17.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:17.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:17.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:17.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.458+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:17.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:17.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:17.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:18.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:18.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:18.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:18.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:18.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:18.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:18.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:18.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:18.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.326+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:18.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:18.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:18.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:18.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:18.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:18.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:18.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:18.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:18.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:18.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:18.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:18.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:18.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.462+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:18.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:18.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:19.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:19.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:19.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:19.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:19.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:19.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:19.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:19.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:19.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:19.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:19.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:19.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.250+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:19.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:19.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:19.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:20.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:20.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:20.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:20.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.090+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:20.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:20.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:20.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:20.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:20.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:20.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:20.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.302+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:20.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:20.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.342+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:20.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.342+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:20.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:20.342+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:22.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:21.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:22.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:21.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:22.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:22.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:22.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:22.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:22.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:22.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:22.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.070+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:22.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:22.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:22.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:22.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:22.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:22.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:22.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:22.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:22.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:22.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.494+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:22.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:22.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:22.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:22.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:22.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:22.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:22.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:22.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:22.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:22.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:22.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:22.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:22.586+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:23.380 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:39:23.374+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:39:24.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:24.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:24.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:24.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:24.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:24.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.146+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:24.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:24.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:24.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:24.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:24.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:24.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:24.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:24.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:24.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:24.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:24.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.486+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:24.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:24.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:24.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:24.787 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:39:24.788 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:39:24.788 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:39:24.797 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:39:25.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:25.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:25.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:25.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:25.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:25.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:25.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:25.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:25.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:25.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:25.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:25.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.218+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:25.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:25.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:25.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:25.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:25.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:25.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:25.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:25.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:25.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:25.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:25.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:25.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.378+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:25.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:25.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:25.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:25.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:25.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.950+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:25.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.974+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:25.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:25.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:25.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:26.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:26.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:26.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:26.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:26.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:26.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:26.270 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:39:26.270 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:39:26.271 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243966 2023-10-14T00:39:26.271 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:39:26.271 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:39:26.272 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:39:26.272 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:39:26.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:26.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:26.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:26.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:26.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.310+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:26.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:26.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:26.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:26.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:26.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:26.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:26.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:26.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:26.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:26.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.418+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:26.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:26.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:27.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:27.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:27.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:27.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:27.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:27.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:27.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:27.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:27.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:27.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:27.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:27.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:27.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:27.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:27.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:27.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:27.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:27.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:27.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:27.486+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:27.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:27.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:27.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:27.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:28.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:28.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:28.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:28.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:28.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:28.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:28.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:28.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:28.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:28.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.390+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:28.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:28.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:28.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:28.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:28.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:28.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:28.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:28.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:28.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:28.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.858+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:28.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.858+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:28.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.858+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:28.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:28.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:28.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:28.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:28.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:28.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:28.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:28.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:29.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:29.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:29.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:29.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:29.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:29.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:29.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:29.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:29.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:29.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:29.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:29.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:29.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:29.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:29.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.294+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:29.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:29.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:29.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:29.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:29.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:29.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:29.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:29.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:29.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:29.502+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:29.839 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:39:29.834+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:39:29.856 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:39:29.850+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:39:30.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:30.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:30.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:30.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:30.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:30.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:30.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:30.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:30.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.398+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:30.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:30.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:30.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:30.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:30.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:30.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:30.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:30.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:30.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:30.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:31.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:31.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:31.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:31.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:31.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:31.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.022+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:31.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:31.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:31.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:31.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:31.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:31.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:31.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:31.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.706+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:31.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.706+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:31.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.706+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:31.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.706+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:31.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.706+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:31.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:31.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:31.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:31.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:31.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:31.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:31.798+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:34.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:34.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:34.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:34.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:34.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:34.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:34.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:34.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:34.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:34.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:34.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.694+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:34.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:34.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:34.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:34.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:34.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:34.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:34.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:34.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:34.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:34.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:34.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:34.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.738+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:34.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.742+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:34.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.758+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:34.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:34.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:34.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:36.294 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:39:36.296 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:39:36.300 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:39:36.323 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:39:36.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:36.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:36.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:36.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:36.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:36.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:36.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:36.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:36.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:36.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:36.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.914+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:36.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:36.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:36.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:37.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:37.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:37.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:37.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:37.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:37.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:37.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:37.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:37.747 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:39:37.748 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:39:37.749 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243977 2023-10-14T00:39:37.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:39:37.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:39:37.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:39:37.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:39:37.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:37.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:37.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:37.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:37.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:37.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:37.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:37.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:37.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:37.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:37.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:37.766+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:37.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:37.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:37.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:37.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:39.365 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:39:39.362+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:39:41.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:41.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:41.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:41.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:41.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:41.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:41.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:41.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:41.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:41.294+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:41.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:41.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:41.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:41.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:41.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:41.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:41.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:41.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:41.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:41.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:41.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:41.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:41.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:41.382+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:42.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:42.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:42.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:42.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:42.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:42.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:42.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:42.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:42.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:42.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:42.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.638+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:42.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:42.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:42.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:42.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:42.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:42.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:42.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:42.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:42.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:43.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:43.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:43.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:43.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:43.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:43.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:43.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:43.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:43.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:43.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:43.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:43.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.358+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:43.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:43.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:43.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:45.054 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:39:45.050+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:39:45.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:45.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:45.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:45.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:45.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:45.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:45.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:45.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.246+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:45.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.266+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:45.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:45.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.274+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:45.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:45.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:45.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:45.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:45.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:45.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:45.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:45.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:45.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:45.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.546+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:45.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:45.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:45.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:45.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:45.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:45.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:45.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:45.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:45.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:45.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:45.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:45.822+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:47.751 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:39:47.751 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:39:47.752 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:39:47.762 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:39:47.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:47.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:47.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:47.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:47.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:47.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:47.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.858+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:47.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.898+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:47.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.930+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:47.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:47.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:47.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:47.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:47.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:47.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:47.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:47.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:47.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:48.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:48.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:48.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:48.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.058+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:48.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:48.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:48.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:48.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:48.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:48.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:48.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:48.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:48.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.114+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:48.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:39:48.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:39:48.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:48.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:48.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:48.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:48.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:48.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:48.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:48.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:48.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:48.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:48.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.210+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:48.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:48.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:48.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:49.313 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:39:49.313 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:39:49.313 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697243989 2023-10-14T00:39:49.314 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:39:49.314 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:39:49.314 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:39:49.314 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:39:50.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:50.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:50.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:50.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:50.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:50.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:50.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:50.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:50.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:50.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:50.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:50.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:50.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:50.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:50.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:50.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:50.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:50.813+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:52.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:39:52.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:39:52.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:39:52.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:52.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:52.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:52.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:52.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:52.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:52.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:52.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.493+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:52.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:52.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:52.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:53.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:53.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:39:53.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:53.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:53.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:53.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:53.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:53.889+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:53.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:53.913+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:55.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:55.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:55.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:55.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:39:55.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:55.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:55.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:55.229+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:55.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:55.245+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:55.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:55.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:55.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:55.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:59.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:59.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:39:59.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:59.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:39:59.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:59.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:39:59.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:59.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:39:59.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:59.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:39:59.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:59.085+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:39:59.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:59.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:39:59.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:39:59.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:39:59.319 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:39:59.320 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:39:59.328 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:39:59.328 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:40:00.754 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:40:00.754 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:40:00.755 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244000 2023-10-14T00:40:00.755 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:40:00.755 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:40:00.755 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:40:00.756 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:40:01.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:01.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:01.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:01.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:01.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:01.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:01.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:01.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:01.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:01.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:01.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:01.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:01.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:01.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:01.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:01.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:01.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:01.329+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:01.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:01.373+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:01.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:01.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:01.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:01.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:02.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:02.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:02.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:02.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:02.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.201+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:02.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:02.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:02.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:02.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:02.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:02.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:02.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:02.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:02.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:02.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:02.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.717+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:02.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:02.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:02.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:03.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:40:03.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:40:03.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:03.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:03.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:03.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:03.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:03.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:03.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:03.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.157+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:03.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:03.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:03.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:40:03.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:03.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:03.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:03.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:03.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:03.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:03.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:03.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:03.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.265+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:03.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:03.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:03.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:03.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:03.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:03.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:03.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:03.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:03.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:03.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:03.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:03.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:03.833+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:04.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:04.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:04.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:04.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:04.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:04.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:04.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:04.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:04.030 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:40:04.025+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:40:04.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:04.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:04.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:04.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:04.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:04.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:04.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:04.053+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:04.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:04.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:04.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:04.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:05.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:05.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:05.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:05.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:05.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:05.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:05.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:05.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:05.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:05.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:05.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:05.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:05.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:05.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:05.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:05.493+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:05.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:05.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:05.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:05.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:06.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:06.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:06.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:06.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:06.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:06.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:06.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:06.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:06.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:06.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:06.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:06.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:06.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:06.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:06.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:06.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:06.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:06.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:06.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:06.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:07.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:06.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:07.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:07.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:07.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:07.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:07.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:07.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:07.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:07.009+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:08.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:08.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:08.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:08.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:08.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:08.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:08.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:08.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:08.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:08.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:08.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:08.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:08.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:08.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:08.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:08.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:08.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:08.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:08.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:08.349+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:08.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:08.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:08.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:08.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:09.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:09.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:09.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:09.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:09.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:09.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:09.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:09.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:09.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:09.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:09.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:09.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:09.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:09.857+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:10.762 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:40:10.762 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:40:10.768 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:40:10.780 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:40:11.091 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:40:11.085+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:40:12.113 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:40:12.119 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:40:12.120 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244012 2023-10-14T00:40:12.120 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:40:12.121 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:40:12.121 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:40:12.121 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:40:18.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:18.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:18.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:18.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:18.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:18.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:18.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:18.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:18.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:18.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:18.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:18.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:18.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:18.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:18.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:18.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:18.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:18.233+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:18.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:18.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:18.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:18.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:19.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:19.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:19.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:19.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:19.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:19.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:19.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:19.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.549+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:19.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:19.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:19.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:19.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:19.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:19.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:19.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:19.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:19.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:20.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:20.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:20.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:20.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:20.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:20.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:20.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:20.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:20.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:20.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:20.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:20.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:20.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:20.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.437+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:20.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.437+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:20.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.465+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:20.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:20.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:20.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:40:20.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:20.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:20.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:20.489 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:40:20.485+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:40:20.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:20.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:20.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:20.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:40:20.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:40:20.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:20.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:20.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:20.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:20.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:20.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:20.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:20.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:20.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:20.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.717+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:20.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:20.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:20.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:22.133 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:40:22.133 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:40:22.140 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:40:22.140 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:40:23.331 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:40:23.332 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:40:23.345 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244023 2023-10-14T00:40:23.345 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:40:23.345 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:40:23.345 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:40:23.346 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:40:25.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:25.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:25.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:25.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:25.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:25.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:25.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:25.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:25.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:25.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.389+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:25.651 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:40:25.645+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:40:25.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:25.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:25.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:25.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:25.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:25.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:25.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:25.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.757+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:25.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:25.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:25.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:25.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:25.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:25.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:25.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:25.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:25.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:26.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:26.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:26.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:26.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.025+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:26.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:26.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:26.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:26.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:26.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.321+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:26.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:26.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:26.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:26.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:26.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:26.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:26.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:26.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:26.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:26.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:26.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:27.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:27.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:27.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:27.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:27.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:27.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:27.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:27.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:27.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:27.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:27.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:27.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:27.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:27.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:27.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:27.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:27.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:27.529+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:27.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:27.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:28.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:28.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:28.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:28.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:28.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:28.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:28.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:28.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:28.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:28.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:28.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:28.933+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:28.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:28.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:28.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:28.969+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:28.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:28.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:28.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:28.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:29.118 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:40:29.113+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:40:29.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:29.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:29.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:29.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:29.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:29.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:29.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:29.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:29.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:29.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:29.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:29.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:29.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:29.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:29.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:29.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:29.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:29.289+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:29.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:29.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:29.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:29.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:30.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:40:30.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:30.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:30.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:30.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:30.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:30.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:30.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:30.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:30.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:30.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.833+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:30.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:30.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:30.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:31.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:31.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:31.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:31.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:31.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:31.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:31.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:31.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:31.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:31.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:31.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:31.337+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:31.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:31.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:31.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:31.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:33.347 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:40:33.349 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:40:33.354 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:40:33.355 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:40:33.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:33.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:33.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:33.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:33.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:33.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:33.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:33.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:33.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.525+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:33.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:33.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:33.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:33.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:33.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:33.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:33.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:33.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:33.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:33.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.805+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:33.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:33.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:33.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:34.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:34.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:34.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:34.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:34.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:34.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:34.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:34.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:34.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:34.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:34.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:34.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:34.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:34.209+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:34.738 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:40:34.738 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:40:34.739 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244034 2023-10-14T00:40:34.739 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:40:34.740 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:40:34.740 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:40:34.740 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:40:37.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:37.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:37.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:37.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:37.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:37.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:37.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:37.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:37.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:37.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:37.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:37.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:37.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:37.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:37.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:37.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:37.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:37.277+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:37.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:37.293+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:37.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:37.301+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:38.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:38.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:38.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:38.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:38.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:38.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:38.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:38.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:38.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:38.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:38.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:38.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:38.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:38.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:38.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:38.508+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:38.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:38.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:38.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:38.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:39.279 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:40:39.272+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:40:40.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:40.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:40.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:40.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:40.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:40.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:40.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:40.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:40.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:40.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:40.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:40.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:40.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:40.032+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:40.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:40.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:40.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:40.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:42.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:42.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:42.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:42.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:42.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:42.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:42.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:42.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:42.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:42.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:42.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:42.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:42.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:42.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:42.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:42.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:42.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:42.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:42.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:42.880+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:42.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:42.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:42.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:42.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:43.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:43.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:43.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:43.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:43.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:43.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:43.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:43.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:43.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:43.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:43.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:43.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:43.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:43.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:43.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:43.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:43.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:43.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:44.109 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:40:44.104+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:40:44.745 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:40:44.747 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:40:44.751 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:40:44.755 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:40:45.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:40:45.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:45.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:45.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:45.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:45.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:45.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:45.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:45.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:45.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:45.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.820+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:45.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:45.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:45.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:46.196 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:40:46.196 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:40:46.197 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244046 2023-10-14T00:40:46.197 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:40:46.197 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:40:46.197 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:40:46.198 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:40:48.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:48.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:48.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:48.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:48.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:48.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:48.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:48.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:48.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.200+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:48.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:48.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:48.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:48.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:48.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:48.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:48.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:48.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:48.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:48.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:48.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:48.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.384+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:48.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:48.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:48.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:48.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:48.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:48.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:48.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:48.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:48.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:48.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.776+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:48.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:48.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:48.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:49.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:49.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:49.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:49.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:49.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:49.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:49.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:49.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:49.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:49.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.244+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:49.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:49.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:49.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:49.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:49.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:49.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:49.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:49.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.860+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:49.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.860+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:49.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:49.860+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:52.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:40:52.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:40:52.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:40:52.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:52.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:52.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:52.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:52.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:52.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:52.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:52.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:52.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:52.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.908+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:52.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:52.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:52.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:52.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:52.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:53.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:53.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:53.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:53.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.032+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:53.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:53.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:53.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:53.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:53.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:53.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:53.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:53.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:53.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:53.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:53.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.700+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:53.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:53.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:53.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:40:53.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:40:53.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:53.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:53.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:53.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:53.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:53.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:53.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:53.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:53.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:53.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.832+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:53.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:53.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:53.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:55.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:40:55.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:40:55.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:40:55.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:55.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:55.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:55.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:55.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:55.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:55.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:55.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:55.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:55.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.676+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:55.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:55.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:55.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:56.204 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:40:56.261 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:40:56.261 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:40:56.261 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:40:56.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:56.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:56.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:56.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:56.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:56.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:57.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:57.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:57.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:57.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:57.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:57.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:57.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:57.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:57.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:57.060+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:57.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:57.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:57.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:57.064+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:57.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:57.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:57.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:57.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:40:57.644 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:40:57.644 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:40:57.645 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244057 2023-10-14T00:40:57.645 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:40:57.645 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:40:57.646 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:40:57.646 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:40:58.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:58.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:40:58.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:58.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:40:58.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:58.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:40:58.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:58.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:40:58.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:58.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:40:58.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:58.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:40:58.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:58.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:40:58.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:58.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:40:58.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:58.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:40:58.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:58.400+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:40:58.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:58.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:40:58.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:40:58.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:00.144 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:41:00.140+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:41:00.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:41:00.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:00.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:00.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:00.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:00.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:00.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:00.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:00.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:00.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:00.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.796+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:00.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:00.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:00.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:01.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:01.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:01.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:01.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:01.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:01.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:01.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.316+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:01.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:01.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:01.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:01.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:01.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:01.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:01.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:01.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:01.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:01.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:01.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.400+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:01.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:01.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:02.152 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:41:02.152+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:41:03.233 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:41:03.232+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:41:03.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:03.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:03.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:03.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:03.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:03.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:03.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:03.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:03.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:03.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:03.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:03.596+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:03.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:03.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:03.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:03.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:05.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:41:05.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:41:05.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:05.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:05.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:05.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:05.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:05.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:05.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:05.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:05.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:05.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.328+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:05.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:05.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:05.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:07.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:07.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:07.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:07.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:07.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:07.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:07.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.380+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:07.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.388+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:07.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:07.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:07.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:07.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:07.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:07.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:07.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:07.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:07.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:07.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:07.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:07.657 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:41:07.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:07.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.656+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:07.663 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:41:07.678 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:41:07.687 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:41:07.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:07.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:07.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:07.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:07.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:07.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:07.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:08.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:08.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:41:08.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:08.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:41:08.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:08.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:08.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:08.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:08.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:08.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:08.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:08.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:08.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:08.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:08.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:08.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:08.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:08.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:08.964 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:41:08.966 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:41:08.967 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244068 2023-10-14T00:41:08.967 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:41:08.968 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:41:08.968 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:41:08.968 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:41:10.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:10.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:10.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:10.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:10.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:10.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:10.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:10.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:10.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:10.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.616+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:10.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:10.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:10.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:41:10.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:41:10.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:10.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:10.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:10.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:10.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:10.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:10.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:10.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:10.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:10.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.728+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:10.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:10.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:10.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:11.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:11.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:11.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:11.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:11.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:11.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:11.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:11.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:12.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:11.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:12.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:12.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:12.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:12.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.032+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:12.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:12.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:12.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:12.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:12.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:12.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:12.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:12.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:12.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:12.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:12.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:12.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.548+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:12.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:12.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:12.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:12.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:12.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:12.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:12.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:12.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:12.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:12.840+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:13.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:13.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:13.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:13.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:13.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:13.496+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:15.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:15.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:41:15.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:15.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:15.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:15.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:15.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:15.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:15.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:15.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:15.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:15.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:15.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:15.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:15.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:15.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:15.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:15.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:15.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:15.676+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:15.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:15.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:15.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:15.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:16.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:16.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:41:16.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:16.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:41:16.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:16.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:16.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:16.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:16.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:16.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:16.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:16.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:16.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:16.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:16.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:16.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:16.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:16.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:16.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:16.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:16.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:16.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:18.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:41:18.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:41:18.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:41:18.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:18.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:18.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:18.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:18.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:18.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:18.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:18.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:18.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:18.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.436+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:18.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:18.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:18.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:18.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:18.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:18.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:18.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:18.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:18.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:18.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:18.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.564+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:18.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:18.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:18.980 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:41:18.980 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:41:18.991 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:41:18.991 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:41:20.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:20.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:20.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:20.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:20.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:20.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:20.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:20.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:20.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:20.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:20.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:20.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:20.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:20.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:20.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:20.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:20.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:20.100+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:20.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:20.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:20.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:20.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:20.409 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:41:20.415 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:41:20.417 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244080 2023-10-14T00:41:20.417 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:41:20.417 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:41:20.417 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:41:20.417 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:41:21.581 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:41:21.580+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:41:21.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:21.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:21.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:21.720+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:23.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:23.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:23.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:23.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:23.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:23.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:23.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:23.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:23.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:23.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:23.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:23.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:23.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:23.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:23.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:23.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:23.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:23.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:23.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:23.928+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:23.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:23.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:23.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:23.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:25.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:41:25.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:25.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:25.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:25.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:25.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:25.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:25.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:25.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:25.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:25.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.616+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:25.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:25.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:25.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:25.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:25.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:25.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:25.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:25.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:25.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:25.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:25.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:25.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.824+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:25.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:25.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:25.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:27.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:27.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:27.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:27.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:27.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:27.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:27.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:27.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:27.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:27.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:27.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:27.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:27.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:27.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:27.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:27.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:27.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:27.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:28.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:27.996+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:28.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:27.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:28.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:27.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:28.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:41:28.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:28.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:28.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:28.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:28.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:28.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:28.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.524+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:28.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:28.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:28.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:41:28.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:28.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:28.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:28.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:28.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:28.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:28.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:28.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:28.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:28.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.748+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:28.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:28.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:28.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:28.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:28.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:28.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:28.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:28.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:28.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:28.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:28.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.964+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:28.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:28.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:28.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:29.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:29.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:41:29.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:29.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:29.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:29.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:29.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:29.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:29.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:29.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:29.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:29.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:29.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:29.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:29.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:29.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:29.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:29.172+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:29.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:29.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:29.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:29.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:30.445 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:41:30.449 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:41:30.456 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:41:30.457 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:41:31.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:31.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:31.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:31.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:31.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:31.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:31.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:31.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:31.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:31.587+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:31.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:31.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:31.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:31.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:32.090 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:41:32.090 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:41:32.091 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244092 2023-10-14T00:41:32.091 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:41:32.092 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:41:32.092 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:41:32.092 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:41:32.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:32.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:32.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:32.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:32.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:32.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:32.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:32.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:32.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:32.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:32.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:32.539+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:32.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:32.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:32.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:32.551+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:33.346 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:41:33.343+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:41:35.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:35.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:35.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:35.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:35.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:35.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:35.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:41:35.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:35.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:35.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:35.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:35.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:35.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:35.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:35.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:35.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:35.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.887+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:35.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:35.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:35.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:36.779 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:41:36.775+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:41:36.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:36.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:36.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:36.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:36.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:36.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:36.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:36.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:36.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:36.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:36.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:36.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:36.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:36.907+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:36.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:36.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:36.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:36.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:37.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:37.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:37.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:37.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:37.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:37.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:37.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:37.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:37.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:37.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:37.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:37.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:37.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:37.579+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:37.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:37.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:37.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:37.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:37.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:37.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:38.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:38.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:38.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:38.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:38.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:38.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:38.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:38.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:38.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:38.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:38.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:38.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:38.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:38.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:39.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:39.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:39.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:39.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:39.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:39.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:39.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:39.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:39.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.287+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:39.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:39.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:41:39.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:41:39.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:41:39.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:39.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:39.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:39.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:39.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:39.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:39.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:39.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:39.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:39.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.379+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:39.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:39.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:39.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:39.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:41.235 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:41:41.231+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:41:41.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:41.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:41.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:41.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:41.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:41.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:41.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:41.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:41.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:41.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:41.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:41.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:41.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:41.567+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:41.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:41.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:41.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:41.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:42.094 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:41:42.094 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:41:42.095 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:41:42.099 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:41:43.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:43.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:43.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:43.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:43.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:43.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:43.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:43.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:43.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:43.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:43.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:43.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:43.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:43.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:43.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:43.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:43.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:43.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:43.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:43.307+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:43.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:43.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:43.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:43.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:43.606 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:41:43.607 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:41:43.608 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244103 2023-10-14T00:41:43.609 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:41:43.609 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:41:43.609 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:41:43.609 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:41:44.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:44.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:44.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:44.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:44.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:44.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:44.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:44.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:44.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:44.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:44.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:44.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:44.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:44.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:44.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:44.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:44.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:44.447+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:44.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:44.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:44.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:44.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:44.859 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:41:44.855+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:41:45.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:45.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:45.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:45.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:45.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:45.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:45.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:45.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:45.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:45.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:45.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:45.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:45.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:45.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:45.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:45.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:45.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:45.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:46.141 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:41:46.139+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:41:49.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:49.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:49.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:49.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:49.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:49.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:49.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:49.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:49.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:49.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:49.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:49.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:49.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:49.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:49.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:49.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:49.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:49.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:49.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:49.455+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:49.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:49.455+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:49.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:49.455+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:50.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:50.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:41:50.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:50.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:50.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:50.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:50.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:50.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:50.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:50.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:50.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:50.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:50.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:50.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:50.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:50.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:50.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:50.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:50.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:50.559+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:50.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:50.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:50.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:50.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:51.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:51.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:51.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:51.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:51.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:51.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:51.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:51.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:51.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:51.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:51.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:51.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:51.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:51.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:51.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:51.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:51.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:51.379+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:51.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:51.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:51.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:51.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:52.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:52.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:52.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:52.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:52.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:52.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:52.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:52.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:52.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:52.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:52.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:52.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:52.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:52.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:52.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:52.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:52.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:52.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:52.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:52.323+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:52.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:52.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:52.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:52.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:52.903 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:41:52.899+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:41:52.903 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:41:52.899+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:41:53.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:53.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:53.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:53.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:53.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:53.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:53.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:53.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:53.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:53.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:53.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:53.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:53.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:53.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:53.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:53.491+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:53.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:53.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:53.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:53.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:53.617 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:41:53.617 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:41:53.618 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:41:53.653 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:41:54.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:54.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:55.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:55.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:55.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:55.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:55.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:55.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:55.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:55.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.067+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:55.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:55.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:55.093 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:41:55.093 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:41:55.095 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244115 2023-10-14T00:41:55.095 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:41:55.095 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:41:55.095 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:41:55.096 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:41:55.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:55.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:55.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:55.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.395+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:55.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:55.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:57.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:57.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:57.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:57.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:57.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:57.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:57.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:57.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:57.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:57.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:57.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:57.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:57.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:57.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:57.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:57.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:57.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:57.159+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:57.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:57.175+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:57.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:57.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:57.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:57.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:41:59.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:59.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:59.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.291+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:59.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:41:59.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:41:59.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:59.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:59.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:59.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:59.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:59.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:59.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:59.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:41:59.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:41:59.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:41:59.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:41:59.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:41:59.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:41:59.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:41:59.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:41:59.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:41:59.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.855+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:41:59.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:41:59.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:41:59.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:01.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:01.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:01.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:01.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:01.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:01.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:01.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:01.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:01.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:01.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:01.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:01.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:01.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:01.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:01.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:01.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:01.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:01.651+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:01.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:01.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:03.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:03.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:03.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:03.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:03.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:03.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:03.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:03.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:03.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:03.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:03.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.119+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:03.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:03.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:03.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:42:03.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:03.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:03.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:03.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:03.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:03.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:03.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:03.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.343+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:03.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.367+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:03.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:03.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:03.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:42:03.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:03.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:03.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:03.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:03.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:03.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:03.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:03.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:03.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.475+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:03.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:03.496 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:42:03.491+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:42:03.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:03.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:03.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:03.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:03.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:03.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:03.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:03.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:03.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:03.947+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:04.446 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:42:04.443+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:42:04.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:04.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:04.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:04.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:04.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:04.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:04.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:04.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:04.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:04.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:04.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:04.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:04.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:04.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:04.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:04.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:04.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:04.831+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:04.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:04.839+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:04.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:04.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:04.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:04.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:05.098 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:42:05.100 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:42:05.104 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:42:05.104 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:42:06.562 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:42:06.568 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:42:06.576 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244126 2023-10-14T00:42:06.577 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:42:06.577 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:42:06.577 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:42:06.577 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:42:07.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:07.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:07.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:07.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:07.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:07.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:07.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:07.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:07.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:07.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:07.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:07.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:07.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:07.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:07.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:07.639+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:07.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:07.639+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:07.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:07.639+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:08.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:07.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:42:08.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:08.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:08.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:08.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:08.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:08.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:08.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:08.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:08.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:08.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:08.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:08.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:08.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:08.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:08.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:08.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:08.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:08.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:08.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:08.079+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:08.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:08.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:08.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:08.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:11.297 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:42:11.295+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:42:12.741 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:42:12.739+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:42:13.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:42:13.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:42:13.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:13.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:13.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:13.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:13.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:13.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:13.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:13.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:13.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:13.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.227+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:13.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:13.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:13.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:13.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:13.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:13.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:13.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:13.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:13.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:13.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:13.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:14.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:13.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:14.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:14.007+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:14.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:14.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:14.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:14.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:14.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:14.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:14.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:14.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:14.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:14.023+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:14.405 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:42:14.399+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:42:15.020 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:42:15.015+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:42:16.590 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:42:16.590 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:42:16.591 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:42:16.591 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:42:17.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:42:17.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:17.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:17.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:17.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:17.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:17.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:17.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:17.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.159+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:17.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:17.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.199+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:17.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:17.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:17.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:42:17.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:42:17.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:17.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:17.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:17.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:17.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:17.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:17.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:17.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:17.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:17.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:17.223+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:17.931 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:42:17.932 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:42:17.932 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244137 2023-10-14T00:42:17.933 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:42:17.933 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:42:17.933 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:42:17.933 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:42:18.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:18.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:18.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:18.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:18.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:18.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:18.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:18.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:18.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:18.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:18.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:18.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:18.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:18.619+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:18.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:18.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:18.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:18.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:19.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:42:19.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:19.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:19.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:19.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:19.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:19.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:19.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:19.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:19.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:19.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.255+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:19.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:19.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:19.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:19.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:19.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:19.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:19.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:19.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.783+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:19.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:19.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:19.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:20.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:42:20.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:20.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:20.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:20.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:20.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:20.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:20.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:20.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:20.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:20.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:20.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.587+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:20.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:20.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:20.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:23.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:23.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:23.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:23.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:23.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:23.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:23.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:23.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:23.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:23.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:23.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:23.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:23.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:23.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:23.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:23.430+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:23.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:23.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:23.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:23.458+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:23.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:23.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:23.687 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:42:23.682+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:42:24.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:24.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:24.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:24.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:24.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:24.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:24.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:24.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:24.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:24.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:24.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:24.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:24.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:24.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:24.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:24.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:24.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:24.130+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:24.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:24.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:24.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:24.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:25.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:25.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:25.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:25.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:25.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:25.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:25.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:25.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:25.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:25.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:25.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:25.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:25.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:25.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:26.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:26.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:26.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:26.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:26.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:26.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:26.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:26.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:26.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:26.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:26.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:26.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:26.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:26.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:26.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:26.530+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:26.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:26.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:26.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:26.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:27.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:27.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:27.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:27.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:27.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:27.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:27.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:27.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:27.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:27.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.662+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:27.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:42:27.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:27.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:27.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:27.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:27.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:27.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:27.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:27.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:27.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.750+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:27.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:27.750+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:27.942 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:42:27.943 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:42:27.957 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:42:27.975 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:42:28.194 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:42:28.190+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:42:28.343 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:42:28.338+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:42:29.297 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:42:29.298 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:42:29.298 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244149 2023-10-14T00:42:29.298 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:42:29.298 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:42:29.299 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:42:29.299 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:42:29.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:29.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:30.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:29.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:30.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:30.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:30.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:30.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:30.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:30.082+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:30.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:30.082+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:30.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:30.082+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:31.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:31.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:31.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:31.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:31.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:31.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:31.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:31.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.490+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:31.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:31.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:31.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:31.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:31.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:31.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.822+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:31.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:31.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:31.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:32.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:42:32.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:42:32.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:32.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:32.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:32.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:32.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:32.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.882+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:32.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:32.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:32.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:32.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:32.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.994+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:33.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:33.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:32.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:34.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:34.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:34.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:34.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:34.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:34.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:34.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:34.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:34.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:34.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:34.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:34.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:34.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:34.602+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:34.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:34.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:34.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:34.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:36.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:36.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:36.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:36.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:36.762 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:42:36.758+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:42:37.906 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:42:37.902+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:42:38.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:38.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:42:38.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:38.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:38.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:38.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:38.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:38.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:38.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:38.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:38.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:38.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:38.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:38.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:38.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:38.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:38.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:38.526+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:38.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:38.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:38.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:38.542+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:39.311 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:42:39.311 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:42:39.313 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:42:39.314 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:42:40.177 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:42:40.170+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:42:40.612 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:42:40.613 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:42:40.614 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244160 2023-10-14T00:42:40.614 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:42:40.615 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:42:40.615 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:42:40.615 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:42:41.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:41.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:41.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:41.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:41.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:41.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:41.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:41.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:41.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:41.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:41.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.462+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:41.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:41.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:41.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:43.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:43.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:43.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:43.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:43.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:43.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:43.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:43.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:43.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:43.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:43.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.902+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:43.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:43.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:43.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:44.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:44.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:44.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:44.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:44.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:44.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:44.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:44.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:44.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:44.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:44.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:44.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:44.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:44.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:44.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:44.402+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:44.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:44.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:44.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:44.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:45.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:45.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:45.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:45.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:45.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:45.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:45.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:45.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:45.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:45.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:45.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:45.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:45.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:45.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:45.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:45.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:46.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:46.018+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:46.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:46.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:46.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:46.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:47.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:47.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:47.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:47.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:47.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:47.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:47.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:47.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:47.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:47.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:47.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.482+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:47.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:47.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:47.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:42:47.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:47.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:47.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:47.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:47.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:47.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:47.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:47.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:47.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:47.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.778+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:47.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:47.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:47.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:47.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:47.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:47.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:47.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:47.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:47.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:47.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.990+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:47.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:47.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:47.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:48.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:48.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:48.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:48.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:48.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:48.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:48.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:48.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:48.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:48.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.606+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:48.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.614+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:48.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:48.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:48.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:48.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:48.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:48.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:48.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:48.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:48.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:48.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:48.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.830+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:48.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:48.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:48.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:49.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:49.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:49.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:49.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:49.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:49.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:49.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:49.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:49.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.746+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:49.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.746+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:49.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.746+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:49.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:49.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:49.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:49.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:49.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:49.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:49.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:49.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:49.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:49.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.898+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:49.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.898+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:49.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:49.898+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:50.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:50.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:50.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:50.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:50.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:50.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:50.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:50.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:50.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:50.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.326+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:50.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:50.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:50.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:50.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:50.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:50.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:50.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:50.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:50.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.506+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:50.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:50.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:50.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:50.623 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:42:50.623 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:42:50.625 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:42:50.643 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:42:52.048 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:42:52.048 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:42:52.057 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244172 2023-10-14T00:42:52.057 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:42:52.058 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:42:52.058 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:42:52.058 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:42:52.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:52.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:52.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:52.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:52.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:52.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:52.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:52.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:52.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.798+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:52.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:52.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.802+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:52.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:52.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:52.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:53.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:53.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:54.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:54.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:54.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:54.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:54.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:54.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:54.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:54.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.086+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:54.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:54.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:54.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:54.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:54.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:54.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:54.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:54.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:42:54.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:54.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:54.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:54.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:54.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:54.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:54.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:54.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:54.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.694+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:54.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:54.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:54.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:56.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:56.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:42:56.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:56.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:56.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:56.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:56.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:56.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:56.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:56.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:56.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:56.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:56.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:56.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:56.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:56.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:56.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:56.230+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:56.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:56.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:56.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:56.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:58.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:58.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:42:58.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:58.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:42:58.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:58.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:42:58.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:58.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:42:58.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:58.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:58.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:58.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:42:58.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:58.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:58.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:58.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:42:58.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:58.806+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:42:58.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:58.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:42:58.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:58.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:42:59.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:59.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:42:59.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:59.526+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:42:59.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:42:59.526+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:00.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:00.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:00.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:00.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:00.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:00.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:00.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:00.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:00.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:00.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:00.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:00.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:00.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:00.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:00.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:00.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:00.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:00.254+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:00.471 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:43:00.466+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:43:02.065 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:43:02.066 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:43:02.073 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:43:02.074 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:43:03.227 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:43:03.227 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:43:03.227 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244183 2023-10-14T00:43:03.228 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:43:03.228 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:43:03.228 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:43:03.228 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:43:03.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:43:03.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:03.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:03.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:03.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:03.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:03.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:03.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:03.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.650+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:03.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:03.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.670+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:03.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:03.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:03.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:03.929 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:43:03.922+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:43:05.048 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:43:05.042+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:43:05.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:43:05.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:05.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:05.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:05.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:05.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:05.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:05.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:05.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.430+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:05.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:05.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.442+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:05.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:05.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:05.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:43:05.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:05.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:05.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:05.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:05.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:05.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:05.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:05.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:05.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:05.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.702+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:05.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:05.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:08.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:08.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:08.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:08.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:08.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:08.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:08.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:08.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:08.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:08.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:08.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:08.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:08.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:08.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:08.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:08.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:08.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:08.838+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:08.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:08.838+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:08.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:08.838+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:10.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:10.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:10.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:10.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:10.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:10.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:10.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:10.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:10.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:10.506+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:10.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:10.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:10.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:10.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:13.243 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:43:13.244 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:43:13.250 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:43:13.261 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:43:13.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:13.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:13.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:13.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:13.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:13.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:13.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:13.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:13.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:13.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:14.508 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:43:14.501+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:43:15.002 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:43:15.003 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:43:15.003 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244195 2023-10-14T00:43:15.004 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:43:15.004 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:43:15.004 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:43:15.004 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:43:16.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:43:16.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:43:16.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:43:16.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:16.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:16.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:16.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:16.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:16.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:16.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:16.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:16.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:16.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.213+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:16.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:16.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:16.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:16.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:16.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:16.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:16.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:16.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:16.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:16.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:16.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.953+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:16.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:16.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:16.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:17.126 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:43:17.121+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:43:19.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:19.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:19.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:19.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:19.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:19.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:19.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.617+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:19.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.617+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:19.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.617+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:19.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.617+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:19.673 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:43:19.669+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:43:19.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:43:19.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:19.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:19.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:19.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:19.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:19.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:19.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:19.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:19.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:19.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.741+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:19.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:19.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:19.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:20.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:20.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:20.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:20.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:20.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:20.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:20.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:20.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:20.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:20.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.509+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:20.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:20.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:20.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:20.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:20.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:20.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:20.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:20.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:20.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:20.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:20.793+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:21.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:21.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:21.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:21.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:21.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:21.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:21.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:21.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:21.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:21.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:21.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:21.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:21.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:21.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:21.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:21.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:21.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:21.033+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:21.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:21.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:21.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:21.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:22.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:22.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:43:22.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:22.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:23.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:22.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:23.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:22.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:23.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:22.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:23.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:23.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:23.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:23.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:23.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:23.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:23.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:23.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:23.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:23.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:23.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:23.085+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:23.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:23.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:23.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:23.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:23.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:23.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:23.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:23.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:23.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:23.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:23.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:23.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:24.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:24.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:24.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:24.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:24.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:24.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:25.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:24.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:25.015 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:43:25.015 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:43:25.019 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:43:25.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:25.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:25.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:25.029+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:25.040 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:43:25.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:25.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:26.294 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:43:26.304 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:43:26.314 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244206 2023-10-14T00:43:26.315 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:43:26.315 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:43:26.315 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:43:26.315 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:43:27.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:43:27.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:27.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:27.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:27.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:27.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:27.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.337+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:27.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:27.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:27.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:27.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:27.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:27.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:27.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:27.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:27.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.577+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:27.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:27.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:27.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:30.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:30.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:30.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:30.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:30.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:30.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:30.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:30.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:30.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:30.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:30.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:30.601+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:31.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:43:31.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:43:31.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:31.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:31.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:31.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:31.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:31.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:31.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:31.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:31.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:31.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.313+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:31.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:31.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:31.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:43:31.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:43:31.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:43:31.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:31.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:31.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:31.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:31.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:31.507 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:43:31.501+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:43:31.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:31.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:31.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:31.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:31.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.573+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:31.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:31.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:31.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:33.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:33.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:33.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:33.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:33.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:33.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:33.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:33.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:33.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:33.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:33.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:33.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:33.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:33.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:33.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:33.645+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:34.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:34.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:34.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:34.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:34.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:34.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:34.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:34.617+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:34.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:34.621+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:34.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:34.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:34.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:34.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:35.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:35.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:35.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:35.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:35.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:35.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:35.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.413+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:35.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.413+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:35.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.413+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:35.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:35.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:35.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:35.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:35.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:35.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:35.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:35.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:35.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.821+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:35.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.821+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:35.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:35.821+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:36.317 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:43:36.322 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:43:36.326 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:43:36.333 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:43:36.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:36.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:36.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:36.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:36.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:36.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:36.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:36.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:36.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.521+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:36.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:36.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:36.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:43:36.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:36.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:36.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:36.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:36.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:36.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:36.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:36.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:36.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:36.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.757+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:36.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:36.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:36.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:36.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:36.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:37.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:37.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:37.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:37.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:37.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:37.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:37.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:37.005+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:37.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:37.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:37.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:37.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:43:37.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:37.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:37.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:37.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:37.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:37.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:37.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:37.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:37.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:37.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:37.654 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:43:37.655 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:43:37.657 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244217 2023-10-14T00:43:37.657 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:43:37.657 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:43:37.657 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:43:37.658 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:43:38.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:38.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:38.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:38.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:38.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:38.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:38.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:38.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:38.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:38.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:38.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:38.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:38.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:38.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:38.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:38.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:38.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:38.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:38.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:38.313+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:38.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:38.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:38.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:38.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:39.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:39.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:39.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:39.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:39.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:39.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:39.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:39.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:39.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:39.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:39.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:39.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:39.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:39.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:39.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:39.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:39.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:39.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:39.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:39.637+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:39.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:39.637+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:39.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:39.637+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:40.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:40.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:40.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:40.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:40.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:40.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:40.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:40.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:40.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:40.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:40.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:40.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:40.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:40.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:40.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:40.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:40.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:40.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:40.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:40.553+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:40.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:40.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:40.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:40.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:42.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:43:42.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:42.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:42.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:42.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.633+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:42.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.637+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:42.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.685+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:42.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:42.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:42.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:43:42.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:43:42.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:43:42.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:42.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:42.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:42.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:42.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:42.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:42.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:42.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:42.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:42.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.785+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:42.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:42.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:42.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:43:42.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:43:42.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:42.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:42.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:42.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:42.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:42.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:42.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:42.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:42.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.877+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:42.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:42.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:42.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:43.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:43.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:43.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:43.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:43.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:43.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:43.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:43.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:43.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:43.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:43.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:43.189+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:43.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:43.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:43.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:43.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:45.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:45.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:45.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:45.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:45.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:45.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:45.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:45.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:45.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:45.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.373+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:45.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:45.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:45.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:45.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:45.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:45.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:45.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:45.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:45.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:45.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:46.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:46.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:46.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:46.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:46.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:46.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:46.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:46.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:46.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:46.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:46.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:46.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:47.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:47.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:47.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:47.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.009+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:47.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.013+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:47.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.013+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:47.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:47.664 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:43:47.670 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:43:47.671 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:43:47.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:47.676 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:43:47.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:47.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:47.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:47.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:47.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:47.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:47.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:47.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:47.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:47.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.985+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:48.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.993+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:48.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:47.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:49.033 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:43:49.033 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:43:49.034 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244229 2023-10-14T00:43:49.034 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:43:49.035 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:43:49.035 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:43:49.035 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:43:49.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:43:49.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:43:49.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:43:49.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:49.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:49.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:49.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:49.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:49.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:49.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:49.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:49.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:49.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.209+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:49.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:49.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:49.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:49.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:49.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:49.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:49.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:49.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:49.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:49.993+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:52.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:52.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:52.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:52.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:52.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:52.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:52.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:52.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:52.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:52.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:52.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:52.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:52.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:52.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:52.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:52.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:52.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:52.217+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:52.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:52.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:52.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:52.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:53.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:53.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:43:53.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:53.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:54.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:54.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:54.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:54.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:54.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:54.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:54.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:54.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:54.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.093+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:54.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:54.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:54.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:54.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:54.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:54.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:54.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:54.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:54.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:54.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:54.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.581+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:54.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:54.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:43:54.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:54.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:54.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:54.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:54.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:54.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:54.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:54.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:54.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.961+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:54.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:54.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:54.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:55.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:55.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:55.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:55.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:55.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:55.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:55.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:55.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:55.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:55.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:55.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:55.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:55.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:55.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:55.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:55.093+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:55.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:55.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:55.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:55.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:56.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:56.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:56.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:56.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:56.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:56.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:56.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:56.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:56.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:56.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:56.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:56.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:56.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:56.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:56.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:56.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:56.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:56.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:56.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:56.169+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:56.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:56.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:56.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:56.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:56.652 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:43:56.645+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:43:57.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:43:57.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:43:57.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:57.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:57.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:57.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:57.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:57.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:57.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:57.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:57.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:57.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.957+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:57.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:57.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:57.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:58.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:58.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:58.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:58.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:58.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:58.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:58.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:58.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:58.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:58.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:58.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:58.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:58.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:58.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:58.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:58.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:58.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:58.769+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:58.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:58.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:43:58.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:58.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:43:59.042 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:43:59.042 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:43:59.063 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:43:59.073 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:43:59.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:59.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:43:59.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:59.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:43:59.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:59.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:43:59.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:59.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:43:59.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:59.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:43:59.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:59.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:43:59.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:59.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:43:59.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:59.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:43:59.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:59.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:43:59.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:59.453+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:43:59.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:43:59.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:00.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:00.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:00.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:00.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:00.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:00.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:00.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:00.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:00.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.441+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:00.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:00.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:00.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:00.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:00.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:00.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:00.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:00.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.445+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:00.465 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:44:00.478 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:44:00.480 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244240 2023-10-14T00:44:00.480 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:44:00.480 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:44:00.480 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:44:00.481 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:44:00.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:44:00.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:00.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:00.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:00.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:00.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:00.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:00.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:00.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.865+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:00.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.889+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:00.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.909+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:00.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:00.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:00.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:02.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:02.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:02.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:02.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:02.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:02.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:02.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:02.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:02.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:02.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:02.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:02.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:02.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:02.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:02.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:02.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:02.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:02.909+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:07.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:07.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:07.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:07.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:07.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:07.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:07.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:07.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:07.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:07.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:07.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:07.145+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:07.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:07.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:07.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:07.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:44:07.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:07.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:08.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:07.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:08.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:08.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:08.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:08.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:08.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:08.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:08.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:08.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:08.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:08.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:08.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:08.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:08.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:08.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:08.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:08.045+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:08.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:08.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:08.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:08.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:09.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:09.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:09.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:09.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:09.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:09.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:09.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:09.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:09.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:09.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:09.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:09.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:09.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:09.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:09.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:09.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:09.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:09.573+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:09.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:09.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:09.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:09.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:10.491 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:44:10.497 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:44:10.498 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:44:10.506 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:44:11.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:11.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:11.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:11.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:11.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:11.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:11.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:11.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:11.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.337+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:11.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:11.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:11.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:11.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:11.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:11.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:11.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.437+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:11.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:11.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.441+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:11.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:11.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:11.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:11.624 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:44:11.617+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:44:12.025 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:44:12.041 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:44:12.042 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244252 2023-10-14T00:44:12.042 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:44:12.042 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:44:12.043 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:44:12.043 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:44:12.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:12.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:12.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:12.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:12.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:12.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:12.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:12.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:12.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:12.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:12.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:12.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:12.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:12.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:12.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:12.669+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:12.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:12.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:12.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:12.693+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:12.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:12.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:12.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:12.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:13.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:13.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:44:13.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:13.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:13.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:13.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:13.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:13.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:13.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:13.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:13.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:13.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:13.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:13.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:13.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:13.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:13.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:13.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:13.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:13.620+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:13.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:13.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:13.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:13.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:15.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:15.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:15.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:15.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:15.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:15.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:15.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:15.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:15.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:15.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:15.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:15.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:15.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:15.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:15.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:15.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:15.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:15.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:15.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:15.572+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:15.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:15.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:15.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:15.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:15.681 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:44:15.672+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:44:16.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:16.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:16.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:16.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:16.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:16.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:16.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:16.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:16.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:16.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:16.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:16.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:16.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:16.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:17.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:17.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:44:17.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:17.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:17.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:17.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:17.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:17.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:17.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:17.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:17.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:17.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:17.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:17.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:17.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:17.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:17.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:17.164+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:17.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:17.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:17.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:17.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:18.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:18.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:18.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:18.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:18.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:18.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:18.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:18.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:18.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:18.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:18.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:18.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:18.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:18.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:18.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:18.276+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:18.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:18.276+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:18.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:18.276+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:18.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:18.276+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:18.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:18.276+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:19.646 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:44:19.640+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:44:20.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:20.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:20.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:20.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:20.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:20.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:20.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:20.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:20.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:20.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:20.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:20.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:20.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:20.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:20.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:20.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:20.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:20.376+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:20.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:20.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:20.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:20.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:21.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:21.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:21.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:21.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:21.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:21.268+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:21.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:21.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:21.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:21.328+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:21.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:21.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:21.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:21.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:22.049 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:44:22.050 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:44:22.057 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:44:22.076 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:44:22.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:22.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:22.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:22.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:22.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:22.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:22.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:22.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:22.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:22.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:22.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:22.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:22.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:22.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:22.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:22.568+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:22.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:22.576+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:22.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:22.576+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:22.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:22.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:22.742 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:44:22.736+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:44:23.488 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:44:23.493 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:44:23.494 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244263 2023-10-14T00:44:23.494 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:44:23.495 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:44:23.495 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:44:23.495 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:44:24.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:24.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:24.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:24.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:24.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:24.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:24.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:24.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:24.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:24.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:24.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:24.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:24.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:24.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:24.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:24.920+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:24.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:24.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:24.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:24.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:25.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:25.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:25.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:25.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:25.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:25.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:25.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:25.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:25.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:25.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:25.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:25.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:26.108 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:44:26.100+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:44:26.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:44:26.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:44:26.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:26.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:26.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:26.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:26.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:26.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:26.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:26.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:26.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:26.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.824+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:26.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.848+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:26.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:26.848+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:27.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:27.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:27.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:27.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:27.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:27.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:27.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:27.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:27.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:27.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:27.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:27.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:27.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:27.464+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:27.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:27.464+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:27.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:27.464+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:28.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:44:28.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:28.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:28.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:28.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:28.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:28.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:28.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:28.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.532+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:28.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:28.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.568+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:28.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.568+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:28.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:28.568+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:29.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:29.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:29.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:29.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:29.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:29.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:29.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:29.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:29.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:29.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:29.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:29.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:29.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:29.848+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:29.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:29.848+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:29.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:29.848+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:29.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:29.848+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:29.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:29.860+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:31.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:31.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:44:31.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:31.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:31.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:31.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:31.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:31.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:31.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:31.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:31.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:31.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:31.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:31.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:31.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:31.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:31.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:31.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:31.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:31.676+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:31.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:31.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:31.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:31.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:33.500 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:44:33.500 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:44:33.504 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:44:33.515 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:44:34.933 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:44:34.945 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:44:34.947 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244274 2023-10-14T00:44:34.948 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:44:34.948 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:44:34.948 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:44:34.948 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:44:35.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:35.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:35.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:35.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:35.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:35.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:35.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:35.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:35.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:35.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:35.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:35.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:35.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:35.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:35.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:35.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:35.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:35.312+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:35.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:35.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:35.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:35.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:36.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:36.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:36.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:36.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:36.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:36.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:36.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:36.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:36.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.520+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:36.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:36.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:36.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:44:36.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:36.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:36.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:36.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:36.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:36.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:36.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:36.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:36.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.932+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:36.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.964+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:36.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:36.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:36.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:38.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:38.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:38.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:38.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:38.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:38.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:38.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:38.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:38.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:38.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:38.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:38.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:38.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:38.812+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:38.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:38.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:38.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:38.824+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:38.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:38.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:38.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:38.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:40.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:40.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:40.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:40.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:40.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:40.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:40.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:40.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.544+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:40.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:40.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:40.738 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:44:40.736+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:44:40.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:40.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:40.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:40.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:40.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:40.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:40.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:40.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:40.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:41.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.000+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:41.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:41.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:41.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:44:41.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:44:41.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:41.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:41.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:41.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:41.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:41.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:41.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:41.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:41.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:41.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.140+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:41.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:41.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:41.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:42.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:42.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:42.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:42.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:42.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:42.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:42.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:42.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:42.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:42.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:42.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:42.220+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:42.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:42.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:42.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:42.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:44.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:44:44.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:44.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:44.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:44.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:44.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:44.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:44.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:44.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.692+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:44.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:44.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.756+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:44.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:44.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:44.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:44.951 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:44:44.954 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:44:44.961 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:44:44.969 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:44:45.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:45.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:45.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:45.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:45.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:45.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:45.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:45.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:45.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:45.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.428+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:45.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:45.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:45.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:45.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:45.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:45.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:45.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:45.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:45.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:45.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:45.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:45.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.832+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:45.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:45.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:45.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:46.340 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:44:46.346 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:44:46.347 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244286 2023-10-14T00:44:46.348 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:44:46.348 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:44:46.348 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:44:46.348 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:44:46.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:46.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:46.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:46.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:46.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:46.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:46.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:46.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:46.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:46.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:46.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:46.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:46.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:46.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:46.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:46.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:46.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:46.576+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:46.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:46.576+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:46.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:46.576+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:47.448 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:44:47.444+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:44:49.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:49.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:49.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:49.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:49.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:49.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.368+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:49.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.384+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:49.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:49.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:49.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:49.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:49.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:49.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:49.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:49.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:49.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:49.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:49.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:49.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.492+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:49.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:49.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:49.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:49.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:49.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:49.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:49.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:50.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:50.008+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:50.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:50.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:50.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:50.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:51.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:51.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:44:51.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:51.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:51.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:51.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:51.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:51.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:51.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:51.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:51.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:51.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:51.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:51.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:51.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:51.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:51.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:51.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:51.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:51.296+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:51.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:51.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:51.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:51.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:53.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:44:53.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:44:53.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:53.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:53.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:53.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:53.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:53.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:53.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:53.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:53.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:53.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.244+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:53.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:53.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:53.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:53.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:53.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:53.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:53.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.752+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:53.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:53.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:53.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:53.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:53.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:54.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:54.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:54.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:53.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:54.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:54.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.032+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:54.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:54.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:54.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:44:54.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:54.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:54.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:54.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:54.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:54.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:54.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:54.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:54.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:54.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.548+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:54.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:54.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:54.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:44:54.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:54.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:54.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:54.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:54.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:54.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:54.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.692+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:54.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:54.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.720+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:54.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:54.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:54.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:56.350 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:44:56.352 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:44:56.353 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:44:56.365 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:44:57.648 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:44:57.653 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:44:57.654 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244297 2023-10-14T00:44:57.655 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:44:57.655 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:44:57.655 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:44:57.655 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:44:57.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:57.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:57.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:57.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:57.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:57.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:57.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:57.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:57.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:57.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:57.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:57.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:57.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:57.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:57.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:57.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:57.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:57.764+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:57.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:57.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:57.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:57.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:44:58.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:44:58.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:44:58.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:44:58.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:44:58.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:44:58.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:44:58.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:44:58.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:44:58.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:44:58.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:44:58.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:44:58.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:44:58.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.264+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:44:58.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:44:58.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:44:58.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:00.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:00.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:00.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:00.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:00.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:00.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:00.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:00.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:00.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:00.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:00.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:00.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.220+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:00.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:00.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:00.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:02.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:02.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:02.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:02.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:02.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:02.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:02.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:02.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.280+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:02.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.284+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:02.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.288+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:02.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:45:02.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:02.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:02.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:02.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:02.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:02.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:02.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:02.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:02.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:02.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.728+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:02.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:02.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:02.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:03.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:03.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:45:03.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:03.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:03.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:03.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:03.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:03.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:03.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:03.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:03.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:03.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:03.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.540+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:03.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.540+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:03.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:03.540+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:04.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:04.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:04.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:04.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:04.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:04.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:04.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:04.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.196+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:04.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:04.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:04.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:45:04.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:04.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:04.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:04.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:04.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:04.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:04.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.576+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:04.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:04.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.624+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:04.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:04.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:04.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:05.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:45:05.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:05.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:05.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:05.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:05.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:05.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:05.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:05.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:05.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:05.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.368+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:05.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.372+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:05.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:05.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:05.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:07.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:07.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:07.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:07.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:07.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:07.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:07.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:07.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:07.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:07.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:07.656 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:45:07.657 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:45:07.657 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:45:07.672 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:45:08.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:08.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:08.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:08.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:08.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:08.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:08.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:08.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:08.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:08.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:08.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.448+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:08.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:08.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:08.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:08.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:45:08.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:08.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:08.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:08.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:08.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:08.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:08.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:08.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:08.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:08.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.684+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:08.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:08.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:08.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:08.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:08.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:08.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:08.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:08.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:08.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:08.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:08.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:08.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.820+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:08.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:08.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:08.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:09.119 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:45:09.135 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:45:09.135 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244309 2023-10-14T00:45:09.136 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:45:09.136 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:45:09.136 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:45:09.136 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:45:11.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:11.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:11.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:11.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:11.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.208+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:11.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:11.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.244+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:11.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:11.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:11.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:11.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:11.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:11.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.952+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:11.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:11.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.988+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:11.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:11.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:11.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:12.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:12.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:12.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:12.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:12.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:12.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:12.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:12.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:12.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:12.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:12.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:12.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:12.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:12.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:12.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:12.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:12.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:12.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:12.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:12.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:14.405 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:45:14.404+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:45:15.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:15.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:15.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:15.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:15.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:15.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:15.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:15.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:15.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:15.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:15.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:15.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:15.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:15.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:15.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:15.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:16.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:16.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:16.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:16.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:16.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:16.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:16.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:16.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:16.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:16.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:16.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:16.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:16.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:16.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:16.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:16.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:16.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:16.520+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:17.324 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:45:17.320+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:45:19.164 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:45:19.167 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:45:19.168 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:45:19.170 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:45:19.742 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:45:19.740+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:45:20.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:20.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:20.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:20.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:20.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:20.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:20.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:20.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:20.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.264+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:20.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:20.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:20.357 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:45:20.352+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:45:20.479 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:45:20.479 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:45:20.480 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244320 2023-10-14T00:45:20.481 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:45:20.481 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:45:20.481 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:45:20.481 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:45:20.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:20.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:20.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:20.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:20.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:20.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:20.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:20.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:21.341 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:45:21.339+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:45:22.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:22.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:22.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:22.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:22.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:22.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:22.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:22.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:22.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:22.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.711+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:22.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:22.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:22.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:22.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:45:22.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:22.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:22.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:22.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:22.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:22.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:22.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:22.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:22.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.771+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:22.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:22.799+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:24.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:24.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:25.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:24.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:25.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:25.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:25.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:25.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:25.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:25.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:25.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.079+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:25.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:25.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:25.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:25.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:25.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:25.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:25.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:25.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:25.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:25.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.387+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:25.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:25.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:25.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:25.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:25.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:25.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:25.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:25.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:25.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:25.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:25.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:25.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.651+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:25.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:25.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:25.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:25.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:25.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:25.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:25.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:25.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:25.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:25.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.843+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:25.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.847+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:25.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:25.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:25.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:25.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:25.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:25.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:25.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:25.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:25.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:25.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:26.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:26.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:26.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:26.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:26.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:26.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:26.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:26.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.575+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:26.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:26.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:26.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:26.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:26.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:26.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:26.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:26.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:26.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:26.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:26.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:26.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:26.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.607+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:26.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:26.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:26.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:27.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:27.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:27.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:27.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:27.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:27.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:27.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:27.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:27.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:27.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.695+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:27.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:27.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:27.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:27.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:27.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:27.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:27.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:27.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:27.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.903+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:27.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:27.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:27.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:29.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:29.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:29.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:29.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:29.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:29.123+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:30.483 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:45:30.484 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:45:30.487 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:45:30.505 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:45:30.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:30.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:30.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:30.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:30.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:30.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:30.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:30.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:30.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:30.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:30.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:30.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:30.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:30.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:30.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:30.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:30.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:30.971+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:30.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:30.983+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:30.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:30.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:30.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:30.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:31.043 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:45:31.035+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:45:31.047 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:45:31.043+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:45:31.753 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:45:31.753 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:45:31.754 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244331 2023-10-14T00:45:31.754 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:45:31.754 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:45:31.754 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:45:31.754 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:45:32.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:32.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:32.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:32.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:32.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:32.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:32.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:32.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:32.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.287+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:32.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:32.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:32.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:32.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:32.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:32.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:32.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:32.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.499+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:32.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:32.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.507+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:32.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:32.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:32.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:32.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:32.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:32.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:32.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:32.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:32.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:32.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:32.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:32.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.927+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:32.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:32.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:32.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:36.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:36.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:36.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:36.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:36.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:36.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:36.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:36.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:36.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:36.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:36.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:36.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:36.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:36.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:36.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:36.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:36.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:36.847+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:36.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:36.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:36.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:36.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:36.880 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:45:36.875+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:45:37.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:37.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:37.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:37.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:37.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:37.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:37.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:37.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:37.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:37.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.219+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:37.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:37.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:37.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:37.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:37.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:37.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:37.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:37.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:37.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:37.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.987+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:37.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:37.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:37.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:38.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:38.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:38.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:38.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:38.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:38.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:38.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:38.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:38.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:38.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:39.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:39.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:39.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:39.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.043+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:39.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:39.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:39.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:39.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:45:39.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:39.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:39.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:39.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:39.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:39.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:39.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:39.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:39.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:39.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:39.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.259+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:39.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:39.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:39.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:39.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:39.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:39.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:39.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:39.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:39.388 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:45:39.383+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:45:39.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:39.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:39.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:39.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:39.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.419+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:39.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:39.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:39.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:40.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:40.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:40.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:40.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:40.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:40.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:40.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:40.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:40.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:40.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:40.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:40.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:40.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:40.107+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:40.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:40.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:40.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:40.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:41.771 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:45:41.772 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:45:41.783 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:45:41.788 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:45:43.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:43.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:43.224 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:45:43.237 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:45:43.241 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244343 2023-10-14T00:45:43.241 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:45:43.241 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:45:43.241 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:45:43.242 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:45:43.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:43.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:43.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:43.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:43.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:43.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:43.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:43.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:43.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:43.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:43.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:43.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:43.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:43.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:43.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:43.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:43.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:43.355+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:43.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:43.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:43.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:43.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:44.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:44.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:44.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:44.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:44.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:44.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:44.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:44.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:44.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:44.899+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:44.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:44.899+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:44.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:44.919+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:44.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:44.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:44.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:44.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:46.522 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:45:46.519+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:45:47.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:47.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:47.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:47.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:47.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:47.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:47.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:47.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:47.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:47.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:47.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:47.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:47.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:47.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:47.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:47.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:47.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:47.955+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:47.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:47.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:47.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:47.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:48.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:48.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:48.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:48.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:48.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:48.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:48.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:48.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:48.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:48.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:48.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:48.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:48.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:48.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:48.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:48.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:48.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:48.903+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:48.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:48.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:48.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:48.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:49.865 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:45:49.859+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:45:50.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:50.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:50.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:50.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:50.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:50.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:50.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:50.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:50.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:50.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:50.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:50.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:50.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:50.971+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:50.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:50.979+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:50.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:50.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:50.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:50.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:51.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:51.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:51.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:51.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:51.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:51.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:51.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:51.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:51.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:51.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:51.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:51.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:51.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:51.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:51.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:51.579+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:51.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:51.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:51.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:51.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:52.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:52.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:52.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:52.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:52.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:52.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:52.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:52.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:52.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:52.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:52.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.407+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:52.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:52.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:52.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:53.257 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:45:53.262 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:45:53.263 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:45:53.263 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:45:54.498 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:45:54.501 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:45:54.510 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244354 2023-10-14T00:45:54.510 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:45:54.511 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:45:54.511 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:45:54.511 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:45:54.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:54.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:54.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:54.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:54.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:54.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:54.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:54.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:54.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:54.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:54.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:54.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:54.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:54.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:55.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:55.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:45:55.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:55.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:55.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:55.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:55.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:55.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:55.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:55.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:55.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:55.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:55.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.395+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:55.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:55.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:55.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:57.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:57.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:57.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:57.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:57.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:57.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:57.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:57.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:57.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:57.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.355+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:57.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:57.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:57.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:57.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:57.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:57.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:57.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:57.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:57.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:57.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:45:57.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:57.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:57.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:57.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:57.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:57.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:57.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:57.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:57.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:57.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:57.898 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:45:57.895+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:45:57.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.911+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:57.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:57.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:57.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:58.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:58.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:45:58.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:58.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:58.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:58.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:58.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:58.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:58.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:58.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:58.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:58.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:58.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.691+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:58.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:58.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:58.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:58.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:45:58.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:45:58.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:45:58.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:58.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:58.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:58.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:58.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:58.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:58.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:58.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:58.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.763+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:58.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:58.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:58.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:45:59.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:59.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:45:59.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:59.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:45:59.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:59.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:45:59.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:59.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:45:59.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:59.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:45:59.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:59.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:45:59.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:59.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:45:59.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:59.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:45:59.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:59.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:45:59.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:59.487+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:45:59.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:59.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:45:59.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:45:59.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:01.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:46:01.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:01.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:01.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:01.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:01.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:01.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:01.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:01.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:01.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:01.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.343+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:01.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.343+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:01.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.343+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:01.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:46:01.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:46:01.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:01.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:01.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:01.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:01.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:01.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:01.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:01.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:01.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:01.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.483+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:01.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.483+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:01.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:01.483+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:02.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:46:02.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:02.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:02.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:02.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:02.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:02.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:02.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:02.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:02.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:02.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.811+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:02.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:02.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:02.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:03.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:46:03.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:03.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:03.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:03.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:03.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:03.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:03.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:03.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:03.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:03.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.263+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:03.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:03.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:03.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:04.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:04.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:04.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:04.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:04.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:04.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:04.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:04.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:04.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:04.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:04.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:04.103+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:04.524 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:46:04.524 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:46:04.525 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:46:04.538 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:46:04.971 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:46:04.967+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:46:05.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:05.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:05.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:05.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:05.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.191+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:05.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:05.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.231+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:05.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:05.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:05.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:05.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:05.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:05.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:05.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:05.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:05.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:05.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.467+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:05.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:05.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:05.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:05.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:05.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:05.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:05.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:05.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:05.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:05.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:05.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:05.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.783+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:05.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:05.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:05.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:06.015 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:46:06.016 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:46:06.017 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244366 2023-10-14T00:46:06.017 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:46:06.017 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:46:06.017 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:46:06.017 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:46:06.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:46:06.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:06.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:06.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:06.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:06.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:06.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:06.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:06.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:06.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:06.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.907+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:06.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:06.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:06.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:07.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:46:07.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:07.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:07.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:07.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:07.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:07.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:07.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:07.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:46:07.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:07.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:07.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:07.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:07.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:07.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:07.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:07.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.631+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:07.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.631+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:07.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.631+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:07.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:07.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:07.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:08.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:08.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:08.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:08.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:08.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:08.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:08.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:08.091+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:08.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:08.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:09.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:09.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:09.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:09.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:09.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:09.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:09.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:09.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:09.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.287+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:09.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:09.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:09.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:09.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:09.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:09.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:09.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:09.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.595+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:09.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.603+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:09.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:09.603+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:10.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:10.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:10.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:10.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:10.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:10.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:10.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:10.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:10.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.187+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:10.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:10.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:10.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:10.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:10.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:10.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:10.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.647+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:10.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:10.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:46:10.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:46:10.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:10.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:10.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:10.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:10.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:10.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:10.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:10.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:10.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:10.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:11.260 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:46:11.255+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:46:11.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:46:11.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:11.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:11.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:11.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:11.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:11.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:11.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:11.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:11.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:11.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.891+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:11.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:11.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:11.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:13.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:46:13.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:13.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:13.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:13.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:13.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:13.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:13.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:13.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:13.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:13.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.143+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:13.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:13.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:13.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:46:13.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:46:13.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:13.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:13.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:13.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:13.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:13.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:13.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:13.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:13.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.831+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:13.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.843+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:13.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.843+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:13.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:13.843+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:15.216 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:46:15.211+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:46:15.228 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:46:15.223+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:46:16.045 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:46:16.046 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:46:16.063 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:46:16.064 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:46:17.233 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:46:17.234 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:46:17.240 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244377 2023-10-14T00:46:17.240 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:46:17.241 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:46:17.241 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:46:17.241 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:46:17.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:17.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:17.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:17.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:17.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:17.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:17.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:17.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:17.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:17.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.399+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:17.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:17.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:17.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:17.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:17.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:17.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:17.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:17.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:17.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.539+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:17.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:17.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.583+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:17.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:17.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:17.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:18.073 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:46:18.067+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:46:18.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:18.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:18.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:18.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:18.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:18.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:18.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:18.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:18.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:18.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:18.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:18.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:18.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:18.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:18.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:18.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:18.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:18.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:18.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:18.435+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:18.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:18.435+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:18.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:18.435+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:19.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:19.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:19.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:19.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:19.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:19.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:19.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:19.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:19.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:19.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:19.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:19.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:19.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:19.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:19.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:19.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:19.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:19.151+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:19.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:19.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:20.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:20.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:20.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:20.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:20.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:20.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:20.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:20.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:20.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:20.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:20.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:20.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:20.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:20.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:20.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:20.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:20.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:20.159+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:20.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:20.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:20.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:20.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:20.203 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:46:20.199+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:46:21.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:46:21.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:21.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:21.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:21.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:21.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:21.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:21.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:21.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:21.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:21.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.279+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:21.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:21.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:21.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:23.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:23.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:23.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:23.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:23.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:23.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:23.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:23.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:23.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:23.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:23.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:23.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:23.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:23.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:23.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:23.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:23.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:23.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:23.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:23.671+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:23.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:23.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:23.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:23.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:24.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:24.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:24.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:24.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:24.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:24.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:24.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:24.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:24.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:24.515+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:24.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:24.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:24.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:24.523+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:24.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:24.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:24.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:24.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:26.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:26.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:26.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:26.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:26.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:26.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:27.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:26.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:27.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:26.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:27.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:27.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:27.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:27.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:27.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.035+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:27.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.035+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:27.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.035+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:27.251 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:46:27.251 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:46:27.252 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:46:27.281 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:46:27.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:46:27.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:27.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:27.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:27.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:27.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:27.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:27.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:27.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:27.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:27.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.443+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:27.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:27.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:27.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:27.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:27.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:28.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:28.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:28.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:28.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:28.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:28.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:28.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:28.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:28.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:28.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:28.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:28.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:28.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:28.650+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:28.910 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:46:28.917 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:46:28.926 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244388 2023-10-14T00:46:28.926 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:46:28.927 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:46:28.927 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:46:28.927 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:46:29.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:29.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:29.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:29.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:29.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:29.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:29.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:29.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:29.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:29.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:29.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:29.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:29.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:29.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:29.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:29.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:29.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:29.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:29.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:29.250+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:29.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:29.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:29.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:29.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:30.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:46:30.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:30.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:30.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:30.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:30.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:30.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:30.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.598+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:30.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:46:30.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:30.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:30.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:30.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:30.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.650+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:30.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:30.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.682+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:30.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:46:30.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:46:30.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:46:30.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:30.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:30.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:30.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:30.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:30.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:30.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:30.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:30.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:30.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:30.846+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:31.227 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:46:31.222+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:46:36.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:36.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:36.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:36.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:36.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:36.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:36.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:36.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:36.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:36.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:36.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:36.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:36.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:36.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:36.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:36.938+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:36.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:36.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:36.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:36.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:37.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:37.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:37.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:37.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:37.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:37.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:37.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:37.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:37.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:37.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:37.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:37.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:37.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:37.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:38.931 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:46:38.936 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:46:38.937 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:46:38.948 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:46:39.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:39.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:39.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:39.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:39.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:39.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:39.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:39.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:39.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:39.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:39.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:39.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:39.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:39.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:39.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:39.554+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:39.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:39.554+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:39.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:39.554+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:40.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:40.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:40.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:40.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:40.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:40.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:40.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:40.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:40.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:40.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:40.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:40.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:40.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:40.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:40.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:40.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:40.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:40.314+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:40.428 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:46:40.443 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:46:40.444 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244400 2023-10-14T00:46:40.445 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:46:40.445 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:46:40.445 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:46:40.445 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:46:42.071 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:46:42.066+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:46:42.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:42.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:42.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:42.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:42.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:42.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:42.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:42.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:42.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:42.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:42.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:42.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:42.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:42.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:42.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:42.798+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:42.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:42.802+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:42.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:42.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:42.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:42.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:43.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:43.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:43.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:43.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:43.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:43.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:43.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:43.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:43.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:43.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:43.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:43.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:43.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:43.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:43.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:43.518+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:43.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:43.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:43.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:43.550+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:43.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:43.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:43.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:43.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:44.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:44.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:44.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:44.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:44.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:44.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:44.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:44.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:44.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:44.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:44.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:44.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:44.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:44.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:44.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:44.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:44.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:44.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:44.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:44.634+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:44.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:44.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:44.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:44.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:47.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:47.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:47.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:47.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:47.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:47.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:47.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:47.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:47.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:47.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.218+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:47.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:47.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:47.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:47.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:47.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:47.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:47.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:47.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:47.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.814+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:47.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:47.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:47.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:48.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:48.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:48.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:48.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:48.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:48.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:48.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:48.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:48.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:48.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:48.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:48.290+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:48.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:48.290+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:48.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:48.298+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:48.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:48.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:49.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:49.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:49.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:49.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:49.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:49.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:49.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:49.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:49.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:49.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:49.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:49.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:50.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:50.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:50.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.342+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:50.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:50.447 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:46:50.447 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:46:50.452 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:46:50.468 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:46:50.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.490+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:50.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:50.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:50.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:46:50.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:46:50.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:46:50.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:50.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:50.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:50.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:50.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:50.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:50.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:50.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:50.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:50.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.914+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:50.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:50.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:50.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:51.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:51.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:51.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:51.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:51.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:51.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:51.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:51.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:51.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:51.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:51.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:51.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:51.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:51.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:51.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:51.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:51.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:51.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:51.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:51.210+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:51.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:51.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:51.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:51.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:51.494 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:46:51.486+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:46:51.707 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:46:51.707 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:46:51.708 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244411 2023-10-14T00:46:51.708 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:46:51.708 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:46:51.708 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:46:51.709 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:46:53.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:53.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:53.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:53.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:53.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:53.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:53.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:53.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:53.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:53.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:53.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:53.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:53.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:53.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:53.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:53.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:53.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:53.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:53.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:53.098+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:53.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:53.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:53.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:53.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:54.515 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:46:54.510+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:46:54.876 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:46:54.870+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:46:55.971 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:46:55.966+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:46:57.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:46:57.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:46:57.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:57.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:57.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:57.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:57.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:57.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:57.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:57.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:57.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.398+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:57.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:57.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:57.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:46:59.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:59.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:46:59.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:59.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:46:59.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:59.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:46:59.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:59.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:46:59.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:59.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:46:59.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:59.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:46:59.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:59.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:46:59.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:59.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:46:59.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:59.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:46:59.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:59.102+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:46:59.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:59.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:46:59.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:46:59.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:00.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:00.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:00.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:00.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:00.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:00.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:00.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:00.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:00.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:00.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:00.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:00.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:00.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:00.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:00.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:00.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:00.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:00.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:00.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:00.046+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:00.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:00.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:00.496 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:00.490+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:47:00.508 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:00.502+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:01.710 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:47:01.716 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:47:01.732 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:47:01.733 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:47:02.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:02.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:02.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:02.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:02.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:02.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:02.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:02.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:02.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:02.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:02.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:02.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:02.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:02.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:02.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:02.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:02.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:02.378+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:02.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:02.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:02.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:02.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:03.119 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:47:03.129 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:47:03.130 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244423 2023-10-14T00:47:03.130 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:47:03.130 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:47:03.130 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:47:03.130 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:47:03.169 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:03.166+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:47:03.169 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:03.166+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:03.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:03.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:03.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:03.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:03.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:03.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:03.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:03.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:03.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:03.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.458+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:03.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:03.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:03.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:03.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:03.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:03.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:03.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:03.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:03.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:03.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:03.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.918+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:03.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.918+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:03.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.918+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:03.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:03.918+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:05.247 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:05.242+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:05.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:47:05.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:05.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:05.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:05.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:05.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:05.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:05.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:05.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:05.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.594+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:05.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.594+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:05.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.594+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:05.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:05.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:05.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:05.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:05.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:05.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.978+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:05.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:05.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:05.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:07.057 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:07.054+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:07.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:07.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:07.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:07.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:07.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:07.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:07.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:07.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:07.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:07.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:07.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:07.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:07.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:07.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:07.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:07.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:07.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:07.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:07.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:07.790+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:07.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:07.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:07.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:07.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:08.267 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:08.262+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:08.503 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:47:08.498+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:47:10.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:10.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:10.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:10.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:10.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:10.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:10.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:10.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:10.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:10.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:10.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:10.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:10.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:10.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:10.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:11.576 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:11.570+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:12.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:12.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:12.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:12.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:12.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:12.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:12.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:12.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:12.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:12.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:12.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:12.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:12.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:12.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:12.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:12.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:12.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:12.858+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:12.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:12.858+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:12.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:12.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:13.137 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:47:13.138 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:47:13.139 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:47:13.148 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:47:13.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:13.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:13.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:13.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:13.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:13.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:13.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:13.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:13.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.414+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:13.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:13.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:13.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:13.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:13.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:13.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:13.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:13.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.870+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:13.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:13.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:13.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:14.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:14.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:14.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:14.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:14.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:14.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:14.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:14.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:14.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:14.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:14.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:14.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:14.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:14.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:14.536 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:47:14.537 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:47:14.544 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244434 2023-10-14T00:47:14.544 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:47:14.544 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:47:14.545 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:47:14.545 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:47:17.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:47:17.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:17.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:17.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:17.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:17.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:17.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:17.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:17.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:17.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:17.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.410+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:17.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:17.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:17.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:17.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:17.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:17.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:17.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:17.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:17.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:17.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:17.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:18.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:18.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:18.409 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:47:18.402+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:47:18.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:47:18.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:18.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:18.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:18.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:18.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:18.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:18.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:18.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.738+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:18.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.746+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:18.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.746+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:18.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.746+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:18.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:18.746+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:19.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:47:19.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:47:19.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:19.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:19.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:19.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:19.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:19.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:19.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:19.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:19.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.662+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:19.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:19.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:19.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:47:19.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:47:19.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:47:19.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:19.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:19.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:19.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:19.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:19.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:19.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:19.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.698+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:19.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:19.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:20.421 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:20.418+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:21.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:21.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:21.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:21.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:21.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:21.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:21.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:21.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.786+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:21.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:21.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:21.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:47:21.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:21.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:21.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:21.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:21.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:21.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:21.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:21.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:22.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:22.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:22.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:22.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:22.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:22.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:22.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:22.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:22.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:22.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:22.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:22.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:22.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:22.518+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:22.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:22.550+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:22.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:22.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:22.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:22.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:22.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:22.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:47:23.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:23.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:23.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:23.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:23.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:23.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:23.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:23.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:23.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:23.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:23.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:23.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:23.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:23.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:23.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:23.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:23.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:23.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:23.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:23.094+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:24.555 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:47:24.567 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:47:24.595 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:47:24.613 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:47:25.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:25.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:25.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:25.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:25.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:25.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:25.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:25.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:25.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:25.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:25.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:25.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:25.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:25.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:25.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:25.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:25.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:25.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:25.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:25.798+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:25.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:25.798+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:25.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:25.798+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:25.879 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:47:25.879 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:47:25.881 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244445 2023-10-14T00:47:25.882 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:47:25.882 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:47:25.882 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:47:25.882 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:47:26.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:26.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:26.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:26.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:26.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.290+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:26.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:26.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.354+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:26.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:26.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:26.560 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:26.554+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:26.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:26.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:26.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:26.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:26.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:26.590+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:28.036 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:28.030+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:47:29.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:47:29.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:29.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:29.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:29.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:29.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:29.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:29.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:29.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:29.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:29.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.270+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:29.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:29.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:29.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:47:29.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:29.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:29.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:29.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:29.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:29.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:29.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:29.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:29.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:30.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:30.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:30.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:30.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:30.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:30.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:30.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:30.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:30.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:30.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:30.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:30.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:30.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:30.510+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:30.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:30.510+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:30.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:30.530+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:30.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:30.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:30.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:30.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:30.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:30.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:31.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:31.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:31.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:31.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:31.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:31.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:31.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:31.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:31.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:31.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:31.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:31.170+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:31.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:31.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:31.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:31.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:31.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:31.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:31.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:31.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:31.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:31.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:31.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:31.274+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:32.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:47:32.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:32.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:32.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:32.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:32.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:32.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:32.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:32.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:32.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:32.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.598+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:32.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:32.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:32.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:34.540 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:34.534+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:35.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:35.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:35.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:35.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:35.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:35.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:35.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:35.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:35.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:35.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:35.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:35.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:35.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:35.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:35.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:35.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:35.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:35.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:35.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:35.394+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:35.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:35.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:35.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:35.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:35.906 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:47:35.906 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:47:35.915 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:47:35.919 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:47:37.517 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:47:37.518 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:47:37.518 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244457 2023-10-14T00:47:37.518 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:47:37.518 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:47:37.519 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:47:37.519 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:47:37.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:37.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:47:37.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:37.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:37.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:37.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:37.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:37.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:38.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:37.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:38.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:38.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:38.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:38.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:38.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:38.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:38.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:38.053+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:38.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:38.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:38.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:38.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:39.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:47:39.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:39.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:39.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:39.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:39.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:39.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:39.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:39.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:39.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:39.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.173+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:39.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.173+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:39.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:39.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:40.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:40.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:40.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:40.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:40.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:40.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:40.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:40.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:40.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:40.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:40.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:40.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:40.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:40.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:40.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:40.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:40.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:40.733+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:40.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:40.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:40.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:40.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:41.479 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:41.473+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:41.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:41.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:42.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:41.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:42.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:41.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:42.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:41.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:42.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:41.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:42.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:42.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:42.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:42.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:42.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:42.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:42.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:42.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:42.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:42.109+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:42.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:42.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:42.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:42.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:44.099 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:44.089+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:44.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:44.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:44.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:44.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:44.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:44.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.557+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:44.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:44.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:44.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:47:44.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:44.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:44.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:44.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:44.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:44.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:44.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:44.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:44.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:44.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.881+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:44.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:44.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:44.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:45.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:45.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:45.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:45.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:45.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:45.224 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:45.221+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:45.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:45.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:45.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:45.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.269+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:45.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:45.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:45.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:45.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:45.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:45.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:45.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:45.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:45.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:45.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:45.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:45.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.601+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:45.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:45.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:45.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:47:45.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:47:45.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:45.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:45.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:45.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:45.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:45.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:45.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:45.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:45.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:45.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.701+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:45.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.701+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:45.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:45.701+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:47.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:47.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:47.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:47.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:47.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:47.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:47.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:47.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:47.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.189+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:47.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:47.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:47.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:47.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:47.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:47.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:47.531 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:47:47.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:47.551 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:47:47.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:47.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:47.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:47.563 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:47:47.568 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:47:47.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:47.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.565+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:47.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:47.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:47.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:47.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:47.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:47.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:47.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:47.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:47.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:47.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.805+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:47.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:47.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:48.789 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:47:48.793 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:47:48.797 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244468 2023-10-14T00:47:48.797 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:47:48.798 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:47:48.798 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:47:48.798 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:47:51.910 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:51.905+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:51.956 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:47:51.949+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T00:47:51.956 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:47:51.949+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:47:51.956 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:47:51.949+0000 7f30478aa640 -1 reset not still connected to 0x55c894ab09c0 2023-10-14T00:47:52.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:47:52.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:47:52.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:47:52.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:52.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:52.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:52.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:52.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:52.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:52.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:52.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:52.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:52.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.465+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:52.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:52.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:52.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:54.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:54.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:54.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:54.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:54.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:54.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:54.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:54.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:54.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:54.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:54.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:54.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:54.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:54.721+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:54.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:54.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:54.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:54.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:57.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:57.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:47:57.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:57.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:47:57.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:57.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:57.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:57.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:57.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:57.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:57.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:57.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:57.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:57.165+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:57.973 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:47:57.969+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:47:58.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:58.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:47:58.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:58.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:47:58.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:58.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:58.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:58.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:58.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:58.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:58.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:58.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:58.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:58.193+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:47:58.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:58.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:47:58.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:58.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:47:58.806 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:47:58.807 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:47:58.808 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:47:58.819 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:47:59.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:59.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:47:59.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:59.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:47:59.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:59.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:47:59.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:59.105+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:47:59.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:59.105+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:47:59.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:47:59.105+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:00.224 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:48:00.224 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:48:00.226 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244480 2023-10-14T00:48:00.226 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:48:00.226 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:48:00.226 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:48:00.226 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:48:01.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:01.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:01.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:01.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:01.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:01.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:01.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:01.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:01.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:01.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:01.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:01.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:01.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:01.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:01.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:01.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:01.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:01.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:01.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:01.645+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:01.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:01.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:01.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:01.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:03.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:03.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:03.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:03.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:03.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:03.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:03.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:03.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:03.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:03.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:03.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:03.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:03.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:03.785+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:03.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:03.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:05.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:48:05.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:05.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:05.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:05.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:05.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:05.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:05.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:05.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:05.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:05.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:05.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.281+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:05.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:05.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:05.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:05.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:05.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:05.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:05.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:05.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:05.485+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:06.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:06.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:06.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:06.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:06.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:06.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:06.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:06.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:06.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:06.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:06.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:06.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:06.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:06.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:06.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:06.777+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:06.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:06.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:06.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:06.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:07.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:07.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:07.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.205+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:07.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:07.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:07.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:07.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:07.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:07.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:07.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:07.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:07.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:07.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:07.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.953+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:07.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:07.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:07.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:09.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:09.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.389+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:09.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.405+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:09.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.453+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:09.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:09.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:09.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:48:09.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:09.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:09.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:09.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:09.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:09.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:09.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:09.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:09.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:09.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:10.258 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:48:10.262 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:48:10.272 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:48:10.293 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:48:10.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:10.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:48:10.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:10.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:10.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:10.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:10.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:10.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:10.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:10.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:10.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:10.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.773+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:10.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:10.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:10.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:11.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:48:11.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:11.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:11.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:11.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:11.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:11.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:11.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:11.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.517+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:11.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:11.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.585+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:11.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:11.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:11.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:11.633 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:48:11.655 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:48:11.657 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244491 2023-10-14T00:48:11.657 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:48:11.657 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:48:11.658 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:48:11.658 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:48:12.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:48:12.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:12.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:48:12.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:12.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:12.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:12.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:12.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:12.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:12.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:12.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:12.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:12.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.169+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:12.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:12.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:12.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:12.888 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:48:12.881+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:48:14.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:14.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:14.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:14.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:14.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:14.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:14.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:14.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:14.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.561+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:14.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:14.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:14.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:14.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:14.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:14.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:14.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:14.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:14.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:14.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:14.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:14.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.905+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:14.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:14.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:14.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:15.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:15.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:15.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:15.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:15.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:15.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:15.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:15.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:15.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:15.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.297+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:15.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:15.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:15.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:48:15.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:15.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:48:15.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:15.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:15.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:15.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:15.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:15.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:15.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:15.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:15.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:15.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.537+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:15.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:15.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:18.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:18.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:48:18.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:18.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:18.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:18.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:18.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:18.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:18.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:18.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:18.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:18.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:18.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:18.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:18.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:18.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:18.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:18.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:18.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:18.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:19.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.009+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:19.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:19.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:19.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:19.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:19.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:19.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:19.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:19.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:19.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:19.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.773+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:19.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:19.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:19.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:20.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:20.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:20.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:20.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:20.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:20.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:20.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:20.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:20.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:20.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:20.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:20.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:20.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:20.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:20.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:20.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:20.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:20.101+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:20.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:20.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:20.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:20.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:21.667 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:48:21.682 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:48:21.682 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:48:21.682 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:48:22.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:22.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:22.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:22.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:22.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:22.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:22.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:22.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:22.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.333+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:22.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:22.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:22.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:22.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:22.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:22.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:22.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:22.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:22.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:22.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.585+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:22.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:22.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:22.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:22.783 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:48:22.784 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:48:22.785 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244502 2023-10-14T00:48:22.785 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:48:22.785 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:48:22.785 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:48:22.785 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:48:23.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:23.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:23.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:23.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:23.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:23.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:23.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:23.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:23.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:23.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:23.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:23.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:23.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:48:23.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:48:23.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:23.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:23.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:23.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:23.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:23.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:23.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:23.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:23.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:23.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.845+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:23.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:23.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:23.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:25.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:25.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:25.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:25.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:25.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:25.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:25.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:25.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.341+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:25.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:25.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:25.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:25.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:48:25.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:25.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:25.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:25.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:25.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:25.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:25.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:25.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.541+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:25.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.541+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:25.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.553+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:25.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:25.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:25.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:25.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:25.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:25.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:25.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:25.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:25.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:25.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:25.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.789+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:25.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:25.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:25.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:27.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:27.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:27.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:27.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:27.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:27.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:27.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:27.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.197+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:27.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:48:27.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:27.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:27.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:27.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:27.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:27.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:27.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:27.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:27.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:27.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:28.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:28.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:28.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:28.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:28.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:28.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:28.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.113+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:28.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:48:28.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:28.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:28.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:28.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:28.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:28.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:28.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:28.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:28.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:28.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:28.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:28.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:28.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:28.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:28.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:28.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.497+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:28.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.497+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:28.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:28.497+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:30.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:30.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:30.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:30.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:30.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:30.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:30.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:30.865+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:30.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:30.873+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:30.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:30.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:30.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:30.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:32.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:32.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:32.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:32.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:32.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:32.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:32.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:32.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:32.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:32.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:32.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:32.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:32.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:32.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:32.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:32.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:32.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:32.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:32.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:32.597+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:32.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:32.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:32.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:32.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:32.786 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:48:32.786 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:48:32.790 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:48:32.798 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:48:33.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:33.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:33.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:33.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:33.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:33.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:33.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:33.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:33.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:33.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:33.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:33.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:33.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:33.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:33.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:33.901+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:33.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:33.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:33.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:33.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:33.981 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:48:33.982 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:48:33.982 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244513 2023-10-14T00:48:33.983 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:48:33.983 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:48:33.983 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:48:33.983 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:48:34.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:34.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:34.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:34.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:34.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:34.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:34.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.181+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:34.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:34.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:34.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:34.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:34.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:35.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:35.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:35.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:34.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:35.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:35.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:35.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:35.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.029+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:35.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.029+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:35.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.029+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:35.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:35.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:35.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:35.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:35.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:35.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:35.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:35.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:35.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.217+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:35.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:35.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:35.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:35.327 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:48:35.321+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:48:36.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:36.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:36.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:36.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:36.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:36.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:36.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:36.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:36.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.485+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:36.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:36.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:36.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:36.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:36.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:36.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:36.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:37.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:37.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:48:37.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:37.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:37.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:37.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:37.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:37.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:37.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:37.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:37.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:37.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:37.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:37.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:37.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:37.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:37.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:37.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:37.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:37.673+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:37.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:37.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:37.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:37.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:38.303 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:48:38.297+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:48:42.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:42.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:42.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:42.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:42.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:42.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:42.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:42.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:42.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:42.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.353+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:42.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:42.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:42.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:42.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:42.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:42.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:42.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:42.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:42.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:42.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:42.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:43.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:43.009+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:43.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:43.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:43.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:43.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:43.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:43.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:43.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:43.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:43.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:43.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:43.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:43.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:43.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:43.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:43.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:43.713+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:43.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:43.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:43.984 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:48:43.984 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:48:43.989 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:48:43.996 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:48:44.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:48:44.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:44.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:44.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:44.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:44.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:44.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:44.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:44.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:44.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:44.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.977+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:44.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.977+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:44.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:44.977+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:45.280 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:48:45.280 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:48:45.280 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244525 2023-10-14T00:48:45.281 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:48:45.281 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:48:45.281 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:48:45.281 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:48:46.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:46.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:46.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:46.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:46.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:46.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:46.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:46.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:46.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:46.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:46.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:46.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:46.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:46.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:46.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:46.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:46.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:46.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:46.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:46.772+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:46.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:46.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:46.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:46.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:47.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:47.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:47.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:47.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:47.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:47.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:47.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:47.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:47.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:47.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:47.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:47.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:47.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:47.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:47.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:47.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:47.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:47.952+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:47.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:47.952+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:48.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:48.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:48.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:48.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:48.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:48.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:48.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:48.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:48.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:48.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:48.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:48.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:48.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:48.908+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:48.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:48.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:48.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:48.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:49.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:49.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:48:49.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:49.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:49.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:49.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:49.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:49.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:49.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:49.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:49.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.596+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:49.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:49.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:49.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:50.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:50.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:50.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:50.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:50.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:50.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:50.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:50.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:50.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:50.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:50.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.328+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:50.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:50.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:50.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:52.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:52.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:52.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:52.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:52.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:52.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:52.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:52.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.460+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:52.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:52.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.492+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:52.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:52.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:52.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:52.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:52.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:52.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:52.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:52.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:52.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:52.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:52.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:52.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:52.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.580+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:52.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:52.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:52.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:53.645 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:48:53.640+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:48:53.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:53.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:53.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:53.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:53.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:53.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:53.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:53.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:53.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:53.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:54.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:54.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:54.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:54.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:54.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:54.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:54.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:54.000+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:55.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:55.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:55.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:55.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:55.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:55.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:55.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:55.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:55.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:55.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.108+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:55.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:48:55.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:55.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:55.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:55.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:55.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:55.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:55.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:55.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:55.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:55.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:55.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.204+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:55.294 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:48:55.297 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:48:55.297 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:48:55.336 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:48:55.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:55.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:55.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:55.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:55.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:55.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:55.904+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:56.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:56.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:56.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:56.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:56.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:56.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:56.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:56.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.316+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:56.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:56.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:56.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:56.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:56.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:56.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:56.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:56.710 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:48:56.712 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:48:56.713 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244536 2023-10-14T00:48:56.713 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:48:56.714 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:48:56.714 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:48:56.714 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:48:56.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:48:56.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:56.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:56.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:56.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:56.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:56.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:57.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:57.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:57.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:57.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.996+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:57.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:57.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:56.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:57.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:57.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:57.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:57.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:57.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:57.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:57.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:57.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:57.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:57.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:57.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:57.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:57.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:57.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:57.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:57.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:57.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:57.208+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:57.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:57.228+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:57.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:57.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:57.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:57.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:48:59.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:48:59.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:48:59.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:48:59.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:48:59.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:48:59.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:59.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:59.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:48:59.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:48:59.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:48:59.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.076+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:48:59.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:48:59.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:48:59.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:48:59.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:48:59.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:00.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:00.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:00.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:00.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:00.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:00.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:00.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:00.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:00.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:00.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:00.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:00.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:00.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:00.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:00.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:00.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:00.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:00.400+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:00.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:00.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:00.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:00.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:03.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:03.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:03.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:03.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:03.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.152+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:03.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.152+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:03.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.152+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:03.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:03.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:49:03.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:03.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:49:03.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:49:03.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:03.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:03.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:03.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:03.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:03.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:03.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:03.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:03.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:03.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.436+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:03.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:03.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:03.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:49:03.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:49:03.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:03.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:03.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:03.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:03.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:03.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:03.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:03.540+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:04.261 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:49:04.260+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:49:04.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:04.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:04.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:04.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:04.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:04.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:04.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:04.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:04.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:04.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:04.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:04.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:04.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:04.752+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:06.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:49:06.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:49:06.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:06.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:06.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:06.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:06.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:06.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:06.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:06.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:06.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:06.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.180+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:06.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:06.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:06.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:06.736 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:49:06.736 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:49:06.737 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:49:06.742 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:49:07.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:49:07.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:07.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:07.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:07.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:07.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:07.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:07.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:07.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:07.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:07.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.244+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:07.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:07.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:07.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:08.381 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:49:08.381 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:49:08.382 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244548 2023-10-14T00:49:08.382 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:49:08.382 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:49:08.382 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:49:08.383 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:49:09.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:09.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:49:09.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:09.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:09.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:09.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:09.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:09.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:09.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:09.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:09.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:09.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:09.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:09.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:09.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:09.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:09.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:09.924+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:09.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:09.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:09.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:09.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:10.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:10.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:10.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:10.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:10.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:10.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:10.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:10.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:10.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:10.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:10.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:10.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:10.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:10.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:10.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:10.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:10.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:10.692+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:10.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:10.692+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:10.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:10.692+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:10.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:10.692+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:11.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:11.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:12.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:49:12.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:49:12.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:12.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:12.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:12.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:12.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:12.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:12.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:12.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:12.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:12.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.780+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:12.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:12.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:12.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:49:12.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:49:12.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:12.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:12.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:12.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:12.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:13.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:13.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:13.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:13.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:13.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.080+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:13.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.080+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:13.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.080+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:13.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.080+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:13.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:49:13.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:49:13.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:49:13.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:13.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:13.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:13.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:13.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:13.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:13.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:13.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:13.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:13.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.536+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:13.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:13.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:13.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:49:13.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:49:13.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:49:13.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:13.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:13.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:13.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:13.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:13.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:13.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:13.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:13.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:13.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.664+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:13.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:13.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:13.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:16.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:16.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:16.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:16.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:16.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:16.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.636+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:16.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:16.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.652+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:16.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:16.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:16.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:16.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:16.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:16.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:16.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:16.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:16.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:16.972+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:18.391 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:49:18.392 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:49:18.397 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:49:18.404 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:49:19.820 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:49:19.820 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:49:19.821 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244559 2023-10-14T00:49:19.821 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:49:19.821 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:49:19.821 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:49:19.821 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:49:20.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:20.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:20.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:20.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:20.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:20.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:20.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:20.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.512+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:20.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:20.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:20.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:20.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:20.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:20.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:20.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:20.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:20.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:20.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:20.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:20.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.836+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:20.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:20.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:20.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:22.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:22.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:22.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:22.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:22.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:22.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:22.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:22.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:22.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:22.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:22.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:22.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:22.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:22.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:22.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:22.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:22.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:22.420+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:22.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:22.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:25.275 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:49:25.272+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:49:25.300 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:49:25.292+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:49:25.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:25.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:25.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:25.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:25.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:25.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:25.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.480+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:25.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:25.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:25.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:25.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:25.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:25.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:25.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:25.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:25.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.732+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:25.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:25.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:25.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:25.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:25.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:25.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:25.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:25.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:25.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:25.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:26.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:26.000+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:26.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:26.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:26.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:26.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:29.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:29.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:29.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:29.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:29.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:29.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:29.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:29.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:29.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:29.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.416+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:29.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:29.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:29.832 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:49:29.832 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:49:29.833 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:49:29.836 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:49:29.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:29.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:29.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:29.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:29.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:29.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:29.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:29.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:30.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:30.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.036+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:30.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:30.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:30.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:30.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:30.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:30.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:30.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:30.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:30.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:30.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:30.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:30.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:31.218 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:49:31.219 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:49:31.219 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244571 2023-10-14T00:49:31.220 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:49:31.220 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:49:31.220 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:49:31.220 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:49:31.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:31.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:31.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:31.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:31.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:31.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:31.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:31.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:31.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:31.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:31.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:31.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:31.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:31.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:32.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:32.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:32.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:32.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:32.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:32.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:32.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:32.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:32.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:32.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.388+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:32.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:32.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:32.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:49:32.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:32.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:32.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:32.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:32.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:32.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:32.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:32.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:32.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:32.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.860+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:32.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.860+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:32.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:32.860+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:35.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:35.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:35.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:35.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:35.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:35.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:35.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.268+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:35.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.288+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:35.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.304+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:35.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:35.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:35.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:35.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:35.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:35.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:35.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:35.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:35.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.580+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:35.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:35.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:35.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:49:35.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:35.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:35.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:35.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:35.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:35.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:35.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:35.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:35.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.788+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:35.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:35.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:35.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:37.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:37.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:37.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:37.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:37.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:37.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:37.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:37.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:37.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:37.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:37.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:37.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:37.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:37.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:38.043 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:49:38.040+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:49:38.865 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:49:38.864+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:49:39.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:39.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:39.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:39.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:39.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:39.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:39.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:39.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:39.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:39.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:39.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:39.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:39.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:39.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:39.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:39.480+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:39.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:39.480+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:39.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:39.492+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:39.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:39.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:39.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:39.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:40.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:40.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:40.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:40.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:40.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:40.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:40.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:40.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:40.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:40.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:40.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:40.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:40.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:40.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:40.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:40.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:40.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:40.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:40.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:40.260+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:40.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:40.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:40.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:40.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:41.221 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:49:41.221 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:49:41.222 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:49:41.222 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:49:42.514 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:49:42.514 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:49:42.516 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244582 2023-10-14T00:49:42.516 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:49:42.516 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:49:42.516 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:49:42.516 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:49:42.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:42.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:42.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:42.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:42.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:42.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:42.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:42.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:42.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:42.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:42.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:42.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:42.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:42.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:42.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:42.656+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:42.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:42.660+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:42.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:42.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:42.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:42.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:44.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:49:44.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:44.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:44.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:44.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:44.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:44.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:44.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.636+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:44.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.648+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:44.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:44.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:44.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:49:44.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:44.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:44.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:44.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:44.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:44.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:45.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:45.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:45.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:45.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:45.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:45.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:45.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:45.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:45.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:45.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:45.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:45.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:45.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:45.648+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:45.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:45.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:45.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:45.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:50.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:50.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:50.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:50.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:50.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:50.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:50.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:50.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.396+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:50.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:49:50.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:50.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:50.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:50.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:50.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:50.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:50.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:50.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.808+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:50.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:50.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:50.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:50.860 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:49:50.856+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:49:51.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:51.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:51.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:51.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:52.534 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:49:52.543 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:49:52.546 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:49:52.546 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:49:53.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:53.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:53.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:53.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:53.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:53.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:53.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:53.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:53.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:53.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:53.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:53.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:53.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:53.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:53.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:53.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:53.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:53.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:53.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:53.264+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:53.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:53.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:53.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:53.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:53.777 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:49:53.777 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:49:53.778 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244593 2023-10-14T00:49:53.778 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:49:53.778 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:49:53.779 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:49:53.779 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:49:54.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:49:54.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:49:54.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:54.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:54.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:54.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:54.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:54.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:54.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:54.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:54.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:54.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.176+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:54.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:49:54.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:49:54.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:54.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:54.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:54.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:54.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:54.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:54.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:54.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:54.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:54.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:54.304+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:54.489 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:49:54.488+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:49:55.386 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:49:55.384+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:49:55.389 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:49:55.388+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:49:55.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:55.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:55.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:55.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:55.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:55.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:55.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:55.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:55.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:55.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:55.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:55.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:55.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:55.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:55.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:55.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:55.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:55.624+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:55.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:55.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:55.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:55.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:56.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:56.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:56.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:56.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:49:56.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:56.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:49:56.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:56.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:56.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:56.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:56.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:56.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:56.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:56.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:56.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:56.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:56.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:56.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:56.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:56.588+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:56.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:56.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:57.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:57.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:49:57.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:57.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:49:57.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:57.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:49:57.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:57.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:49:57.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:57.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:49:57.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:57.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:49:57.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:57.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:49:57.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:57.200+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:49:57.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:57.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:49:57.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:49:57.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:49:59.156 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:49:59.155+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:50:00.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:50:00.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:00.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:50:00.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:00.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:00.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:00.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:00.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:00.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:00.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:00.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:00.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:00.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.463+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:00.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:00.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:00.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:01.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:01.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:01.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:01.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:01.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:01.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:01.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:01.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:01.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:01.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:01.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:01.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:01.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:01.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:01.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:01.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:01.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:01.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:01.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:01.555+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:01.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:01.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:01.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:01.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:03.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:03.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:03.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:03.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:03.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:03.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:03.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:03.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:03.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:03.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:03.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:03.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:03.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:03.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:03.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:03.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:03.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:03.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:03.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:03.483+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:03.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:03.483+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:03.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:03.483+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:03.789 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:50:03.791 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:50:03.802 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:50:03.802 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:50:04.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:04.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:04.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:04.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:04.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:04.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:04.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:04.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:04.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:04.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:04.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:04.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:04.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:04.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:04.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:04.639+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:04.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:04.643+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:04.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:04.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:04.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:04.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:05.160 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:50:05.160 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:50:05.160 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244605 2023-10-14T00:50:05.161 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:50:05.161 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:50:05.161 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:50:05.161 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:50:05.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:05.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:05.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:05.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:05.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:05.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:05.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:05.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.263+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:05.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:05.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:05.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:05.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:05.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:05.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:05.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:05.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:05.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.719+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:05.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:05.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:05.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:05.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:05.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:05.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:05.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:05.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:05.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:05.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:05.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:05.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.915+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:05.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:05.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:05.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:06.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:06.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:06.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:06.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:06.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:06.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:06.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:06.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:06.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:06.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:06.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:06.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:08.203 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:50:08.199+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:50:08.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:08.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:50:08.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:08.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:08.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:08.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:08.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:08.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:08.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:08.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:08.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:08.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.279+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:08.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:08.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:08.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:11.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:11.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:11.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:11.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:11.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:11.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:11.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:11.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:11.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:11.827+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:11.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:11.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:11.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:11.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:11.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:11.827+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:11.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:11.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:11.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:11.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:14.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:50:14.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:14.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:14.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:14.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:14.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:14.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:14.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:14.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:14.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:14.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.739+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:14.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:14.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:14.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:15.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:15.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:15.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:15.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:15.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:15.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:15.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.143+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:15.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:15.172 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:50:15.173 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:50:15.175 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:50:15.176 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:50:15.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:15.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:15.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:15.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:15.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:15.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:15.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:15.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.539+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:15.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:15.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.567+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:15.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:15.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:15.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:16.774 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:50:16.774 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:50:16.775 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244616 2023-10-14T00:50:16.775 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:50:16.775 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:50:16.776 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:50:16.776 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:50:17.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:17.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:17.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:17.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:17.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:17.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:17.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:17.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:17.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:17.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:17.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:17.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:17.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:17.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:17.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:17.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:17.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:17.191+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:17.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:17.203+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:17.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:17.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:17.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:17.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:19.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:19.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:19.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:19.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:19.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:19.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:19.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:19.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:19.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:19.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:19.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:19.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:19.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:19.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:19.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:19.895+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:19.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:19.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:19.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:19.907+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:19.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:19.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:19.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:19.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:20.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:20.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:20.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:20.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:20.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:20.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:20.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:20.635+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:20.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:20.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:20.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:20.671+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:20.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:20.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:20.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:20.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:20.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:20.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:50:20.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:20.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:21.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:21.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:21.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:21.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:21.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:21.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:21.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:21.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.087+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:21.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:21.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:21.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:50:21.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:21.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:21.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:21.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:21.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:21.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:21.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:21.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:21.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.243+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:21.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:21.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:21.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:21.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:21.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:21.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:21.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:21.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:21.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:50:21.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:21.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:50:21.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:21.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:21.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:21.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:21.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:21.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:21.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:21.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:21.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:21.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.387+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:21.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:21.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:21.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:21.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:21.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:21.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:21.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:21.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:21.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.515+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:21.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:21.523+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:22.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:22.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:22.338 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:50:22.335+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:50:22.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:22.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:22.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:22.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:22.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:22.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.407+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:22.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:22.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:22.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:22.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:22.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:22.791+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:23.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:23.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:23.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:23.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:23.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:23.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:23.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:23.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:50:23.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:23.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:23.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:23.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:23.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:23.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:23.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:23.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:23.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:23.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:23.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:23.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:23.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:25.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:25.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:25.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:25.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:25.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:25.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:25.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:25.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:25.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:25.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:25.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:25.699+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:25.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:25.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:25.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:25.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:26.780 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:50:26.780 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:50:26.781 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:50:26.834 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:50:27.085 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:50:27.083+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:50:28.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:50:28.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:28.127 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:50:28.127 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:50:28.128 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244628 2023-10-14T00:50:28.128 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:50:28.129 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:50:28.129 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:50:28.129 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:50:28.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:28.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:28.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:28.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:28.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:28.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.171+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:28.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.171+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:28.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.179+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:28.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:28.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:28.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:50:28.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:28.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:28.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:28.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:28.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:28.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:28.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:28.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.387+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:28.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:28.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:28.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:28.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:28.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:28.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:28.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.883+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:28.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:28.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:28.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:30.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:50:30.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:30.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:30.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:30.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:30.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:30.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:30.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:30.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:30.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:30.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.199+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:30.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:30.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:30.328 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:50:30.323+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:50:30.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:30.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:30.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:30.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:30.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:30.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:30.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:30.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.555+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:30.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:30.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:30.555+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:32.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:32.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:32.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:32.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:32.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:32.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:32.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:32.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:32.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:32.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:32.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:32.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:32.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:32.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:32.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:32.819+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:32.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:32.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:32.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:32.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:33.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:33.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:33.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:33.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:33.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:33.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:33.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:33.483+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:33.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:33.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:33.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:33.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:33.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:33.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:33.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:33.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:33.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:33.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:33.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:33.575+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:33.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:33.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:33.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:33.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:35.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:35.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:35.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:35.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:35.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:35.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:35.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:35.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:35.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:35.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:35.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:35.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:35.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:35.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:35.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:35.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:35.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:35.747+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:35.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:35.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:35.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:35.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:37.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:37.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:37.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:37.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:37.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:37.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:37.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:37.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:37.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:37.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:38.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:38.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:38.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:38.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:38.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.051+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:38.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:38.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:38.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:50:38.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:50:38.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:38.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:38.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:38.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:38.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:38.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:38.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:38.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.103+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:38.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.103+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:38.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.111+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:38.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:38.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:38.173 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:50:38.174 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:50:38.185 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:50:38.214 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:50:38.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:38.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:38.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:38.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:38.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:38.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:38.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:39.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:39.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:39.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:39.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:39.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:39.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:39.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:39.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:39.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:39.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:39.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:39.207+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:39.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:39.235+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:39.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:39.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:39.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:39.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:39.654 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:50:39.667 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:50:39.681 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244639 2023-10-14T00:50:39.681 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:50:39.681 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:50:39.682 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:50:39.682 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:50:41.579 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:50:41.575+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T00:50:41.580 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:50:41.575+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:50:42.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:42.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:42.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:42.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:42.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:42.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:42.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:42.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:42.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.551+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:42.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:42.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:42.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:42.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:42.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:42.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:42.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:42.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:42.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:42.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.807+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:42.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:42.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:42.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:43.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:43.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:43.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:43.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:43.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:43.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:43.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:43.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:43.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:43.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:43.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:43.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:43.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:43.551+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:43.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:43.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:43.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:43.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:43.620 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:50:43.619+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:50:44.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:44.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:44.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:44.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:44.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:44.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:44.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.499+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:44.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.503+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:44.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.531+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:44.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:44.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:44.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:50:44.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:44.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:44.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:44.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:44.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:44.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:44.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:50:44.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:44.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:44.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:44.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:44.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:44.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:44.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:44.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:44.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:45.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:50:45.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:45.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:45.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:45.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:45.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:45.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:45.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:45.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:45.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:45.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:45.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.351+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:45.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:45.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:50:45.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:45.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:45.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:45.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:45.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:45.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:45.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:45.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:45.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:45.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.747+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:45.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:45.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:45.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:46.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:46.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:46.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:46.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:46.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:46.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:46.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:46.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:46.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.535+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:46.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.535+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:46.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.539+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:46.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.539+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:46.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:46.539+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:47.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:47.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:47.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:47.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:47.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:47.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:47.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:47.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:47.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.619+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:47.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:47.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:47.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:47.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:47.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:47.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:47.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:47.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:47.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:47.755+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:48.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:48.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:48.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:48.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:48.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:48.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:48.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:48.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:48.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:48.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:48.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:48.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:48.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:48.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:48.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:48.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:48.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:48.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:48.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:48.359+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:48.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:48.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:48.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:48.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:49.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:49.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:49.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:49.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:49.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:49.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:49.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:49.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:49.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:49.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:49.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:49.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:49.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:49.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:49.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:49.171+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:49.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:49.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:49.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:49.191+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:49.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:49.191+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:49.706 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:50:49.707 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:50:49.726 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:50:49.739 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:50:50.448 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:50:50.447+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:50:50.915 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:50:50.911+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:50:51.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:51.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:51.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:51.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:51.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:51.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:51.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:51.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:51.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:51.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:51.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:51.375 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:50:51.375 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:50:51.376 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244651 2023-10-14T00:50:51.377 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:50:51.377 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:50:51.377 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:50:51.377 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:50:51.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:51.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:50:51.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:51.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:51.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:51.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:51.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:51.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:51.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:51.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:51.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:51.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.915+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:51.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:51.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:51.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:52.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:52.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:52.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:52.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:52.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:52.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:52.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:52.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:52.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:52.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:52.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:52.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:52.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:52.899+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:52.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:52.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:52.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:52.923+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:52.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:52.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:53.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:53.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:53.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:53.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:53.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:53.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:53.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:53.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:53.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:53.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:53.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:53.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:53.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:53.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:53.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:53.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:53.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:53.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:53.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:53.263+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:54.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:54.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:54.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:54.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:54.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:54.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:54.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:54.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:54.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.267+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:54.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:54.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:54.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:54.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:54.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:54.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:54.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:54.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:54.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:54.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.767+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:54.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:54.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.779+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:54.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:54.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:54.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:55.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:55.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:55.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:55.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:55.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:55.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:55.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:55.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:55.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:55.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.363+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:55.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:55.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:55.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.483+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:55.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.483+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:55.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:55.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:55.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.527+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:55.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.563+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:55.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:55.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:55.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:55.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:55.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:55.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.843+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:55.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.863+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:55.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:55.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:55.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:50:56.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:56.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:50:56.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:56.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:56.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:56.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:56.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:56.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:56.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:56.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:56.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:56.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:56.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:56.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:56.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:56.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:56.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:56.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:57.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:50:57.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:50:57.435 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:50:57.431+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T00:50:57.435 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:50:57.431+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:50:57.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:50:57.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:50:57.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:50:57.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:50:57.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:50:57.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:50:57.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:50:57.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:50:57.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:50:57.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:50:57.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.547+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:50:57.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:50:57.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:50:57.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:00.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:00.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:00.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:00.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:00.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.375+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:00.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:51:00.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:00.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:00.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:00.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:00.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:00.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:00.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:00.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:00.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:00.459+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:01.384 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:51:01.384 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:51:01.384 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:51:01.385 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:51:02.751 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:51:02.752 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:51:02.771 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244662 2023-10-14T00:51:02.771 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:51:02.771 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:51:02.771 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:51:02.772 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:51:03.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:03.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:03.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:03.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:03.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:03.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.035+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:03.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:03.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.059+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:03.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:03.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:03.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:03.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:03.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:03.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:03.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:03.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:03.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:03.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:51:03.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:51:03.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:03.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:03.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:03.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:03.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:03.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:03.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:03.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:03.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:03.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.959+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:03.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:03.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:03.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:04.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:04.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:04.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:04.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:04.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:04.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:04.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:04.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:04.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:04.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:04.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:04.991+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:08.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:08.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:08.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:08.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:08.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:08.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:08.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:08.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:08.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:08.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:08.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:08.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:08.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:08.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:08.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:08.083+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:08.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:08.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:08.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:08.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:10.188 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:51:10.183+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:51:10.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:10.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:10.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:10.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.574+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:10.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:10.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.590+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:10.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:10.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:10.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:10.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:10.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:10.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:11.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:10.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:11.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:11.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:11.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:11.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:11.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:11.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:11.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:11.018+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:12.784 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:51:12.784 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:51:12.797 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:51:12.798 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:51:13.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:13.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:13.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:13.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:13.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:13.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:13.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:13.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:13.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:13.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.326+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:13.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:13.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:13.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:13.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:13.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:13.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:13.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:13.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:13.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:13.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:14.278 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:51:14.278 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:51:14.279 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244674 2023-10-14T00:51:14.280 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:51:14.280 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:51:14.280 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:51:14.280 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:51:14.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:14.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:14.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:14.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:17.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:17.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:17.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:17.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:17.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:17.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:17.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:17.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:17.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:17.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:17.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:17.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:17.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:17.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:17.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:17.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:17.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:17.226+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:17.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:17.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:17.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:17.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:18.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:18.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:18.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:18.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:18.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:18.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:18.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:18.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:18.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:18.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:18.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:18.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:18.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:18.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:18.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:18.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:18.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:18.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:18.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:18.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:19.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:19.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:19.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:19.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:19.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:19.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:19.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:19.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:19.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:19.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:19.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:19.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:19.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:19.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:20.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:20.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:51:20.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:20.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:20.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:20.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:20.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:20.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:20.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:20.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:20.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:20.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:20.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:20.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:20.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:20.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:20.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:20.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:20.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:20.470+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:20.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:20.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:20.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:20.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:21.459 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:51:21.454+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:51:21.459 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:51:21.454+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:51:22.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:22.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:22.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:22.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:22.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:22.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:22.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:22.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:22.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:22.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.690+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:22.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:22.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:22.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:22.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:22.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:22.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:22.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:22.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:51:22.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:22.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:22.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:22.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:22.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:23.702 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:51:23.698+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:51:23.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:23.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:23.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:23.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:23.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:23.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:23.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:23.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:23.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:23.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:23.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:23.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:23.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:23.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:23.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:23.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:23.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:23.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:23.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:23.942+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:24.285 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:51:24.287 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:51:24.308 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:51:24.329 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:51:25.308 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:51:25.298+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:51:25.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:25.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:25.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:25.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:25.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:25.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:25.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:25.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:25.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:25.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:25.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:25.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:25.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:25.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:25.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:25.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:25.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:25.718+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:25.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:25.718+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:25.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:25.718+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:25.763 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:51:25.763 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:51:25.764 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244685 2023-10-14T00:51:25.764 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:51:25.765 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:51:25.765 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:51:25.765 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:51:26.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:51:26.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:26.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:26.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:26.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:26.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:26.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:26.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:26.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:26.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:26.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:26.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.194+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:26.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:26.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:26.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:27.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:27.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:27.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:27.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:28.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:28.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:28.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:28.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:28.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:28.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:28.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:28.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:28.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:28.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:28.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.098+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:28.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:28.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:28.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:28.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:28.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:28.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:28.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:28.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:28.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:28.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.854+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:28.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.874+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:28.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:28.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:28.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:29.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:29.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:29.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:29.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:29.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:29.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:29.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:29.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:29.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:29.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.118+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:29.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:29.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:29.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:51:29.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:51:29.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:29.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:29.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:29.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:29.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:29.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:29.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:29.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:29.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:29.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.686+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:29.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:29.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:29.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:29.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:29.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:29.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:29.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:29.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:29.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:29.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.866+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:29.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:29.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:29.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:30.222 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:51:30.214+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:51:30.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:30.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:30.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:30.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:30.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:30.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:30.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:30.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:30.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:30.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:30.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:30.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:30.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:30.778+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:30.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:30.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:30.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:30.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:31.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:31.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:51:31.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:31.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:32.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:31.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:32.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:32.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:32.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:32.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:32.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:32.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:32.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:32.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:32.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.018+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:32.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:32.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:32.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:32.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:32.206+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:34.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:34.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:34.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:34.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:34.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:34.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:34.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:34.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:34.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.198+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:34.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:34.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:51:34.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:34.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:34.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:34.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:34.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:34.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:34.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:51:34.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:34.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:34.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:34.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:34.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:34.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:34.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:34.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:34.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:34.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.346+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:34.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:34.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:34.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:35.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:35.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:35.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:35.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:35.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:35.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:35.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:35.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:35.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:35.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:35.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.670+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:35.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:35.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:35.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:35.766 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:51:35.768 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:51:35.768 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:51:35.801 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:51:37.029 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:51:37.041 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:51:37.050 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244697 2023-10-14T00:51:37.050 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:51:37.050 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:51:37.050 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:51:37.050 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:51:38.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:38.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:38.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:38.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:38.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:38.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:38.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:38.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:38.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:38.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.354+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:38.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:38.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:38.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:51:38.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:38.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:38.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:38.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:38.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:38.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:38.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:38.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:38.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:38.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:38.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.986+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:38.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:38.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:38.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:42.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:42.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:42.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:42.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:42.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:42.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:42.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:42.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:42.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.590+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:42.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:42.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:42.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:42.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:42.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:42.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:42.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:42.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:42.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:42.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:42.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:42.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:42.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.926+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:42.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:42.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:42.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:43.942 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:51:43.938+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:51:44.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:51:44.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:44.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:44.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:44.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:44.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:44.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:44.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:44.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:44.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.806+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:44.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:44.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.834+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:44.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:44.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:44.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:45.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:45.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:45.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:45.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:45.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:45.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:45.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:45.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:45.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:45.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:45.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:45.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:45.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:45.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:45.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:45.186+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:45.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:45.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:45.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:45.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:47.057 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:51:47.057 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:51:47.060 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:51:47.076 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:51:48.428 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:51:48.429 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:51:48.431 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244708 2023-10-14T00:51:48.431 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:51:48.431 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:51:48.432 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:51:48.432 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:51:48.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:48.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:48.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:48.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:48.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:48.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:48.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:48.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:48.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.674+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:48.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:48.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:48.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:51:48.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:48.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:48.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:48.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:48.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:48.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:48.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:48.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.794+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:48.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.794+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:48.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.794+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:48.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:51:48.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:48.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:48.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:48.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:48.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:48.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:50.564 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:51:50.558+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:51:52.981 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:51:52.978+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:51:54.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:54.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:54.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:54.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:54.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:54.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:54.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:54.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:54.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.570+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:54.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:54.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:54.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:54.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:54.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:54.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:54.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:54.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:54.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.838+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:54.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:54.846+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:54.914 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:51:54.906+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:51:55.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:55.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:55.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:55.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:55.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:55.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:55.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:55.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:55.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:55.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:55.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:55.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:55.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:55.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:55.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:55.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:55.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:55.718+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:55.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:55.718+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:55.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:55.718+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:56.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:56.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:56.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:56.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:56.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:56.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:56.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:56.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:56.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:56.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.682+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:56.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:56.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:56.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:56.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:56.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:56.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:56.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:56.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:56.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.950+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:56.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:56.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.982+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:56.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:56.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:57.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:57.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:57.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:57.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:57.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:57.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:57.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:57.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.546+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:57.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:57.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:57.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:57.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:57.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:57.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:57.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:57.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:57.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:57.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:57.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:57.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:58.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.014+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:58.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:58.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:58.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:58.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:58.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:58.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:58.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:58.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:58.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:58.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.318+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:58.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:58.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.386+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:58.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:58.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:58.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:58.455 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:51:58.460 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:51:58.460 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:51:58.477 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:51:59.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:51:59.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:51:59.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:59.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:59.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:59.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:59.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:59.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:59.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:59.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.574+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:59.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.582+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:59.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:59.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:59.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:59.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:59.797 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:51:59.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:59.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:59.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:51:59.830 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:51:59.837 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244719 2023-10-14T00:51:59.837 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:51:59.837 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:51:59.837 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:51:59.838 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:51:59.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:59.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:59.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:59.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.834+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:59.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:59.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:59.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:59.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:59.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:51:59.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:51:59.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:51:59.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:51:59.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:51:59.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.942+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:51:59.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:51:59.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.946+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:51:59.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:51:59.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:51:59.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:51:59.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:51:59.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:51:59.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:00.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:00.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:00.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:00.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:00.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:00.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:00.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:00.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:00.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:00.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:00.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:00.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:00.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:00.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:00.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:00.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.226+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:00.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:00.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:00.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:00.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:00.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:00.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:00.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:00.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:00.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:00.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:00.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.458+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:00.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:00.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:00.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:00.711 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:52:00.698+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:52:01.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:01.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:01.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:01.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:01.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:01.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:01.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:01.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:01.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:01.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:01.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:01.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.690+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:01.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:01.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:01.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:02.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:02.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:02.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:02.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:02.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:02.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:02.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:02.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:02.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:02.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:02.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:02.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:03.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:03.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:03.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:03.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:03.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.018+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:03.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:03.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:03.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:03.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:52:03.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:03.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:03.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:03.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:03.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:03.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:03.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:03.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:03.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:03.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:03.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:03.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.142+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:03.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:03.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:03.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:04.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:04.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:04.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:04.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:04.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:04.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:04.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:04.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:04.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:04.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.198+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:04.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:04.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:04.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:04.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:04.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:04.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:04.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:04.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:04.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:04.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:04.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.406+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:04.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:04.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:04.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:06.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:06.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:06.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:06.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:06.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:06.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:06.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:06.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:06.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:06.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:06.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:06.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:06.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:06.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:06.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:06.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:06.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:06.222+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:06.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:06.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:06.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:06.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:08.894 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:52:08.890+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:52:09.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:09.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:09.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:09.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:09.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:09.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:09.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:09.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:09.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:09.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:09.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:09.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.242+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:09.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:09.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:09.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:09.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:09.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:09.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:09.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:09.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:09.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:09.842 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:52:09.842 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:52:09.844 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:52:09.848 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:52:11.119 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:52:11.121 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:52:11.123 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244731 2023-10-14T00:52:11.123 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:52:11.123 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:52:11.123 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:52:11.124 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:52:11.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:11.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:11.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:11.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:11.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:11.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:11.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:11.722+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:11.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:11.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:11.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:11.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:12.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:12.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:12.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:12.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:12.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:12.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:12.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:12.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:12.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:12.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:12.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:12.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:12.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:12.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:13.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:13.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:13.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:13.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:13.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:13.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:13.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:13.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:13.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:13.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:13.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.122+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:13.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.122+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:13.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:13.122+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:13.958 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:52:13.914+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:52:14.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:14.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:14.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:14.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:14.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:14.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:14.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:14.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:14.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:14.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:14.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.190+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:14.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:14.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:14.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:52:14.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:14.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:14.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:14.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:14.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:14.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:14.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:14.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:14.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:14.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:14.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:14.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.270+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:14.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:14.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:14.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:17.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:17.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:17.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:17.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:17.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:17.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:17.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:17.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:17.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:17.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:17.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:17.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:17.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:17.970+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:17.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:17.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:17.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:17.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:18.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:18.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:18.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:18.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:18.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:18.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:19.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:19.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:19.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:19.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:19.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:19.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.022+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:19.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:52:19.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:19.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:19.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:19.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:19.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:19.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:19.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:19.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:20.309 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:52:20.306+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:52:21.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:21.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:21.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:21.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:21.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:21.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:21.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:21.125 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:52:21.125 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:52:21.126 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:52:21.133 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:52:21.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:21.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:21.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:21.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.205+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:21.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:21.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:21.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:21.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:21.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:21.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:21.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:22.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:22.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:22.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:22.001+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:22.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:22.001+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:22.573 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:52:22.575 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:52:22.576 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244742 2023-10-14T00:52:22.577 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:52:22.577 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:52:22.577 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:52:22.577 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:52:23.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:23.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:23.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:23.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:23.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:23.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:23.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:23.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:23.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.357+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:23.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:23.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:23.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:52:23.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:23.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:23.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:23.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:23.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:23.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:23.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:23.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:23.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:23.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:23.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:24.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:24.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:24.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:24.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:24.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:24.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:24.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:24.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:24.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:24.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.505+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:24.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:24.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:24.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:24.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:24.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:24.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:24.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:24.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:24.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:24.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:24.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.637+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:24.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.637+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:24.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.637+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:24.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:24.637+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:27.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:27.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:52:28.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:28.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:28.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:28.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:28.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:28.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:28.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:28.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:28.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.041+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:28.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:28.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:28.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:52:28.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:28.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:28.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:28.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:28.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.105+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:28.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:52:28.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:28.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:28.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:28.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:28.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:28.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:30.337 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:52:30.333+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T00:52:30.337 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:52:30.333+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:52:31.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:31.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:31.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:31.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:31.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:31.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:31.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:31.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:31.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:31.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:32.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:32.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.001+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:32.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.013+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:32.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.017+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:32.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:32.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:32.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:32.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:32.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:32.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:32.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:32.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:32.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:32.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:32.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:32.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:32.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:32.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.353+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:32.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:32.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:32.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:52:32.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:32.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:32.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:32.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:32.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:32.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:32.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:32.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:32.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:32.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:32.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.481+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:32.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:32.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:32.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:32.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:32.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:32.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:32.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:32.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:32.588 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:52:32.597 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:52:32.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:32.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:32.598 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:52:32.599 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:52:33.597 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:52:33.597 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:52:33.598 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244753 2023-10-14T00:52:33.598 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:52:33.598 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:52:33.598 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:52:33.599 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:52:34.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:34.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:34.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:34.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:34.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:34.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.157+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:34.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:34.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:52:34.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:34.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:34.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:34.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:34.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:34.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:35.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:35.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:35.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:35.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:35.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:35.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:35.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:35.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:35.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:35.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:35.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:35.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:35.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:35.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:35.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:35.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:35.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:35.097+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:35.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:35.101+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:35.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:35.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:35.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:35.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:37.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:37.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:37.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:37.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:37.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:37.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:37.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:37.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:37.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:37.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:37.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:37.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:37.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:37.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:37.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:37.561+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:37.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:37.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:37.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:37.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:38.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:38.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:38.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:38.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:38.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:38.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:38.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:38.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:38.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:38.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.273+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:38.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:38.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:38.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:38.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:38.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:38.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:38.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:38.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:38.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:38.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:38.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:38.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.713+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:38.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:38.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:39.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:39.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:39.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:39.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:39.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:39.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:39.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:39.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:39.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:39.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:39.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:39.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:39.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:39.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:39.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:39.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:39.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:39.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:39.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:39.553+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:39.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:39.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:39.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:39.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:41.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:41.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:41.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:41.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:41.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:41.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:41.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:41.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:41.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:41.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.437+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:41.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.445+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:41.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:41.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:41.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:42.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:42.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:42.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:42.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:42.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:42.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:42.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:42.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:42.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:42.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:42.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:42.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:42.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:42.501+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:43.657 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:52:43.664 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:52:43.666 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:52:43.685 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:52:44.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:52:44.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:44.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:44.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:44.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:44.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:44.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:44.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:44.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:44.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:44.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:44.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:44.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.245+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:44.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:44.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:44.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:44.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:44.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:44.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:44.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:44.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:44.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:44.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:44.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:44.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.821+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:44.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.821+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:44.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:44.821+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:45.076 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:52:45.083 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:52:45.084 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244765 2023-10-14T00:52:45.084 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:52:45.084 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:52:45.084 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:52:45.085 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:52:45.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:45.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:45.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:45.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:45.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:45.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:45.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:45.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:45.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:45.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:45.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:45.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:45.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:45.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:46.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:46.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:46.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:46.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:46.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:46.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:46.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:46.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:46.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:46.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:46.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.593+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:46.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:46.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:46.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:47.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:47.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:47.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:47.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:47.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:47.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:47.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:47.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:47.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:47.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:47.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:47.473+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:47.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:47.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:47.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:47.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:48.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:52:48.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:48.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:48.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:48.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:48.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:48.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:48.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:48.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:48.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:48.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.605+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:48.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:48.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:48.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:49.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:49.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:49.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:49.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:49.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:49.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:49.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:49.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:49.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:49.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:49.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.549+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:49.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:49.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:49.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:52.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:52.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:52.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:52.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:52.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:52.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:52.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:52.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:52.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:52.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.341+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:52.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:52.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:52.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:52:52.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:52:52.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:52.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:52.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:52.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:52.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:52.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:52.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:52.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.985+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:52.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.985+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:52.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.985+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:52.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:52.985+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:53.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:53.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:53.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:53.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:53.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:53.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:53.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:53.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:53.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:53.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:53.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:53.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:53.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:53.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:53.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:53.695 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:52:53.689+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:52:54.913 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:52:54.909+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:52:55.096 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:52:55.102 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:52:55.109 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:52:55.112 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:52:55.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:55.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:55.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:55.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:55.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:55.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:55.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:55.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:55.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:55.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:55.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:55.505+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:55.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:55.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:52:55.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:55.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:52:55.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:55.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:52:56.624 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:52:56.624 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:52:56.625 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244776 2023-10-14T00:52:56.625 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:52:56.625 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:52:56.625 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:52:56.626 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:52:57.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:57.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:57.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:57.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:52:57.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:52:57.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:57.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.057+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:52:57.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:52:57.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:52:57.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:52:57.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:52:57.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:52:57.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:52:57.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:52:57.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:52:58.731 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:52:58.725+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:53:00.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:00.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:00.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:00.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:00.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:00.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:00.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:00.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:00.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:00.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:00.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:00.137+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:00.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:00.153+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:00.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:00.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:00.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:00.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:01.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:01.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:01.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:01.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:01.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:01.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:01.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:01.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:02.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:01.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:02.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:02.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:02.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:02.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:02.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:02.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:02.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:02.093+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:02.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:02.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:02.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:02.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:02.433 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:53:02.429+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:53:03.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:03.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:03.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:03.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:03.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:03.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:03.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:03.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:03.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:03.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:03.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:03.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:03.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:03.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:03.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:03.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:03.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:03.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:03.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:03.465+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:03.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:03.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:03.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:03.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:04.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:04.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:04.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:04.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:04.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:04.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:04.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:04.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:04.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:04.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:04.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:04.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:04.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:04.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:04.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:04.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:04.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:04.413+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:04.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:04.413+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:04.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:04.413+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:05.431 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:53:05.425+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:53:06.630 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:53:06.639 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:53:06.639 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:53:06.649 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:53:07.280 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:53:07.269+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:53:07.974 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:53:07.975 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:53:07.976 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244787 2023-10-14T00:53:07.976 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:53:07.976 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:53:07.977 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:53:07.977 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:53:08.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:08.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:08.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:08.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:08.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:08.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:08.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:08.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:08.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:08.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:08.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:08.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:08.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:08.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:08.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:08.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:08.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:08.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:08.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:08.861+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:08.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:08.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:08.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:08.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:10.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:10.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:10.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:10.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:10.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:10.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:10.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:10.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:10.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:10.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:10.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.281+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:10.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:10.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:10.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:13.208 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:53:13.201+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:53:13.208 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:53:13.201+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:53:13.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:13.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:13.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:13.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:13.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:13.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:13.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:13.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:13.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:13.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:13.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:13.397+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:13.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:13.397+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:13.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:13.405+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:13.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:13.405+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:13.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:13.405+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:17.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:17.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:53:17.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:17.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:53:17.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:17.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:17.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:17.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:17.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:17.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:17.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:17.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:17.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:17.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:17.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:17.497+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:17.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:17.497+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:17.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:17.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:17.999 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:53:17.999 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:53:18.022 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:53:18.023 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:53:18.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:18.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:18.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:18.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:18.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:18.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:18.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:18.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.161+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:18.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:18.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:18.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:18.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:18.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:18.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:18.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:18.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:18.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:18.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:18.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.469+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:18.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.469+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:18.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.469+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:18.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:18.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:18.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:18.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:18.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:18.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:18.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:18.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:18.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:18.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:18.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.981+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:18.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:18.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:18.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:19.376 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:53:19.377 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:53:19.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244799 2023-10-14T00:53:19.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:53:19.380 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:53:19.381 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:53:19.381 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:53:20.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:20.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:20.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:20.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:20.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:20.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:20.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:20.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:20.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:20.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:20.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:20.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:20.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:20.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:20.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:20.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:20.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:20.577+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:20.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:20.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:20.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:20.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:21.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:21.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:21.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:21.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:21.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:21.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:21.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:21.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:21.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.193+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:21.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:21.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:21.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:21.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:21.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:21.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:21.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:21.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:21.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:21.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:21.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:21.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.485+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:21.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:21.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:21.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:25.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:53:25.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:53:25.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:25.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:25.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:25.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:25.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:25.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:25.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:25.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:25.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:25.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:25.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.161+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:25.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.165+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:25.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:25.165+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:27.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:27.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:27.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:27.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:27.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:27.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:27.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:27.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:27.222 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:53:27.217+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:53:27.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:27.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:27.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:27.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:27.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:27.269+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:29.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:53:29.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:29.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:29.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:29.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:29.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:29.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:29.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:29.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:29.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:29.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.357+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:29.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:29.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:29.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:29.401 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:53:29.401 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:53:29.401 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:53:29.401 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:53:30.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:53:30.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:53:30.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:30.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:30.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:30.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:30.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:30.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:30.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:30.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:30.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:30.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:30.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.369+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:30.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:30.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:30.698 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:53:30.699 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:53:30.701 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244810 2023-10-14T00:53:30.701 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:53:30.701 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:53:30.701 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:53:30.701 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:53:30.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:30.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:30.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:30.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:30.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:30.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:30.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:31.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:31.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:31.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:31.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:31.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:31.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:31.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:31.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:31.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:31.540+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:31.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:31.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:32.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:32.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:32.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:32.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:32.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:32.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:32.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:32.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:32.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:32.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:32.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:32.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:32.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:32.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:33.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:33.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:33.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:33.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:33.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:33.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:33.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:33.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:33.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:33.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.240+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:33.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:33.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:33.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:33.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:33.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:33.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:33.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:33.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:33.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.504+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:33.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:33.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:33.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:33.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:33.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:33.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:33.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:33.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:33.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:34.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.016+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:34.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.020+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:34.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.020+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:34.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.020+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:34.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:34.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:34.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:34.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:34.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:34.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:34.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:34.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:34.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:34.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.624+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:34.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:34.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:34.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:36.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:36.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:53:36.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:36.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:36.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:36.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:36.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:36.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:36.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:36.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:36.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:36.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:36.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:36.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:36.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:36.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:36.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:36.752+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:36.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:36.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:36.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:36.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:37.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:37.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:37.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:37.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:37.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:37.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:37.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:37.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:37.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:37.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:37.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:37.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:37.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:37.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:37.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:37.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:37.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:37.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:37.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:37.536+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:37.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:37.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:37.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:37.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:37.639 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:53:37.632+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:53:38.782 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:53:38.768+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:53:38.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:38.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:38.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:38.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:38.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:38.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:38.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:38.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:39.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:38.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:39.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:39.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:39.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:39.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:39.664 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:53:39.656+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:53:39.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:39.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:39.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:39.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:39.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:39.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:39.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:39.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:39.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:39.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:39.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.920+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:39.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:39.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:39.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:40.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:53:40.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:53:40.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:40.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:40.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:40.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:40.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:40.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:40.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:40.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:40.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:40.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:40.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.140+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:40.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:40.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:40.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:53:40.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:40.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:40.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:40.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:40.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:40.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:40.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.192+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:40.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:40.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:53:40.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:53:40.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:40.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:40.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:40.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:40.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:40.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:40.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:40.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:40.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:40.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:40.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.300+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:40.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:40.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:40.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:40.721 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:53:40.721 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:53:40.724 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:53:40.730 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:53:41.306 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:53:41.300+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:53:42.126 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:53:42.127 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:53:42.127 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244822 2023-10-14T00:53:42.127 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:53:42.128 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:53:42.128 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:53:42.128 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:53:44.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:44.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:44.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:44.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:44.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:44.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:44.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:44.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:44.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.148+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:44.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.152+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:44.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.152+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:44.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.152+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:44.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:53:44.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:53:44.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:44.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:44.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:44.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:44.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:44.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:44.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:44.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:44.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:44.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:44.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.324+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:44.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:44.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:44.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:46.242 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:53:46.240+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:53:46.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:46.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:46.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:46.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:46.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:46.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:46.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:46.500+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:46.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:46.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:46.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:46.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:46.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:46.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:46.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:46.860+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:46.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:46.880+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:46.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:46.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:46.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:46.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:47.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:47.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:47.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:47.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:47.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:47.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:47.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:47.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:47.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:47.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.172+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:47.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:47.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:47.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:47.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:47.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:47.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:47.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:47.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:47.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:47.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:47.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:47.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.376+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:47.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:47.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:47.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:48.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:48.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:48.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:48.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:48.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:48.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:48.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:48.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:48.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:48.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.476+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:48.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:48.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:48.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:48.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:48.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:48.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:48.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:48.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:48.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:48.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:48.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:48.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:48.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.704+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:48.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:48.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:48.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:48.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:48.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:48.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:48.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:48.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:48.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:49.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:49.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:49.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:49.024+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:49.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:49.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:49.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:49.088+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:49.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:49.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:49.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:49.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:50.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:50.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:50.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:50.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:50.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:50.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:50.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:50.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:50.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:50.940+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:50.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:50.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:53:50.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:50.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:50.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:50.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:50.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:50.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:50.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:50.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:50.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:50.972+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:52.129 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:53:52.130 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:53:52.130 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:53:52.130 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:53:52.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:52.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:52.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:52.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:53.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:53.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:53.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:53.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.096+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:53.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:53.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.164+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:53.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:53.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:53.491 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:53:53.491 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:53:53.492 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244833 2023-10-14T00:53:53.492 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:53:53.492 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:53:53.493 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:53:53.493 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:53:53.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:53:53.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:53.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:53.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:53.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:53.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:53.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:53.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:53.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:53.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:53.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:53.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.960+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:53.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:53.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:53.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:55.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:53:55.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:53:55.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:55.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:55.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:55.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:55.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:55.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:55.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:55.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:55.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:55.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:55.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.572+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:55.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:55.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:55.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:56.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:56.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:56.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:56.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:56.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:56.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:56.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:56.208+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:58.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:58.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:53:58.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:58.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:53:58.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:58.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:58.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:58.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:58.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:58.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:58.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:58.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:53:58.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:58.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:58.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:58.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:58.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:58.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:58.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:58.684+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:58.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:58.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:58.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:58.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:53:59.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:59.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:53:59.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:59.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:53:59.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:59.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:53:59.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:59.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:53:59.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:59.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:53:59.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:59.060+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:53:59.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:59.072+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:53:59.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:59.096+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:53:59.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:59.096+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:53:59.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:53:59.096+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:00.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:54:00.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:54:00.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:54:00.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:00.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:00.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:00.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:00.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:00.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:00.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:00.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:00.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:00.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.748+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:00.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:00.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:00.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:03.514 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:54:03.525 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:54:03.531 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:54:03.537 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:54:04.960 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:54:04.966 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:54:04.967 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244844 2023-10-14T00:54:04.968 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:54:04.968 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:54:04.968 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:54:04.968 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:54:05.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:54:05.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:05.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:05.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:05.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:05.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:05.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:05.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:05.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:05.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:05.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.872+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:05.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:05.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:05.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:05.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:54:06.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:06.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:06.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:06.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:06.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:06.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:06.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:06.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.024+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:06.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.024+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:06.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.024+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:06.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.024+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:06.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.024+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:06.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:06.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:06.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:06.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:06.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:06.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:06.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:06.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:06.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:06.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.124+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:06.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:06.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:06.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:06.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:06.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:06.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:06.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:06.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:06.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:06.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:06.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:06.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.512+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:06.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:06.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:12.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:54:12.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:54:12.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:54:12.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:12.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:12.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:12.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:12.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:12.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:12.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:12.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:12.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:12.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.784+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:12.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:12.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:12.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:14.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:14.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:14.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:14.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:14.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:14.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:14.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:14.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:14.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:14.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:14.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:14.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:14.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:14.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:14.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:14.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.828+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:14.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:14.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:14.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:14.969 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:54:14.971 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:54:14.974 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:54:14.999 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:54:16.244 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:54:16.249 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:54:16.251 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244856 2023-10-14T00:54:16.251 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:54:16.251 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:54:16.251 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:54:16.251 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:54:18.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:54:18.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:18.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:18.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:18.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:18.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:18.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:18.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:18.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:18.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:18.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.424+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:18.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:18.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:18.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:18.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:18.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:18.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:18.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:18.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:18.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:18.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:18.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:18.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.636+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:18.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.636+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:18.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:54:18.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:54:18.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:54:18.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:18.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:18.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:18.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:18.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:18.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:18.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:18.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:18.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:18.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.860+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:18.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:18.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:19.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:19.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:19.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:19.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:19.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:19.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:19.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:19.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:19.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:19.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:20.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:20.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:20.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:20.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:20.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:20.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:20.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:20.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:20.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:20.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:20.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:20.048+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:20.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:20.048+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:20.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:20.048+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:23.508 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:54:23.508+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:54:24.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:54:24.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:24.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:24.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:24.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:24.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:24.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:24.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:24.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:24.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:24.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.300+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:24.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:24.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:24.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:54:24.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:54:24.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:24.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:24.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:24.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:24.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:24.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:24.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:24.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.844+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:24.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:24.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:24.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:26.271 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:54:26.271 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:54:26.280 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:54:26.282 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:54:26.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:26.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:26.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:26.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:26.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:26.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:26.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:26.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:26.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:26.416+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:26.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:26.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:26.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:26.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:27.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:27.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:27.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:27.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:27.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:27.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:27.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:27.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:27.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:27.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:27.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:27.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:27.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:27.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:27.236 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:54:27.236+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:54:27.468 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:54:27.468 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:54:27.469 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244867 2023-10-14T00:54:27.469 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:54:27.469 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:54:27.469 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:54:27.469 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:54:31.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:54:31.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:31.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:31.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:31.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:31.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:31.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:31.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:31.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:31.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:31.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.960+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:31.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:31.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:31.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:32.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:54:32.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:54:32.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:54:32.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:32.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:32.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:32.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:32.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:32.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:32.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:32.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:32.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:32.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.564+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:32.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:32.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:32.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:33.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:33.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:33.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:33.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:33.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:33.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:33.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:33.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:33.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:33.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:33.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:33.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:33.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:33.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:33.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:33.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:33.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:33.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:33.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:33.784+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:33.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:33.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:33.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:33.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:34.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:34.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:34.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:34.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:34.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:34.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:34.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:34.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:34.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:34.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:34.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:34.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:34.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:34.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:34.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:34.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:34.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:34.800+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:34.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:34.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:34.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:34.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:35.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:35.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:35.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:35.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:35.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:35.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:35.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:35.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:35.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:35.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:35.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:35.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:54:35.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:35.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:35.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:35.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:35.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:35.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:35.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:37.472 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:54:37.477 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:54:37.478 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:54:37.478 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:54:38.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:38.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:38.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:38.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:38.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:38.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:38.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:38.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:38.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:38.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:38.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:38.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:38.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:38.652+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:38.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:38.688+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:38.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:38.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:38.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:38.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:38.969 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:54:38.986 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:54:38.988 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244878 2023-10-14T00:54:38.989 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:54:38.989 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:54:38.989 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:54:38.989 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:54:39.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:54:39.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:39.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:39.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:39.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:39.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:39.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:39.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:39.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:39.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.108+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:39.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:39.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:39.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:39.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:39.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:39.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:39.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:39.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:39.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.908+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:39.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:39.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:54:39.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:39.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:39.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:39.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:41.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:41.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:54:41.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:41.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:54:41.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:41.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:41.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:41.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:41.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:41.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:41.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:41.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:41.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:41.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:42.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:42.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:42.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:42.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:42.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:42.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:42.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:42.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:42.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:42.019+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:42.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:42.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:42.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:42.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:43.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:43.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:43.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:43.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:43.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:43.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:43.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:43.511+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:43.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:43.511+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:43.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:43.511+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:43.854 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:54:43.851+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:54:43.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:43.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:54:44.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:43.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:44.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:44.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:44.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:44.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:44.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:44.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:44.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:44.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:44.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.055+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:44.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:44.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:44.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:44.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:44.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:44.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:44.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:44.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.619+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:44.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:44.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:44.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:44.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:44.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:44.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:44.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:44.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:44.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:44.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:44.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.895+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:44.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.907+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:44.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:44.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:44.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:47.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:47.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:47.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:47.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:47.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:47.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:47.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:47.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:47.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:47.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:47.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:47.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:47.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:47.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:47.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:47.963+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:47.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:47.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:48.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:48.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:48.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:48.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:48.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:48.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:48.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:48.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:48.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:48.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:48.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:48.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:48.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:48.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:48.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:48.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:48.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:48.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:48.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:48.823+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:48.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:48.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:48.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:48.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:48.991 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:54:48.991 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:54:48.994 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:54:49.002 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:54:49.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:54:49.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:49.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:49.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:49.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:49.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:49.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:49.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:49.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.639+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:49.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:49.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.679+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:49.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:49.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:49.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:50.248 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:54:50.251 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:54:50.252 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244890 2023-10-14T00:54:50.253 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:54:50.253 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:54:50.253 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:54:50.253 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:54:50.576 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:54:50.575+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:54:50.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:50.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:50.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:50.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:50.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:50.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:50.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:50.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:50.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:50.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:50.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:50.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:50.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:50.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:50.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:50.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:50.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:50.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:50.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:50.819+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:50.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:50.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:51.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:51.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:51.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:51.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:51.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:51.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:51.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:51.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:51.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:51.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:51.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:51.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:51.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:51.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:51.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:51.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:51.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:51.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:51.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:51.743+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:51.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:51.751+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:51.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:51.751+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:53.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:53.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:53.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:53.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:53.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:53.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:53.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:53.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:53.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:53.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:53.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:53.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:53.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:53.347+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:53.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:53.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:53.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:53.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:53.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:53.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:54.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:54.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:54.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:54.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:54.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:54.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:54.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:54.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:54.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:54.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.451+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:54.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:54.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:54.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:54.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:54.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:54.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:54.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:54.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:54.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:54.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:54.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:54.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:54.963+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:55.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:54:55.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:55.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:55.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:55.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:55.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:55.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:55.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:55.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:55.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:55.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.731+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:55.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:55.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:55.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:54:56.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:56.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:54:56.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:56.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:54:56.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:56.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:56.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:56.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:56.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:56.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:56.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:56.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:56.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:56.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:56.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:56.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:56.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:56.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:56.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:56.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:56.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:56.279+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:56.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:56.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:57.391 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:54:57.387+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:54:58.079 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:54:58.075+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:54:58.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:58.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:54:58.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:58.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:54:58.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:58.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:54:58.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:58.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:54:58.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:58.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:54:58.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:58.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:54:58.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:58.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:54:58.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:58.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:54:58.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:58.219+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:54:58.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:58.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:54:58.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:54:58.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:00.254 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:55:00.258 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:55:00.274 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:55:00.283 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:55:01.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:01.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:01.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:01.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:01.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:01.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:01.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:01.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:01.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:01.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:01.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:01.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:01.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:01.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:01.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:01.699 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:55:01.700 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:55:01.700 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244901 2023-10-14T00:55:01.701 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:55:01.701 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:55:01.701 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:55:01.701 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:55:02.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:02.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:02.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:02.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:03.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:03.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:03.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:03.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:03.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:03.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:03.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:03.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:03.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:03.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:03.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:03.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:03.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:03.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:03.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:03.207+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:03.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:03.207+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:03.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:03.207+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:03.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:03.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:03.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:03.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:04.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:04.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:04.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:04.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:04.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:04.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:04.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:04.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:04.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:04.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:04.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:04.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:04.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:04.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:04.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:04.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:04.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:04.207+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:04.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:04.215+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:04.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:04.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:04.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:04.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:05.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:05.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:05.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:05.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:05.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:05.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:05.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:05.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:05.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:05.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:05.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:05.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:05.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:05.807+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:05.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:05.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:05.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:05.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:06.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:06.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:06.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:06.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:06.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:06.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:06.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.103+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:06.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.103+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:06.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.103+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:06.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.103+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:06.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.103+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:06.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:55:06.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:06.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:06.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:06.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:06.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:06.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:06.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:06.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:06.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:06.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.967+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:06.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:06.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:06.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:09.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:55:09.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:09.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:09.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:09.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:09.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:09.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:09.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:09.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:09.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.247+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:09.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:09.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:09.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:09.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:09.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:09.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:09.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:09.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:09.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:09.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:09.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:09.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:11.706 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:55:11.707 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:55:11.727 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:55:11.727 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:55:13.069 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:55:13.067+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:55:13.078 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:55:13.079 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:55:13.080 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244913 2023-10-14T00:55:13.080 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:55:13.081 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:55:13.081 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:55:13.081 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:55:13.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:13.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:13.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:13.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:13.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:13.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:13.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:13.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:13.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:13.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:13.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:13.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:13.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:13.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:13.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:13.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:13.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:13.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:13.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:13.411+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:13.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:13.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:13.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:13.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:14.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:14.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:14.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:14.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:14.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:14.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:14.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.835+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:14.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:14.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:14.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:55:14.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:55:14.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:55:14.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:14.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:14.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:14.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:14.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:14.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:14.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:14.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:14.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:14.991+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:15.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:15.003+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:15.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:15.003+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:15.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:15.003+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:16.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:55:16.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:16.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:16.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:16.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:16.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:16.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:16.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:16.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:16.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:16.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.407+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:16.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:16.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:16.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:17.234 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:55:17.227+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:55:20.301 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:55:20.299+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:55:20.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:20.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:20.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:20.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:20.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:20.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:20.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:20.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:20.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:20.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:20.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:20.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:20.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:20.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:20.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:20.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:20.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:20.871+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:20.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:20.871+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:20.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:20.871+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:20.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:20.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:21.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:21.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:21.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:21.031+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:21.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:21.031+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:21.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:21.031+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:22.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:22.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:22.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:22.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:22.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:22.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:22.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:22.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:22.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:22.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:22.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:22.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:23.084 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:55:23.084 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:55:23.085 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:55:23.089 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:55:23.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:23.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:55:24.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:24.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:24.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:24.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:24.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:24.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:24.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:24.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:24.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:24.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:24.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:24.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:24.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:24.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:24.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:24.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:24.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:24.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:24.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:24.163+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:24.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:24.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:24.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:24.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:24.335 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:55:24.336 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:55:24.336 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244924 2023-10-14T00:55:24.337 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:55:24.337 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:55:24.337 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:55:24.337 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:55:25.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:25.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:25.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:25.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:25.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:25.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:25.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:25.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:25.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:25.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:25.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:25.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:25.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:25.435+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:25.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:25.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:25.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:25.463+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:25.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:25.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:25.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:25.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:27.462 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:55:27.459+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:55:27.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:27.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:27.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:27.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:27.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:27.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:27.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:27.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:27.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:27.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:27.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:27.603+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:27.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:27.603+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:27.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:27.603+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:27.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:27.603+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:27.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:27.603+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:28.002 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:55:27.999+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:55:28.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:28.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:28.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:28.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:28.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:28.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:28.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:28.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:28.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:28.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:28.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:28.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:28.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:28.139+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:28.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:28.187+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:30.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:30.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:30.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:30.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:30.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:30.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:30.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:30.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:30.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:30.539+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:30.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:30.539+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:30.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:30.539+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:30.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:30.539+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:31.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:31.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:31.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:31.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:31.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:31.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:31.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:31.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:31.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:31.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:31.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:31.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:31.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:31.087+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:31.639 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:55:31.635+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:55:32.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:32.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:32.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:32.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:32.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:32.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:32.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:32.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:32.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:32.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:32.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:32.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:32.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:32.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:32.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:32.499+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:32.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:32.519+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:33.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:55:33.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:55:33.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:55:33.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:33.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:33.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:33.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:33.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:33.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:33.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.159+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:33.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:33.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.179+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:33.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:33.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:33.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:55:33.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:55:33.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:55:33.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:33.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:33.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:33.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:33.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:33.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:33.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:33.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:33.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.235+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:33.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:33.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:33.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:33.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:33.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:33.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:33.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:33.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:33.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:33.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:33.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:33.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.615+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:33.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.615+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:33.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.615+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:33.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:55:33.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:55:33.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:33.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:33.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:33.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:33.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:33.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:33.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:33.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:33.991+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:34.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:34.003+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:34.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:34.003+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:34.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:34.003+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:34.342 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:55:34.343 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:55:34.343 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:55:34.343 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:55:35.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:35.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:35.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:35.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:35.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:35.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:35.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:35.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:35.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:35.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:35.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:35.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:35.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:35.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:35.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:35.511+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:35.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:35.535+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:35.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:35.539+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:35.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:35.539+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:35.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:35.539+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:35.677 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:55:35.678 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:55:35.679 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244935 2023-10-14T00:55:35.679 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:55:35.679 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:55:35.681 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:55:35.681 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:55:36.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:36.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:36.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:36.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:36.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:36.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:36.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:36.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:36.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:36.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:36.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:36.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:36.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:36.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:36.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:36.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:36.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:36.111+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:36.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:36.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:36.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:36.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:38.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:55:38.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:55:38.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:55:38.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:38.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:38.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:38.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:38.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:38.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:38.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:38.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:38.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:38.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:38.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:38.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:38.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:55:38.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:55:38.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:55:38.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:38.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:38.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:38.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:38.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:38.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:38.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:38.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:38.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:38.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:38.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:38.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:39.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:39.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:39.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:39.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:39.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:39.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:39.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:39.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:39.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:39.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:39.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:39.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:39.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:39.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:41.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:41.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:41.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:41.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:41.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:41.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:41.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:41.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:41.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:41.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:41.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:41.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:42.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:42.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:55:42.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:42.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:42.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:42.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:42.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:42.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:42.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:42.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:42.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:42.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:42.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:42.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:42.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:42.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:42.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:42.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:42.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:42.163+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:42.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:42.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:42.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:42.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:44.067 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:55:44.063+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:55:44.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:44.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:44.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:44.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:44.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:44.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:44.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:44.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:44.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:44.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:44.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:44.735+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:44.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:44.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:44.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:44.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:45.692 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:55:45.694 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:55:45.696 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:55:45.700 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:55:45.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:45.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:55:45.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:45.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:45.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:45.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:45.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:45.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:45.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:45.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:45.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:45.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:45.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:45.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:45.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:45.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:45.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:45.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:45.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:45.951+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:45.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:45.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:45.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:45.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:46.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:46.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:46.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:46.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:46.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:46.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:46.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:46.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:46.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:46.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:46.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:46.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:46.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:46.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:46.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:46.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:46.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:46.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:46.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:46.303+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:46.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:46.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:46.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:46.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:47.041 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:55:47.041 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:55:47.042 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244947 2023-10-14T00:55:47.042 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:55:47.042 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:55:47.043 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:55:47.043 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:55:47.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:47.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:47.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:47.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:47.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:47.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:47.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:47.479+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:48.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:55:48.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:48.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:48.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:48.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:48.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:48.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:48.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:48.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:48.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:48.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.783+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:48.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:48.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:48.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:49.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:49.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:49.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:49.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:49.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:49.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:49.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:49.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:49.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:49.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.267+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:49.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:49.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:49.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:49.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:49.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:49.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:49.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:49.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:49.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:49.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:49.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.447+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:49.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:49.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:49.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:51.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:51.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:51.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:51.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:51.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:51.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:51.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:51.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:51.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:51.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:51.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:51.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:51.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:51.626+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:52.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:52.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:52.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:52.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:52.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:52.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:52.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:52.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:53.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:53.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:53.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:53.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:53.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:53.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:53.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:53.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:53.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:53.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:53.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:53.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:53.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:53.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:53.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:53.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:53.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:53.310+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:53.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:53.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:53.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:53.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:57.044 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:55:57.048 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:55:57.051 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:55:57.052 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:55:57.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:55:57.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:55:57.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:55:57.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:55:57.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:55:57.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:55:57.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:55:57.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:55:57.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:55:57.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:55:57.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:55:57.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.962+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:55:57.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:55:57.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:55:57.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:55:58.349 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:55:58.349 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:55:58.350 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244958 2023-10-14T00:55:58.350 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:55:58.350 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:55:58.350 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:55:58.350 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:56:02.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:02.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:02.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:02.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:02.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:02.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:02.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:02.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:02.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:02.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:02.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:02.990+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:02.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:02.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:02.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:02.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:03.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:03.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:03.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:03.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:03.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:03.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:03.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:03.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:03.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:03.782+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:03.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:03.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:03.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:03.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:03.891 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:56:03.886+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:56:04.034 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:56:04.030+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:56:05.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:05.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:05.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:05.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:05.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:05.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:05.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:05.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:05.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:05.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:05.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:05.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:05.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:05.950+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:05.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:05.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:05.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:05.990+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:06.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:06.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:06.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:06.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:06.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:06.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:06.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:06.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:06.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:06.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:06.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.474+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:06.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.482+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:06.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:06.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:06.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:07.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:07.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:07.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:07.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:07.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:07.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:07.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:07.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:07.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:07.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:07.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:07.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:07.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:07.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:07.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:07.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:07.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:07.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:07.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:07.158+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:08.021 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:56:08.018+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:56:08.352 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:56:08.363 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:56:08.366 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:56:08.369 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:56:09.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:09.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:09.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:09.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:09.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:09.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:09.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:09.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:09.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:09.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:09.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:09.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:09.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:09.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:09.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:09.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:09.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:09.630+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:09.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:09.646+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:09.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:09.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:09.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:09.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:09.749 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:56:09.749 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:56:09.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244969 2023-10-14T00:56:09.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:56:09.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:56:09.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:56:09.751 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:56:10.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:10.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:10.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:10.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:10.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:10.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:10.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:10.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:10.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:10.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:10.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:10.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:10.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:10.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:10.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:10.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:10.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:10.294+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:10.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:10.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:10.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:10.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:11.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:11.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:11.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:11.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:11.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:11.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:11.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:11.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:11.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:11.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:11.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:11.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:11.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:11.102+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:11.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:11.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:11.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:11.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:12.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:12.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:12.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:12.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:12.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:12.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:12.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:12.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:12.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:12.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:12.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:12.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:12.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:12.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:12.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:12.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:12.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:12.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:12.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:12.910+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:12.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:12.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:12.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:12.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:14.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:14.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:14.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:14.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:14.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:14.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:14.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:14.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:14.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:14.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:14.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:14.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:14.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:14.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:14.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:14.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:14.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:14.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:14.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:14.886+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:14.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:14.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:14.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:14.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:17.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:17.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:17.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:17.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:17.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:17.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:17.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:17.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:17.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:17.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:17.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:17.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:17.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:17.378+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:17.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:17.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:17.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:17.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:18.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:18.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:18.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:18.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:18.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:18.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:18.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:18.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:18.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:18.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:18.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:18.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:18.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:18.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:18.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:18.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:18.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:18.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:18.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:18.350+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:18.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:18.350+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:18.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:18.350+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:19.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:56:19.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:56:19.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:19.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:19.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:19.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:19.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:19.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:19.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:19.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:19.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:19.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:19.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.126+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:19.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:19.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:19.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:56:19.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:19.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:19.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:19.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:19.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:19.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:19.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:19.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:19.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.382+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:19.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:19.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:19.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:19.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:19.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:19.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:19.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:19.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:19.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:19.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:19.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.622+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:19.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:19.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:19.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:19.757 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:56:19.758 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:56:19.768 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:56:19.768 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:56:20.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:20.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:20.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:20.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:20.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:20.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:20.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:20.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:20.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.782+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:20.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:20.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:20.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:56:20.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:20.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:20.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:20.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:20.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:20.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:21.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:21.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:21.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:21.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:21.082 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:56:21.082 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:56:21.083 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244981 2023-10-14T00:56:21.083 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:56:21.083 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:56:21.084 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:56:21.084 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:56:21.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.082+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:21.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.082+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:21.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.082+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:21.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:56:21.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:56:21.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:21.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:21.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:21.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:21.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:21.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:21.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:21.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:21.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:56:21.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:56:21.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:21.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:21.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:21.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:21.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:21.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:21.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:21.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:21.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:21.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:21.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.198+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:21.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:21.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:21.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:56:21.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:21.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:21.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:21.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:21.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:21.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:22.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:22.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:22.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:22.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:22.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:22.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:22.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:22.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:22.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.566+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:22.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.566+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:22.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.566+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:22.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:22.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:22.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:23.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:23.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:23.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:23.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:23.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:23.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:23.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:23.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:23.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:23.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:23.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:23.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:24.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:24.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:24.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:24.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.026+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:24.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:24.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:24.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:24.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:24.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:24.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:24.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.882+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:24.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:24.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:24.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:24.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.930+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:24.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:24.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:24.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:26.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:26.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:26.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:26.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:26.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:26.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:26.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:26.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.350+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:26.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:26.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.354+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:26.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:26.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:26.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:56:26.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:56:26.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:26.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:26.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:26.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:26.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:26.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:26.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:26.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:26.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:26.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.466+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:26.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:26.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:26.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:27.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:27.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:27.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:27.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:27.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:27.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:27.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:27.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:27.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:27.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:27.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:27.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:27.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:27.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:27.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:27.930+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:29.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:29.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:29.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:29.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.122+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:29.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.142+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:29.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:29.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:29.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:56:29.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:56:29.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:29.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:29.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:29.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:29.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:29.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:29.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:29.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:29.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:29.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:29.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.398+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:29.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:29.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:29.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:30.966 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:56:30.962+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:56:31.085 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:56:31.085 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:56:31.087 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:56:31.090 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:56:32.280 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:56:32.281 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:56:32.283 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697244992 2023-10-14T00:56:32.283 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:56:32.283 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:56:32.283 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:56:32.283 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:56:33.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:33.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:33.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:33.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:33.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:33.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:34.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:34.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:34.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:34.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:34.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:34.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:34.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:34.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:34.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:34.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:34.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.194+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:34.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:34.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:34.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:56:34.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:34.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:34.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:34.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:34.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:34.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:34.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:34.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:34.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.442+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:34.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:34.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:34.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:34.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:34.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:34.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:34.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:35.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:35.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:35.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:35.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:35.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:35.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:35.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:35.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:35.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:35.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:35.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:35.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:35.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:35.290+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:35.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:35.290+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:35.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:35.290+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:35.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:35.290+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:36.102 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:56:36.098+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:56:36.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:36.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:36.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:36.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:36.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:36.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:36.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:36.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:36.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:36.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:36.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:36.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:36.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:36.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:36.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:36.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:36.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:36.146+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:36.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:36.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:36.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:36.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:37.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:37.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:56:37.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:37.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:38.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:37.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:38.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:37.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:38.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:37.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:38.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:37.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:38.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:37.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:38.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:38.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:38.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:38.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:38.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:38.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:38.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:38.066+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:38.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:38.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:38.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:38.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:39.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:39.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:39.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:39.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:39.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:39.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:39.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:39.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:39.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:39.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:39.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:39.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:39.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:39.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:39.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:42.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:42.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:56:42.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:42.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:42.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:42.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:42.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:42.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:42.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:42.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:42.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:42.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:42.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:42.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:42.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:42.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:42.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:42.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:42.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:42.222+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:42.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:42.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:42.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:42.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:42.311 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:56:42.312 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:56:42.313 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:56:42.330 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:56:43.838 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:56:43.838 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:56:43.840 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245003 2023-10-14T00:56:43.840 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:56:43.840 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:56:43.841 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:56:43.841 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:56:44.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:44.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:44.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:44.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:44.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:44.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:44.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:44.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:44.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.126+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:44.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:44.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:44.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:44.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:44.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:44.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:44.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:44.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:44.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:44.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:44.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:44.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:44.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.450+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:44.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:44.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:44.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:44.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:44.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:44.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:44.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:44.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:44.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:44.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.874+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:44.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:44.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:44.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:45.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:56:45.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:45.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:45.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:45.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:45.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:45.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:45.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:45.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:45.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.382+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:45.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:45.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:45.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:56:45.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:45.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:45.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:45.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:45.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:45.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:45.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:45.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:45.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.398+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:45.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:45.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:45.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:45.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:45.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:45.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:45.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:45.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:45.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:45.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:45.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:46.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.058+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:46.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:46.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:46.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:46.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:46.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:46.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:46.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:46.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:46.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:46.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:46.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.470+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:46.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.474+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:46.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.474+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:46.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:46.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:46.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:46.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:46.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:46.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:46.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:46.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:46.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.562+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:46.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.562+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:46.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.562+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:46.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.562+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:46.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.562+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:46.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:46.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:46.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:46.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:47.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:47.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:47.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:47.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:47.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:47.066+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:47.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:47.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:47.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:47.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:51.094 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:56:51.090+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:56:51.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:51.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:51.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:51.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:51.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:51.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:51.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:51.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:51.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:51.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:51.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:51.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:51.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:51.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:51.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:51.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:51.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:51.338+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:51.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:51.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:51.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:51.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:53.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:53.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:53.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:53.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:53.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:53.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:53.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:53.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:53.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:53.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:53.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:53.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:53.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:53.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:53.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:53.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:53.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:53.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:53.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:53.178+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:53.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:53.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:53.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:53.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:53.844 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:56:53.851 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:56:53.884 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:56:53.892 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:56:54.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:56:54.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:54.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:54.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:54.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:54.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:54.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:54.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:54.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:54.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.486+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:54.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:54.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:54.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:54.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:54.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:54.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:54.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:54.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:54.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.658+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:54.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:54.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.738+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:54.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:54.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:54.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:54.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:54.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:54.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:54.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:55.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:55.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:55.044 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:56:55.050 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:56:55.051 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245015 2023-10-14T00:56:55.052 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:56:55.052 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:56:55.052 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:56:55.052 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:56:55.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:55.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:55.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:55.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:55.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:55.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:55.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:55.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:55.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:55.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:55.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:55.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:55.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:55.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:58.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:58.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:58.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:58.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:58.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:58.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:58.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:58.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:58.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:58.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:58.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:58.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:58.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:58.558+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:58.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:58.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:58.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:58.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:56:59.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:56:59.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:56:59.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:56:59.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:56:59.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:56:59.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:56:59.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:56:59.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:56:59.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:56:59.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:56:59.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.489+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:56:59.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:56:59.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:56:59.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:00.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:00.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:00.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:00.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:00.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:00.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:00.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:00.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:00.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:00.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:00.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:00.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:00.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:00.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:00.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:00.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:00.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:00.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:00.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:00.373+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:00.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:00.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:00.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:00.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:02.134 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:57:02.129+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:57:02.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:57:02.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:57:02.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:02.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:02.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:02.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:02.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:02.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:02.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:02.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.933+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:02.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:02.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.953+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:02.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:02.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:02.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:03.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:03.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:03.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:03.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:03.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:03.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:03.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:03.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:03.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:03.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:03.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:03.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:03.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:03.301+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:03.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:03.301+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:03.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:03.301+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:04.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:04.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:04.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:04.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:04.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:04.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:04.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:04.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:04.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:04.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:04.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:04.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:04.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:04.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:04.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:04.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:04.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:04.501+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:04.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:04.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:04.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:04.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:05.055 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:57:05.059 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:57:05.072 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:57:05.075 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:57:05.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:57:05.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:57:05.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:05.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:05.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:05.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:05.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:05.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:05.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:05.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:05.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:05.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:05.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.245+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:05.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:05.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:05.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:05.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:05.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:05.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:05.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:05.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:05.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.665+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:05.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.693+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:05.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:05.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:05.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:57:05.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:05.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:05.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:05.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:05.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:05.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:05.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:05.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:05.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:05.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:05.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:05.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:05.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.925+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:05.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:05.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:05.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:06.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:06.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:06.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:06.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:06.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:06.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:06.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:06.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.385+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:06.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:06.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:06.418 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:57:06.419 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:57:06.420 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245026 2023-10-14T00:57:06.420 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:57:06.420 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:57:06.420 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:57:06.421 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:57:06.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:06.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:06.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:06.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:06.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:06.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:06.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.917+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:06.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:06.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.941+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:06.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:06.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:06.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:07.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:57:07.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:57:07.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:07.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:07.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:07.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:07.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:07.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:07.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:07.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:07.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:07.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:07.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.093+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:07.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:07.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:07.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:07.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:07.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:07.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:07.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:07.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:07.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:07.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:07.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:08.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:08.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:08.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:08.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:10.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:10.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:10.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:10.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:10.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:10.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:10.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:10.293 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:57:10.289+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:57:10.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:10.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:10.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:10.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:10.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:10.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:10.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:10.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:10.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:10.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:10.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.625+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:10.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:10.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:10.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:14.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:14.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:14.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:14.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:14.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:14.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:14.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:14.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:14.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:14.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.281+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:14.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:14.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:14.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:14.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:15.068 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:57:15.065+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:57:16.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:16.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:16.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:16.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:16.426 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:57:16.427 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:57:16.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:16.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:16.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:16.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:16.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:16.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:16.439 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:57:16.446 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:57:16.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:16.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:16.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:16.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:16.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:16.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:16.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:16.501+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:16.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:16.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:16.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:16.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:17.618 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:57:17.619 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:57:17.621 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245037 2023-10-14T00:57:17.621 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:57:17.621 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:57:17.622 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:57:17.622 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:57:18.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:18.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:18.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:18.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:18.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:18.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:18.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:18.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:18.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:18.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:18.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.209+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:18.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:18.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:18.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:18.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:18.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:18.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:18.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:18.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:18.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:18.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:18.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:18.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.401+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:18.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:18.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:18.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:57:18.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:57:18.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:18.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:18.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:18.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:18.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:18.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:18.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:18.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:18.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:18.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:18.985+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:19.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:19.005+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:19.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:19.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:19.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:19.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:26.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:57:26.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:26.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:26.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:26.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:26.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:26.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:26.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:26.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:26.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.397+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:26.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.397+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:26.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.413+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:26.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.413+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:26.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.413+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:26.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:26.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:26.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:26.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:26.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:26.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:26.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:26.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:26.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.737+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:26.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:26.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:26.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:27.634 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:57:27.635 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:57:27.641 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:57:27.647 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:57:29.067 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:57:29.070 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:57:29.071 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245049 2023-10-14T00:57:29.072 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:57:29.072 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:57:29.072 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:57:29.072 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:57:29.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:29.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:29.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:29.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:29.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:29.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:29.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:29.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:29.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:29.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:29.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:29.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:29.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:29.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:29.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:29.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:29.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:29.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:29.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:29.989+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:29.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:29.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:30.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:30.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:30.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:30.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:30.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:30.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:30.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:30.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:30.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:30.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:30.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:30.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:30.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:30.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:30.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:30.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:30.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:30.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:30.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:30.817+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:30.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:30.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:30.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:30.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:31.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:31.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:31.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:31.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:31.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:31.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:31.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:31.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:31.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:31.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:32.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:31.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:32.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:31.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:32.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:32.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.033+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:32.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:32.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:32.233 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:57:32.229+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:57:32.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:32.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:32.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:32.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:32.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:32.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:32.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:32.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:32.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:32.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.329+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:32.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:32.329+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:33.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:57:33.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:33.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:33.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:33.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:33.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:33.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:33.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:33.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:33.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:33.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.437+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:33.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:33.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:33.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:33.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:33.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:33.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:33.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:33.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:33.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:34.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:34.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:34.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:34.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:34.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:34.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:34.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:34.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:34.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:34.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:34.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:34.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:34.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:34.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:34.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:34.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:34.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:34.825+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:34.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:34.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:34.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:34.849+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:36.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:36.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:36.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:36.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:36.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:36.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:36.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:36.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:36.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:36.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:36.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.585+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:36.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:36.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:36.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:37.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:37.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:37.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:37.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:37.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:37.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:37.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:37.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:37.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:37.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:37.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:37.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:37.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:37.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:37.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:37.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:37.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:37.893+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:37.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:37.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:37.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:37.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:38.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:38.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:57:38.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:38.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:38.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:38.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:38.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:38.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:38.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:38.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:38.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:38.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:38.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:38.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:38.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:38.853+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:39.074 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:57:39.074 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:57:39.074 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:57:39.094 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:57:40.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:40.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:40.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:40.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:40.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:40.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:40.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:40.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:40.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:40.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:40.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.609+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:40.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:40.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:40.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:40.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:40.677 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:57:40.677 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:57:40.678 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245060 2023-10-14T00:57:40.678 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:57:40.678 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:57:40.678 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:57:40.679 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:57:41.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:41.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:41.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:41.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:41.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:41.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:41.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:41.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:41.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:41.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:41.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.125+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:41.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:41.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:41.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:43.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:57:43.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:43.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:43.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:43.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:43.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:43.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:43.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:43.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:43.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.313+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:43.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:43.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:43.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:43.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:43.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:43.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:43.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:43.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.797+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:43.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.797+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:43.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:43.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:43.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:43.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:44.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:43.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:44.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:44.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:44.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:44.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.029+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:44.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.069+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:44.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:44.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:44.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:44.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:44.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:44.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:44.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:44.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:44.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:44.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:44.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.237+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:44.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:44.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:44.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:44.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:44.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:44.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:44.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:44.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:44.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:44.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:44.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:47.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:47.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:57:47.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:47.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:47.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:47.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:47.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:47.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:47.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:47.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:47.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:47.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:47.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:47.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:47.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:47.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:47.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:47.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:47.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:47.937+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:47.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:47.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:47.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:47.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:48.112 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:57:48.109+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:57:48.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:48.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:48.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:48.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:49.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:48.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:49.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:48.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:49.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:49.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.021+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:49.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:49.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:49.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:49.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:49.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:49.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:49.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:49.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:49.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:49.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:49.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.517+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:49.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.517+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:49.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.517+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:49.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:49.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:49.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:49.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:49.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:49.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:49.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:49.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:49.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:49.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.913+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:49.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:49.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:50.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:50.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:50.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:50.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:50.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:50.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:50.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:50.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.449+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:50.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:50.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:50.691 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:57:50.691 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:57:50.692 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:57:50.697 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:57:50.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:50.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:50.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:50.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:50.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:50.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:50.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:50.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:50.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.853+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:50.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.865+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:50.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.865+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:50.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:50.865+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:51.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:51.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:51.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:51.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:51.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:51.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:51.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:51.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:51.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:51.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:51.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:51.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:51.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:51.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:51.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:51.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:51.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:51.713+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:51.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:51.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:51.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:51.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:52.204 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:57:52.219 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:57:52.222 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245072 2023-10-14T00:57:52.222 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:57:52.223 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:57:52.223 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:57:52.223 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:57:52.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:57:52.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:57:52.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:52.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:52.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:52.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:52.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:52.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:52.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:52.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:52.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.413+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:52.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:52.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.449+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:52.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:52.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:52.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:57:52.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:52.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:52.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:52.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:52.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:52.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:52.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:52.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:52.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:52.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:52.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.801+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:52.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:52.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:52.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:53.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:57:53.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:57:53.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:53.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:53.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:53.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:53.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:53.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:53.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:53.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:53.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:53.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.901+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:53.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:53.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:53.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:55.135 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:57:55.129+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:57:55.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:55.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:55.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:55.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:55.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:55.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:55.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:55.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:55.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:55.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:55.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:55.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:55.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:55.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:55.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:55.329+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:55.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:55.329+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:55.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:55.329+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:55.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:55.329+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:55.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:55.329+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:56.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:56.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:56.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:56.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:56.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:56.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:56.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:56.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:56.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:56.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:56.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:56.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:56.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:56.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:56.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:56.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:56.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:56.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:56.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:56.765+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:56.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:56.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:56.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:56.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:57.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:57.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:57.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:57.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:57.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:57.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:57.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:57.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:57.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:57.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:57.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:57.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:57.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:57.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:57.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:57.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:57.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:57.345+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:57.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:57.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:57.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:57.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:57:58.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:58.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:57:58.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:58.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:57:58.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:58.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:57:58.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:58.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:57:58.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:58.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:57:58.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:58.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:57:58.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:58.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:57:58.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:58.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:57:58.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:58.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:57:58.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:58.729+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:57:58.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:58.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:57:58.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:57:58.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:00.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:00.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:00.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:00.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:00.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:00.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:00.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:00.469+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:00.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:00.481+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:00.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:00.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:00.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:00.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:01.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:01.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:01.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:01.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:01.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:01.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:01.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:01.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:01.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:01.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:01.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:01.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:01.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:01.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:01.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:01.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:01.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:01.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:01.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:01.501+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:01.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:01.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:01.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:01.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:02.230 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:58:02.230 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:58:02.238 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:58:02.242 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:58:02.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:02.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:02.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:02.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:02.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:02.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:02.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:02.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:02.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:02.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:02.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:02.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:02.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:02.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:02.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:02.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:02.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:02.797+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:02.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:02.865+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:02.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:02.865+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:02.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:02.865+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:03.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:03.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:03.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:03.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:03.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:03.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:03.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:03.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:03.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:03.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:03.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:03.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:03.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:03.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:03.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:03.293+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:03.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:03.293+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:03.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:03.293+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:03.678 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:58:03.679 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:58:03.680 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245083 2023-10-14T00:58:03.680 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:58:03.680 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:58:03.681 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:58:03.681 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:58:06.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:06.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:06.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:06.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:06.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:06.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:06.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:06.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:06.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:06.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:06.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.328+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:06.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:06.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:06.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:06.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:06.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:06.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:06.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:06.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:06.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:06.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:06.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.844+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:06.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:06.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:06.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:06.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:07.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:07.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:07.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:07.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:07.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:07.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.092+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:07.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:07.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.124+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:07.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:07.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:07.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:07.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:07.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:07.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:07.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:07.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:07.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:07.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:08.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:08.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:08.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:08.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:08.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:08.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:08.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:08.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:08.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:08.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:08.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:08.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.688+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:08.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:08.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:08.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:08.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:08.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:08.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:08.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:08.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:08.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:08.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:08.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:08.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.904+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:08.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:08.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:08.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:09.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:09.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:09.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:09.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:09.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:09.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:09.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:09.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:09.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:09.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:09.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:09.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:09.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:09.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:09.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:09.832+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:09.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:09.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:09.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:09.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:10.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:10.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:10.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:10.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:10.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:10.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:10.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:10.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:10.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:10.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.524+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:10.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:10.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:10.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:10.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:10.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:10.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:10.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:10.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:10.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.920+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:10.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:10.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:10.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:11.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:11.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:11.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:11.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:11.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:11.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:11.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:11.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:11.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:11.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:11.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:11.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:11.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:11.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:11.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:11.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:11.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:11.440+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:11.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:11.448+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:11.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:11.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:11.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:11.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:12.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:12.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:12.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:12.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:12.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:12.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:12.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:12.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:12.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:12.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:12.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:12.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:12.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:12.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:12.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:12.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:12.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.584+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:12.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.584+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:12.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.584+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:12.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.584+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:12.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:12.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:12.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:12.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:12.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:12.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:13.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:13.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:13.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:13.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:13.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:13.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:13.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:13.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:13.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:13.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:13.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:13.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:13.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:13.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:13.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:13.683 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:58:13.689 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:58:13.689 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:58:13.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.692+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:13.701 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:58:13.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.744+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:13.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:13.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:13.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:14.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:14.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:14.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:14.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:14.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:14.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:14.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:14.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:14.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:14.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.804+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:14.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:14.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:14.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:14.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:14.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:14.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:14.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:14.891 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:58:14.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:14.892 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:58:14.893 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245094 2023-10-14T00:58:14.893 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:58:14.893 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:58:14.893 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:58:14.894 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:58:14.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:14.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:14.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:14.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.932+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:14.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:14.932+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:15.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:15.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:15.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:15.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:15.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:15.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:15.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:15.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:16.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:16.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:16.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:16.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:16.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:16.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:16.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:16.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:16.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:16.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:16.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:16.044+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:16.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:16.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:16.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:16.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:19.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:19.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:19.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:19.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:19.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:19.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:19.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:19.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:19.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:19.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:19.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:19.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:19.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:19.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:19.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:19.540+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:19.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:19.548+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:19.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:19.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:19.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:19.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:20.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:20.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:20.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:20.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:20.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:20.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:20.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.540+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:20.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:20.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.572+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:20.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:20.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:20.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:20.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:20.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:20.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:20.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:20.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:20.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:20.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:20.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:20.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:20.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.800+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:20.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:20.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:20.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:21.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:21.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:21.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:21.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:21.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:21.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:21.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:21.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:21.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:21.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:21.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:21.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:21.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:21.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:21.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:21.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:21.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:21.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:21.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:21.256+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:21.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:21.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:21.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:21.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:22.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:22.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:22.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:22.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:22.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:22.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:22.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:22.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:22.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:22.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:22.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.368+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:22.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.368+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:22.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.368+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:22.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:22.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:22.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:22.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:22.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:22.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:22.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:22.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.752+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:22.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:22.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:22.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:22.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:22.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:22.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:22.940+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:23.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:23.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:23.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:23.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:23.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:23.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:23.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:23.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:23.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:23.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:23.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:23.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:23.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:23.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:23.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:23.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:23.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:23.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:23.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:23.748+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:23.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:23.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:24.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:24.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:24.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:24.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:24.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:24.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.504+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:24.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:24.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.588+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:24.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:24.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:24.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:24.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:24.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:24.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:24.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:24.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:24.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:24.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:24.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:24.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:24.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:24.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:24.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:24.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:24.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:24.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:24.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:24.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:24.794 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:58:24.792+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:58:24.895 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:58:24.895 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:58:24.896 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:58:24.898 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:58:26.209 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:58:26.209 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:58:26.210 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245106 2023-10-14T00:58:26.210 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:58:26.210 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:58:26.210 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:58:26.210 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:58:27.989 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:58:27.988+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:58:28.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:28.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:28.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:28.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:28.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:28.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:28.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:28.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:28.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:28.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.444+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:28.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:28.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:28.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:28.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:28.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:28.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:28.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:28.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:28.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:28.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:28.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:28.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:28.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:29.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:29.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:29.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:29.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:29.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:29.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:29.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:29.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:29.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:29.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:29.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:29.092+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:29.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:29.104+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:29.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:29.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:29.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:29.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:30.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:30.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:30.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:30.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:30.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:30.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:30.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:30.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:30.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:30.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:30.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:30.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.220+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:30.245 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:58:30.244+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:58:30.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:30.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:30.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:30.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:30.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:30.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:30.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:30.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:30.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:30.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:30.536+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:31.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:31.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:31.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:31.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:31.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:31.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:31.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:31.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:31.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:31.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:31.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:31.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:31.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.356+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:31.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:31.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:31.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:31.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:31.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:31.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:31.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:31.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:31.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:31.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:31.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:31.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:31.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.868+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:31.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:31.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:31.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:32.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:32.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:32.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:32.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:32.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:32.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:32.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:32.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:32.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:32.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:32.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:32.936+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:32.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:32.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:32.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:32.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:35.837 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:58:35.836+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:58:36.211 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:58:36.218 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:58:36.219 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:58:36.236 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:58:36.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:36.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:36.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:36.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:36.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:36.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:36.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:36.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:36.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:36.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:36.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:36.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:36.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:36.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:36.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:36.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:36.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:36.772+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:36.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:36.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:36.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:36.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:37.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:37.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:37.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:37.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:37.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:37.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:37.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:37.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:37.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:37.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:37.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:37.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:37.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:37.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:37.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:37.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:37.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:37.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:37.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:37.448+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:37.744 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:58:37.748 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:58:37.749 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245117 2023-10-14T00:58:37.749 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:58:37.749 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:58:37.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:58:37.750 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:58:38.301 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:58:38.300+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:58:38.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:38.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:38.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:38.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:38.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:38.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:38.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:38.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.744+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:38.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:38.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:38.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:38.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:38.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:38.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:38.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:38.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:38.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:38.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:38.880+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:39.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:39.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:39.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:39.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:39.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:39.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:39.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:39.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:39.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:39.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:39.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:39.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:39.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:39.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:39.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:39.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:39.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:39.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:39.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:39.544+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:39.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:39.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:39.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:39.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:41.458 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:58:41.456+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:58:41.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:41.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:41.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:41.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:41.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:41.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:41.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:41.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:41.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:41.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:41.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.932+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:41.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:41.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:41.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:42.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:42.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:42.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:42.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:42.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:42.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:42.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:42.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:42.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:42.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.532+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:42.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.544+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:42.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:42.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:42.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:42.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:42.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:42.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:42.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:42.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:42.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:42.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:42.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:42.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:42.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:42.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:42.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.728+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:42.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:42.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:42.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:43.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:43.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:43.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:43.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:43.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:43.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:43.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:43.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:43.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:43.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:43.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:43.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:43.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:43.616+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:43.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:43.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:44.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:44.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:44.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:44.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:44.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:44.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:44.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:44.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:44.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:44.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:44.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.444+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:44.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:44.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.480+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:44.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.480+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:44.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.480+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:44.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:44.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:44.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:44.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:44.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:44.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:44.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:44.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:44.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:44.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:44.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:44.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:44.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.684+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:44.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:44.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:44.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:44.919 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:58:44.916+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:58:45.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:45.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:45.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:45.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:45.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:45.072+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:45.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:45.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:45.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:45.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:45.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:45.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:45.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:45.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:45.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:45.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:45.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:45.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:45.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:45.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:46.168 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:58:46.168+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:58:46.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:46.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:46.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:46.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:46.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:46.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:46.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:46.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:46.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:46.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:46.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.344+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:46.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:46.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:46.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:46.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:46.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:46.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:46.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:46.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:46.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:46.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:46.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:46.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.556+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:46.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:46.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:46.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:47.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:47.172 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T00:58:47.168+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T00:58:47.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:47.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:47.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:47.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:47.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:47.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:47.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:47.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:47.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:47.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.236+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:47.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:47.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:47.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:47.750 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:58:47.751 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:58:47.765 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:58:47.783 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:58:48.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:48.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:48.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:48.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:48.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:48.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:48.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:48.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:48.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:48.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:48.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:48.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:48.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:48.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:48.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:48.312+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:48.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:48.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:48.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:48.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:49.188 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:58:49.188 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:58:49.189 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245129 2023-10-14T00:58:49.189 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:58:49.190 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:58:49.190 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:58:49.190 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:58:49.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:49.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:49.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:49.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:49.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:49.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:49.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:49.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:49.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:49.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:49.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:49.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:49.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:49.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:49.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:49.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:49.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:49.884+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:49.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:49.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:49.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:49.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:50.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:50.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:50.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:50.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:50.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:50.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:50.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:50.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:50.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:50.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:50.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:50.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:50.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:50.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:52.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:52.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:52.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:52.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:52.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:52.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:52.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.640+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:52.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:52.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:52.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:52.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:52.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:52.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:52.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:52.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:52.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:53.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:53.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:53.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:53.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.008+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:53.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:53.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:53.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:53.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:53.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:53.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:53.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:53.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:53.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:53.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:53.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:53.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:53.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:53.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.188+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:53.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:53.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:53.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:58:53.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:58:53.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:53.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:58:53.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:53.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:53.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:53.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:53.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:53.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:53.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.280+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:53.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.280+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:53.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.280+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:53.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:53.280+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:54.564 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:58:54.564+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:58:54.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:54.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:58:54.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:54.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:58:54.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:54.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:58:54.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:54.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:58:54.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:54.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:54.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:54.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:54.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:54.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:54.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:54.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:54.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:54.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:54.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:54.796+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:54.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:54.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:54.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:54.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:58.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:58.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:58:58.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:58.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:58:58.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:58.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:58:58.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:58.048+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:58:58.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:58.052+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:58:58.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:58.100+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:58:58.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:58.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:58:58.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:58:58.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:58:59.208 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:58:59.212 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:58:59.212 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:58:59.219 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:59:00.643 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:59:00.653 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:59:00.654 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245140 2023-10-14T00:59:00.654 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:59:00.654 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:59:00.655 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:59:00.655 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:59:00.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:00.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:00.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:00.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:00.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:00.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:00.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:00.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:00.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:00.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:00.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:00.916+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:00.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:00.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:59:00.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:00.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:00.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:00.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:00.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:00.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:01.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:01.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:01.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:01.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:01.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:01.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:01.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:01.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:01.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:01.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.356+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:01.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:01.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:01.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:01.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:01.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:01.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:01.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:01.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:01.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:01.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.608+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:01.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:01.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:01.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:59:01.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:01.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:02.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:02.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:02.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:02.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:02.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:02.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:02.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:02.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:02.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:02.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:02.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:02.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:02.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:02.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:02.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:02.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:02.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:02.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:02.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:02.736+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:02.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:02.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:02.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:02.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:03.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:03.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:59:03.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:03.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:59:03.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:03.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:03.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:03.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:03.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:03.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:03.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:03.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:03.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:03.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:03.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:03.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:03.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:03.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:03.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:03.256+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:03.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:03.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:03.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:03.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:05.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:05.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:05.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:05.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:05.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:05.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:05.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:05.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:05.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:05.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:05.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:05.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:05.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:05.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:06.249 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:59:06.248+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:59:08.148 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:59:08.148+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:59:08.431 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:59:08.428+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:59:08.638 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:59:08.635+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:59:09.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:09.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:09.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:09.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:09.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:09.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:09.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:09.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.567+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:09.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:09.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:09.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:09.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:09.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:09.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:09.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:09.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:09.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:09.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:09.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:09.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:09.947+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:10.656 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:59:10.656 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:59:10.658 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:59:10.659 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:59:11.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:11.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:11.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:11.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:11.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:11.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:11.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:11.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:11.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:11.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:11.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:11.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:12.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:59:12.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:12.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:12.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:12.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:12.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:12.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:12.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:12.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:12.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:12.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.051+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:12.123 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:59:12.123 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:59:12.125 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245152 2023-10-14T00:59:12.125 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:59:12.125 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:59:12.125 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:59:12.126 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:59:12.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:12.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:12.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:12.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:12.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:12.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:12.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:12.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:12.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:12.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:12.487+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:14.735 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:59:14.731+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T00:59:14.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:14.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:14.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:14.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:14.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:14.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:14.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:14.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:14.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:14.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:14.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:14.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:14.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:14.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:14.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:14.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:14.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:14.927+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:14.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:14.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:14.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:14.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:15.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:15.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:15.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:15.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:15.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:15.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:15.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:15.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:15.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:15.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:15.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:15.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:15.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:15.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:15.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:15.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:15.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:15.431+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:15.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:15.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:15.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:15.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:16.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:16.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:16.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:16.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:16.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:16.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:16.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:16.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:16.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:16.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:16.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:16.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:16.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:16.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:16.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:16.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:16.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:16.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:16.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:16.099+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:16.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:16.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:16.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:16.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:19.332 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:59:19.331+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:59:19.943 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:59:19.939+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:59:20.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:20.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:20.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:20.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:20.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:20.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:20.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:20.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:20.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:20.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.811+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:20.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:20.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:20.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:20.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:20.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:20.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:20.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:20.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:20.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:21.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:21.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:59:21.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:21.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:21.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:21.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:21.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:21.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:21.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:21.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:21.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:21.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:21.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:21.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:21.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:21.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:21.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:21.783+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:21.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:21.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:21.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:21.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:22.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:21.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:22.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:22.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:22.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:22.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:22.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:22.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:22.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:22.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:22.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.071+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:22.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:22.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:22.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:59:22.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:22.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:22.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:22.128 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:59:22.134 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:59:22.140 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:59:22.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:22.165 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:59:22.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:22.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:22.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:22.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.207+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:22.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.207+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:22.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:22.207+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:23.580 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:59:23.580 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:59:23.581 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245163 2023-10-14T00:59:23.581 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:59:23.581 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:59:23.582 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:59:23.582 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:59:23.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:23.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:23.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:23.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:24.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:24.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:24.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:24.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:24.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:24.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:24.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:24.035+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:24.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:24.039+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:24.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:24.043+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:24.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:24.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:24.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:24.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:26.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:59:26.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:26.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:26.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:26.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:26.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:26.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:26.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:26.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:26.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:26.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.343+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:26.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.343+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:26.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:26.343+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:27.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:59:27.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:59:27.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:27.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:27.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:27.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:27.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:27.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:27.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:27.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:27.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.115+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:27.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:27.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:27.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:27.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:27.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:27.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:27.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:28.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:27.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:28.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:28.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:28.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:28.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:28.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:28.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:28.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:28.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:28.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:28.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:28.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:28.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.767+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:28.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.783+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:28.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:28.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:28.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:28.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:28.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:28.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:29.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:29.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:29.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:29.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:29.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:29.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:29.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:29.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:29.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:29.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:29.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:29.067+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:29.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:29.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:29.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:29.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:30.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:30.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:30.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:30.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:30.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:30.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:30.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:30.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:30.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:30.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.407+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:30.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:30.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:30.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:59:30.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:30.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:30.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:30.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:30.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:30.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:30.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:30.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:30.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:30.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.947+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:30.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:30.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:30.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:33.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:33.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:33.590 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:59:33.594 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:59:33.595 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:59:33.611 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:59:33.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:59:33.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:33.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:33.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:33.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:33.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:33.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:33.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:33.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:33.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:33.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.971+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:33.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.971+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:33.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:33.971+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:34.964 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:59:34.964 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:59:34.965 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245174 2023-10-14T00:59:34.965 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:59:34.965 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:59:34.965 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:59:34.966 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:59:35.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:35.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:35.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:35.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:35.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:35.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:35.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:35.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:35.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:35.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:35.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:35.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:35.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:35.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:35.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:35.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:35.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:35.903+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:35.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:35.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:35.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:35.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:36.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:36.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:36.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:36.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:36.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:36.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:36.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:36.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:36.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:36.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.667+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:36.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:36.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:36.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:59:36.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:59:36.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:36.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:36.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:36.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:36.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:36.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:36.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:36.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:36.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:36.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.963+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:36.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:36.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:36.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:36.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:42.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:59:42.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:42.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:42.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:42.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:42.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:42.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:42.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:42.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.155+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:42.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.155+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:42.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.155+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:42.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.155+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:42.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:42.155+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:43.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:43.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:43.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:43.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:43.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:43.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:43.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:43.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:43.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:43.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.435+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:43.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:43.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:43.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.623+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:43.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:43.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:43.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:43.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:43.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:44.967 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:59:44.972 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:59:44.978 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:59:44.986 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:59:45.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:59:45.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:45.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:45.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:45.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:45.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:45.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:45.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:45.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:45.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:45.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.095+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:45.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:45.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:45.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:46.074 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:59:46.075 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:59:46.076 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245186 2023-10-14T00:59:46.076 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:59:46.076 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:59:46.077 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:59:46.077 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:59:46.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:46.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:46.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:46.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:46.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:46.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:46.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:46.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:46.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:46.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:46.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:46.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:46.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:46.751+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:46.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:46.767+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:46.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:46.779+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:46.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:46.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:46.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:46.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:48.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:59:48.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:59:48.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:59:48.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:48.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:48.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:48.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:48.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:48.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:48.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:48.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:48.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:48.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.863+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:48.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:48.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:48.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:49.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:49.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:49.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:49.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:49.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:49.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:49.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:49.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:49.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:49.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:49.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:49.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:49.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:49.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:49.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:49.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:49.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:49.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:49.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:49.471+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:49.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:49.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:49.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:49.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:51.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:51.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:51.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:51.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:51.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:51.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:51.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:51.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:51.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:51.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:51.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:51.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:51.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:51.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:51.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:51.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:51.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:51.183+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:51.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:51.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:51.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:51.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:52.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:52.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:52.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:52.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:52.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:52.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:52.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:52.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:52.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:52.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:53.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:59:53.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:59:53.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:53.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:53.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:53.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:53.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:53.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:53.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:53.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:53.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:53.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.287+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:53.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:53.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:53.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:53.974 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T00:59:53.971+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T00:59:56.079 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T00:59:56.079 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T00:59:56.085 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T00:59:56.099 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T00:59:57.642 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T00:59:57.644 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T00:59:57.648 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245197 2023-10-14T00:59:57.649 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T00:59:57.649 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T00:59:57.649 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T00:59:57.649 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T00:59:57.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:57.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T00:59:57.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:57.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T00:59:57.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:57.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:57.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:57.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:57.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:57.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:57.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:57.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:57.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:57.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:57.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:57.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:58.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:58.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:58.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:58.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:58.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:58.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:58.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:58.019+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:58.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:58.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:58.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:58.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:59.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:59.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:59.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:59.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:59.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:59.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:59.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:59.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:59.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.411+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:59.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:59.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T00:59:59.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T00:59:59.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T00:59:59.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T00:59:59.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T00:59:59.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T00:59:59.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T00:59:59.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T00:59:59.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T00:59:59.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T00:59:59.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T00:59:59.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.887+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T00:59:59.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T00:59:59.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T00:59:59.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:00.061 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:00:00.059+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:00:01.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:00:01.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:00:01.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:00:01.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:01.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:01.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:01.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:01.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:01.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:01.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:01.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:01.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:01.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.127+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:01.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:01.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:01.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:01.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:01.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:01.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:01.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:01.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:01.459 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:00:01.455+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:00:01.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:01.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.519+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:01.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:01.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:01.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:03.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:03.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:03.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:03.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:03.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:03.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:03.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:03.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:03.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:03.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:03.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:03.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:03.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:03.474+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:03.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:03.474+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:03.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:03.474+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:03.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:03.474+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:03.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:03.474+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:05.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:05.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:05.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:05.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:05.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:05.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:05.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:05.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:05.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:05.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:05.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:05.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:05.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:05.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:05.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:05.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:05.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:05.802+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:05.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:05.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:05.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:05.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:07.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:07.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:07.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:07.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:07.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:07.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:07.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:07.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:07.657 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T01:00:07.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:07.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:07.676 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T01:00:07.684 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T01:00:07.691 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T01:00:07.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:07.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:07.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:07.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:07.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:07.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:07.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:07.702+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:08.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:08.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:08.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:08.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:08.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:08.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:08.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:08.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:08.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:08.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:08.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:08.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:08.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:08.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:08.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:08.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:08.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:08.778+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:08.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:08.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:08.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:08.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:08.982 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T01:00:08.983 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T01:00:08.984 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245208 2023-10-14T01:00:08.984 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T01:00:08.984 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T01:00:08.984 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T01:00:08.985 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:00:10.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:10.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:10.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:10.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:10.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:10.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:10.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:10.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:10.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:10.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:10.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:10.334+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:10.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:10.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:10.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:10.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:11.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:11.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:11.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:11.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:11.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:11.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:11.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:11.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.470+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:11.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:11.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:00:11.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:11.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:11.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:11.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:11.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:11.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.510+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:11.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.510+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:11.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:11.550+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:12.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:12.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:12.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:12.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:12.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:12.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:12.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:12.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:12.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:12.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:12.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:12.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:12.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:12.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:12.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:12.434+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:12.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:12.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:12.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:12.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:13.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:13.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:13.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:13.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:13.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:13.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:13.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:13.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.578+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:13.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:13.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:13.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:13.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:13.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:13.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:13.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:13.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:13.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:13.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:13.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:13.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:13.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:13.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:13.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:14.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:14.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:15.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:15.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:15.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:15.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:15.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:15.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:15.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:15.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:15.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:15.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:15.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:15.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:15.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:15.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:15.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:15.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:15.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:15.862+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:15.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:15.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:15.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:15.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:16.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:16.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:16.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:16.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:16.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:16.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:16.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:16.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:16.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:16.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.590+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:16.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:16.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:16.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:00:16.612 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:00:16.610+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:00:16.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:00:16.619 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:00:16.614+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:00:16.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:16.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:16.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:16.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:16.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:16.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:16.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:16.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:16.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:16.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.698+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:16.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:16.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:16.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:17.010 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:00:17.006+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:00:17.167 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:00:17.162+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:00:18.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:00:18.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:00:18.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:18.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:18.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:18.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:18.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:18.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:18.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:18.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:18.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:18.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.546+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:18.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:18.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:18.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:18.988 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T01:00:18.989 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T01:00:18.997 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T01:00:18.997 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T01:00:19.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:00:19.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:19.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:19.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:19.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:19.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:19.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:19.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:19.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:19.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:19.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.154+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:19.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:19.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:19.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:00:19.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:00:19.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:00:19.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:19.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:19.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:19.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:19.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:19.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:19.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:19.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:19.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:19.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.670+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:19.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:19.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:19.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:20.349 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T01:00:20.349 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T01:00:20.352 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245220 2023-10-14T01:00:20.352 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T01:00:20.352 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T01:00:20.352 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T01:00:20.352 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:00:21.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:21.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:21.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:21.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:21.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:21.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:21.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:21.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:21.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:21.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:21.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:21.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:21.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:21.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:21.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:21.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:21.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:21.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:21.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:21.970+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:21.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:21.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:21.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:21.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:23.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:23.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:23.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:23.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:23.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:23.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:23.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:23.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:23.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:23.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:23.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:23.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:23.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:23.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:23.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:23.898+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:23.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:23.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:23.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:23.906+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:23.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:23.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:23.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:23.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:24.113 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:00:24.110+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:00:24.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:00:24.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:00:24.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:24.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:24.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:24.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:24.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:24.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:24.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:24.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.878+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:24.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.882+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:24.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.922+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:24.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.922+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:24.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:24.922+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:25.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:00:25.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:00:25.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:25.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:25.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:25.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:25.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:25.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:25.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:25.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:25.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:25.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.682+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:25.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:25.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:25.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:26.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:26.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:26.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:26.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:26.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:26.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:26.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:26.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:26.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:26.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:28.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:27.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:00:28.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:28.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:28.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:28.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:28.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:28.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:28.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:28.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.030+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:28.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:28.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:28.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:28.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:28.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:28.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:28.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:28.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:28.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:28.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:28.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.958+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:28.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:28.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:28.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:29.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:29.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:29.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:29.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:29.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:29.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:29.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:29.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:29.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:29.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:29.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:29.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:29.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:29.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:29.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:29.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:29.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:29.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:29.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:29.418+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:29.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:29.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:29.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:29.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:30.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:30.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:30.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:30.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:30.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:30.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:30.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:30.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:30.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.246+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:30.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.262+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:30.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:30.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:30.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:00:30.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:00:30.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:30.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:30.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:30.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:30.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:30.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:30.355 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T01:00:30.355 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T01:00:30.356 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T01:00:30.358 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T01:00:30.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:30.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:30.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:30.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.386+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:30.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:30.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:30.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:00:30.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:00:30.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:30.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:30.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:30.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:30.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:30.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:30.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:30.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:31.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:31.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:31.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:31.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:31.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:31.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:31.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:31.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:31.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:31.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:31.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:31.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:31.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:31.150+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:31.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:31.166+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:31.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:31.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:31.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:31.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:32.011 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T01:00:32.011 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T01:00:32.012 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245232 2023-10-14T01:00:32.012 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T01:00:32.012 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T01:00:32.012 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T01:00:32.013 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:00:33.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:33.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:33.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:33.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:33.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:33.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:33.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:33.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:33.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:33.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.374+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:33.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:33.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:33.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:00:33.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:00:33.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:33.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:33.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:33.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:33.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:33.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:33.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:33.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:33.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:33.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.530+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:33.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:33.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:33.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:36.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:36.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:36.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:36.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:36.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:36.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:36.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:36.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:36.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:36.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:36.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:36.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:36.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:36.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:36.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:36.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:36.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:36.142+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:36.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:36.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:36.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:36.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:37.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:37.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:00:37.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:37.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:37.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:37.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:37.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:37.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:37.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:37.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:37.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:37.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:37.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:37.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:37.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:37.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:37.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:37.342+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:37.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:37.366+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:37.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:37.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:37.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:37.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:38.045 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:00:38.038+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:00:38.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:00:38.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:38.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:38.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:38.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:38.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:38.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:38.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:38.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:38.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:38.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.522+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:38.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:38.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:38.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:38.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:38.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:38.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:38.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:38.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:39.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:39.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:39.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:39.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:38.998+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:40.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:40.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:40.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:40.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:40.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:40.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:40.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:40.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:40.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:40.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:41.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:41.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:41.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:41.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:41.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:41.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:41.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:41.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:41.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:41.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:41.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:41.658+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:41.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:41.658+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:41.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:41.658+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:42.017 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T01:00:42.017 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T01:00:42.018 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T01:00:42.019 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T01:00:43.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:43.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:00:43.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:43.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:43.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:43.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:43.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:43.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:43.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:43.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:43.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:43.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:43.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:43.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:43.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:43.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:43.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:43.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:43.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:43.230+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:43.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:43.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:43.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:43.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:43.342 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T01:00:43.342 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T01:00:43.343 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245243 2023-10-14T01:00:43.343 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T01:00:43.343 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T01:00:43.344 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T01:00:43.344 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:00:43.988 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:00:43.986+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:00:46.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:46.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:00:46.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:46.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:46.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:46.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:46.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:46.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:46.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:46.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:46.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:46.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:46.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:46.274+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:46.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:46.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:46.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:46.294+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:46.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:46.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:46.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:46.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:47.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:47.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:47.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:47.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:47.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:47.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:47.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:47.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:47.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:47.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:47.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:47.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:47.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:47.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:47.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:47.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:47.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:47.410+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:47.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:47.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:47.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:47.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:49.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:49.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:49.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:49.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:49.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:49.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:49.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:49.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:49.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:49.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:49.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:49.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:49.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:49.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:49.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:49.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:49.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:49.846+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:49.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:49.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:49.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:49.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:52.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:52.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:52.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:52.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:52.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:52.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:52.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:52.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:52.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:52.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.166+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:52.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:52.489 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:00:52.486+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:00:52.532 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:00:52.530+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:00:52.613 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:00:52.610+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:00:52.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:52.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:52.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:52.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:52.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:52.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:52.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:52.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:53.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:53.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.002+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:53.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:53.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:53.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:53.345 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T01:00:53.345 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T01:00:53.354 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T01:00:53.356 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T01:00:53.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:53.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:53.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:53.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:53.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.530+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:53.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:53.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:53.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:53.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:53.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:53.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:53.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.886+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:53.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:53.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:53.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:54.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:54.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:54.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:54.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:54.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:54.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:54.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:54.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:54.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:54.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:54.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:54.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:54.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:54.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:54.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:54.182+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:54.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:54.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:54.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:54.182+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:54.550 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T01:00:54.556 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T01:00:54.563 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245254 2023-10-14T01:00:54.563 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T01:00:54.563 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T01:00:54.564 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T01:00:54.564 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:00:55.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:55.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:55.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:55.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:55.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:55.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:55.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:55.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:55.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:55.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.418+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:55.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:55.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:55.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:00:55.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:00:55.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:00:55.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:55.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:55.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:55.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:55.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:55.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:55.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:55.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:55.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:55.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.730+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:55.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:55.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:55.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:56.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:00:56.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:00:56.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:56.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:56.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:56.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:56.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:56.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:56.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:56.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:56.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.558+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:56.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:56.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:56.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:00:56.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:56.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:56.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:56.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:56.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:56.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:56.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:56.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:56.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.730+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:56.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:56.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:56.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:00:57.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:57.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:00:57.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:57.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:00:57.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:57.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:00:57.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:57.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:00:57.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:57.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:00:57.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:57.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:00:57.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:57.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:00:57.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:57.854+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:00:57.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:57.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:00:57.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:57.890+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:00:57.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:57.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:00:57.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:00:57.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:01.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:01.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:01.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:01.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:01.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:01.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:01.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:01.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:01.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.445+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:01.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:01.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:01.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:01.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:01.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:01.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:01.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:01.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:01.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:01.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.553+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:01.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:01.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:01.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:01.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:01.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:04.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:04.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:04.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:04.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:04.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:04.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:04.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:04.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:04.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:04.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:04.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:04.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:04.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:04.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:04.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:04.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:04.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:04.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:04.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:04.193+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:04.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:04.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:04.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:04.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:04.582 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T01:01:04.585 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T01:01:04.586 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T01:01:04.601 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T01:01:05.050 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:01:05.045+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:01:05.069 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:01:05.065+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:01:06.040 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T01:01:06.040 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T01:01:06.041 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245266 2023-10-14T01:01:06.041 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T01:01:06.041 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T01:01:06.041 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T01:01:06.042 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:01:07.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:07.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:07.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:07.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:07.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:07.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:07.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:07.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:07.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:07.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:07.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:07.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:07.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:07.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:07.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:07.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:07.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:07.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:07.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:07.649+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:08.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:08.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:08.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:08.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:08.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:08.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:08.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:08.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:08.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:08.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:08.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:08.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:08.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:08.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:08.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:08.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:08.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:08.217+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:08.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:08.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:08.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:08.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:09.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:09.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:09.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:09.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:09.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:09.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:09.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:09.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:09.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:09.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:09.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:09.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:09.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:09.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:09.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:09.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:09.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:09.253+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:09.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:09.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:09.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:09.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:11.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:11.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:11.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:11.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:11.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:11.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:11.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:11.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:11.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:11.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:11.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.273+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:11.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:11.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:11.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:11.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:11.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:11.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:11.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:11.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:11.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:11.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:11.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.385+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:11.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:11.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:11.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:11.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:11.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:11.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:11.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:11.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:11.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:11.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:11.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:11.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.697+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:11.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.701+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:11.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.701+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:11.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:11.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:11.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:11.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:11.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:11.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:11.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:11.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:11.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:11.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.989+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:11.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:11.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:11.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:12.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:12.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:12.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:12.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:12.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:12.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:12.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:12.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:12.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:12.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.169+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:12.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:12.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:12.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:12.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:12.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:12.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:12.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:12.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:12.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:12.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:12.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:13.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.017+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:13.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:13.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:13.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:01:13.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:13.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:13.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:13.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:13.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:13.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:13.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:13.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:13.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:13.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.569+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:13.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:13.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:13.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:14.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:14.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:14.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:14.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:14.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:14.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:14.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:14.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:14.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:14.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:14.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.201+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:14.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:14.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:14.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:15.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:15.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:15.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:15.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:15.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:15.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:15.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:15.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:15.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:15.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:15.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:15.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:15.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:15.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:15.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:15.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:15.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:15.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:15.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:15.781+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:15.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:15.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:15.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:15.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:16.054 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T01:01:16.062 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T01:01:16.067 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T01:01:16.069 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T01:01:17.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:17.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:17.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:17.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:17.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:17.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:17.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:17.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:17.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:17.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.121+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:17.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:17.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:17.190 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T01:01:17.196 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T01:01:17.199 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245277 2023-10-14T01:01:17.199 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T01:01:17.200 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T01:01:17.200 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T01:01:17.200 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:01:17.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:01:17.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:17.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:17.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:17.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:17.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:17.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:17.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:17.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:17.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:17.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.605+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:17.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:17.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:17.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:19.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:19.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:19.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:19.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:19.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:19.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:19.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:19.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:19.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:19.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.873+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:19.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:19.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:19.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:01:19.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:19.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:19.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:19.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:19.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:19.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.973+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:19.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:01:19.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:19.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:01:20.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:20.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:20.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:20.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:20.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:20.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:20.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:20.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:20.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:20.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:20.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.065+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:20.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:20.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:20.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:21.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:21.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:21.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:21.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:21.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:21.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:21.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:21.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:21.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:21.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:21.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:21.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:21.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:21.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:21.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:21.385+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:21.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:21.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:21.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:21.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:22.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:01:22.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:22.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:22.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:22.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:22.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:22.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:22.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:22.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:22.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:22.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.173+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:22.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.173+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:22.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:22.173+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:23.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:23.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:23.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:23.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:23.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:23.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:23.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:23.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:23.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:23.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:23.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:23.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:23.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:23.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:23.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:23.461+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:23.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:23.461+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:23.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:23.461+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:23.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:23.461+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:23.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:23.461+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:25.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:01:25.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:25.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:25.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:25.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:25.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:25.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:25.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:25.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:25.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:25.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.101+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:25.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:25.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:25.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:26.356 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:01:26.353+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:01:26.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:26.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:26.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:26.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:26.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:26.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:26.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:26.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:26.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:26.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:26.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:26.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:26.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:26.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:26.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:26.613+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:26.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:26.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:26.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:26.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:27.223 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T01:01:27.224 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T01:01:27.227 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T01:01:27.228 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T01:01:28.524 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T01:01:28.525 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T01:01:28.525 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245288 2023-10-14T01:01:28.525 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T01:01:28.526 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ -n 172.21.15.191:0/2424388657 ]] 2023-10-14T01:01:28.526 INFO:tasks.workunit.client.0.smithi191.stderr:+ [[ 172.21.15.191:0/2424388657 != \1\7\2\.\2\1\.\1\5\.\1\9\1\:\0\/\2\4\2\4\3\8\8\6\5\7 ]] 2023-10-14T01:01:28.526 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:01:29.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:29.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:29.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:29.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:29.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:29.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:29.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:29.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:29.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:29.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.277+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:29.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:29.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:29.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:01:29.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:29.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:29.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:29.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:29.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:29.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:29.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:29.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:29.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.357+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:29.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:29.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:29.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:29.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:29.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:29.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:29.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:29.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:29.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.541+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:29.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:29.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.549+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:29.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:29.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:29.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:31.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:31.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:31.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:31.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:31.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:31.733+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:31.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:31.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:33.618 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:01:33.609+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:01:35.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:01:35.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:35.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:35.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:35.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:35.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:35.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:35.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:35.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:35.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.577+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:35.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:35.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:35.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:35.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:35.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:35.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:35.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:35.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:35.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:35.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.785+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:35.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:35.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:35.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:01:35.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:35.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:35.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:35.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:35.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:35.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:35.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:35.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:35.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.853+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:35.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:35.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.877+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:35.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:35.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:35.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:01:35.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:35.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:35.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:35.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:35.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:35.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:35.894 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:01:35.889+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:01:36.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:36.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:36.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:36.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:36.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:36.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:36.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:36.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:36.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:36.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:36.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:36.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:36.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:36.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:36.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:36.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:36.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:36.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:36.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:36.153+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:36.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:36.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:36.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:36.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:38.537 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq -r '[.addrvec[0].addr, "/", .addrvec[0].nonce|tostring] | add' 2023-10-14T01:01:38.547 INFO:tasks.workunit.client.0.smithi191.stderr:++ ceph mgr dump 2023-10-14T01:01:38.549 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq 'select(.name == "rbd_support")' 2023-10-14T01:01:38.555 INFO:tasks.workunit.client.0.smithi191.stderr:++ jq '.active_clients[]' 2023-10-14T01:01:39.762 INFO:tasks.workunit.client.0.smithi191.stderr:+ CLIENT_ADDR=172.21.15.191:0/2424388657 2023-10-14T01:01:39.763 INFO:tasks.workunit.client.0.smithi191.stderr:++ date +%s 2023-10-14T01:01:39.765 INFO:tasks.workunit.client.0.smithi191.stderr:+ CURRENT_TIME=1697245299 2023-10-14T01:01:39.765 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( CURRENT_TIME <= END_TIME )) 2023-10-14T01:01:39.765 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i = 1 )) 2023-10-14T01:01:39.765 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:01:39.766 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:01:39.959 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:01:39.953+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:01:39.959 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:01:39.966 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:01:40.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:40.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:40.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:40.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:40.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:40.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:40.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:40.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:40.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:40.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:40.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:40.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:40.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:40.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:40.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:40.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:40.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:40.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:40.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:40.125+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:40.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:40.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:40.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:40.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:41.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:41.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:01:41.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:41.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:41.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:41.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:41.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:41.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:41.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:41.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:41.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:41.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:41.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:41.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:41.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:41.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:41.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:41.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:41.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:41.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:41.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:41.273+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:42.783 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:01:42.777+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:01:44.787 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:01:44.781+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:01:45.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:45.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:45.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:45.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:45.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:45.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:45.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:45.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:45.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:45.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:45.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:45.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:45.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:45.593+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:46.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:46.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:46.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:46.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:46.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:46.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:46.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:46.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:46.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:46.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:46.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:46.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:46.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:46.473+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:46.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:46.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:46.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:46.505+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:46.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:46.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:46.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:46.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:46.696 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:01:46.693+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:01:47.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:47.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:47.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:47.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:47.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:47.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:47.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:47.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:47.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:47.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:47.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:47.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:47.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:47.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:47.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:47.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:47.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:47.829+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:47.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:47.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:47.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:47.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:48.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:01:48.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:01:48.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:48.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:48.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:48.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:48.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:48.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:48.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:48.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:48.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:48.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.141+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:48.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:48.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:49.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:49.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:49.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:49.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:49.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:49.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:49.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:49.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:49.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:49.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:49.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:49.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:49.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:49.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:49.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:49.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:49.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:49.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:49.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:49.365+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:49.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:49.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:49.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:49.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:49.967 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:01:49.968 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:01:49.968 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:01:50.118 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:01:50.113+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:01:50.119 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:01:50.129 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:01:50.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:50.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:50.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:50.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:50.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:50.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:50.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:50.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:50.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.733+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:50.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:50.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:50.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:01:50.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:01:50.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:50.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:50.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:50.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:50.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:50.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:50.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:50.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:50.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:50.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:50.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.833+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:50.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:50.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:50.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:51.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:01:51.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:51.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:51.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:51.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:51.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:51.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:51.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:51.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:51.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:51.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:51.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.893+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:51.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:51.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:51.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:53.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:53.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:53.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:53.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:53.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:53.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:53.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:53.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:53.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:53.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:54.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:54.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:01:54.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:54.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:54.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:54.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:54.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:54.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:54.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:54.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:54.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:54.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:54.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:54.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:54.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:54.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:54.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:54.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:54.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:54.537+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:55.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:55.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:55.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:55.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:55.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:55.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:55.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:55.381+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:55.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:55.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:55.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:55.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:55.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:55.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:55.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:55.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:55.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:55.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:55.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:55.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:55.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:55.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:56.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:56.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:56.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:56.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:56.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:56.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:56.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:56.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:56.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:56.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.089+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:56.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:56.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:56.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:56.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:56.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:56.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:56.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:56.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.205+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:56.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:56.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:56.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:01:56.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:56.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:56.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:56.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:56.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:56.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:56.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:56.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:56.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:56.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:56.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.629+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:56.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:56.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:56.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:57.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:01:57.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:01:57.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:01:57.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:57.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:57.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:57.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:57.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:57.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:57.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:57.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:57.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:57.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.233+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:57.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:57.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:57.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:58.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:01:58.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:58.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:58.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:58.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:58.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:58.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:01:58.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:01:58.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:01:58.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.076+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:01:58.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:01:58.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:01:58.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:01:58.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:01:58.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:01:58.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:01:58.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:01:58.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:01:58.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:00.130 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:02:00.130 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:02:00.131 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:02:00.229 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:02:00.224+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:02:00.230 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:02:00.239 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:02:01.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:01.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:01.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:01.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:01.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:01.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:01.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:01.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:01.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:01.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:01.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:01.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:01.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:01.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:01.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:01.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:01.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:01.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:01.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:01.744+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:01.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:01.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:01.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:01.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:02.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:02:02.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:02.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:02.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:02.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:02.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:02.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:02.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:02.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:02.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.276+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:02.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:02.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:02.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:02:02.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:02:02.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:02.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:02.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:02.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:02.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:02.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:02.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.312+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:02.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:02.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:03.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:03.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:03.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:03.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:03.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:03.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:03.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:03.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:03.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:03.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:03.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:03.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:03.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:03.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:03.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:03.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:03.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:03.604+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:03.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:03.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:03.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:03.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:04.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:02:04.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:04.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:04.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:04.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:04.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:04.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:04.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:04.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:04.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.164+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:04.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:04.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:04.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:04.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:04.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:04.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:08.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:08.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:08.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:08.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:08.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:08.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:08.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:08.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:08.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.184+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:08.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:08.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:08.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:08.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:08.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:08.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:08.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:08.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:08.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:08.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:08.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:09.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:09.004+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:09.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:09.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:09.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:09.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:10.240 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:02:10.240 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:02:10.240 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:02:10.423 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:02:10.420+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:02:10.424 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:02:10.440 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:02:11.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:11.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:11.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:11.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:11.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:11.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:11.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:11.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:11.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:11.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:11.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:11.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:11.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:11.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:11.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:11.972+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:12.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:11.996+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:12.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:11.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:12.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:11.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:12.043 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:02:12.040+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:02:14.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:14.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:14.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:14.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:14.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:14.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:14.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:14.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:14.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:14.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:14.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:14.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:14.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:14.888+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:14.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:14.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:14.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:14.936+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:14.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:14.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:14.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:14.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:16.923 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:02:16.920+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:02:16.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:16.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:17.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:17.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.028+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:17.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:17.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.036+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:17.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:17.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:17.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.048+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:17.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:17.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:17.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:17.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:17.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:17.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:17.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:17.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:17.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:17.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.176+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:17.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:17.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:17.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:02:17.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:17.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:17.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:17.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:17.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:17.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:17.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.284+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:17.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:17.284+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:20.460 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:02:20.460 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:02:20.460 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:02:20.557 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:02:20.556+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:02:20.557 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:02:20.569 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:02:20.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:20.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:20.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:20.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:20.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:20.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:20.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:20.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:21.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:02:21.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:02:21.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:21.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:21.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:21.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:21.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:21.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:21.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:21.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:21.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:21.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.212+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:21.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.212+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:21.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:21.212+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:21.870 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:02:21.868+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:02:23.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:02:23.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:23.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:23.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:23.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:23.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:23.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:23.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:23.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:23.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:23.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.312+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:23.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:23.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:23.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:02:23.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:02:23.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:23.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:23.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:23.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:23.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:23.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:23.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:23.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:23.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:23.376+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:24.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:02:24.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:24.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:24.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:24.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:24.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:24.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:24.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:24.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:24.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:24.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.252+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:24.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:24.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:24.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:02:24.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:24.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:24.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:24.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:24.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:24.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:24.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:24.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:25.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:25.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:25.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:25.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:25.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:25.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:25.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:25.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:25.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:25.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:25.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:25.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:25.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:25.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:25.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:25.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:02:25.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:25.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:26.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:26.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:26.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:26.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:26.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:26.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:26.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:26.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:26.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:26.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:26.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:26.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:26.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:26.084+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:26.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:26.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:26.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:26.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:27.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:27.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:27.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:27.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:27.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:27.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:27.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:27.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:27.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:27.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:27.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:27.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:27.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:27.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:27.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:27.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:27.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:27.144+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:27.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:27.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:27.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:27.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:28.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:28.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:28.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:28.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:28.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:28.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:28.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:28.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:28.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.328+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:28.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.328+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:28.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:28.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:28.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:28.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:28.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:28.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:28.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:28.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:28.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:28.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:28.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.744+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:28.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:28.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:29.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:29.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:29.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:29.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:29.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:29.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:29.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:29.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:29.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:29.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:29.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:29.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:29.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:29.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:30.571 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:02:30.571 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:02:30.571 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:02:30.735 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:02:30.732+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:02:30.736 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:02:30.757 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:02:30.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:30.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:30.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:30.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:30.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:30.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:30.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:30.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:30.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:30.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:30.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:30.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:31.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:31.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.032+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:31.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:31.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:31.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:02:31.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:31.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:31.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:31.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:31.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:31.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:31.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:31.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:31.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.824+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:31.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:31.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:31.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:34.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:34.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:34.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:34.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:34.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:34.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:34.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:34.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:35.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:35.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:35.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.024+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:35.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:35.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.040+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:35.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:35.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:35.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:35.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:35.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:35.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:35.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:35.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:35.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:35.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.776+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:35.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:35.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:35.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:36.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:36.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:36.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:36.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:36.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:36.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:36.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:36.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:36.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:36.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.940+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:36.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:02:36.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:02:36.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:36.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:36.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:36.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:36.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:36.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:37.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:37.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:37.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:37.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:37.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:37.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:37.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:37.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:02:37.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:37.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:02:37.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:37.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:37.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:37.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:37.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:37.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:37.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:37.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:37.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:37.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:37.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:37.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:38.158 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:02:38.156+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:02:40.227 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:02:40.224+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:02:40.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:40.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:40.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:40.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:40.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:40.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:40.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:40.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:40.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:40.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:40.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:40.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:40.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:40.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:40.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:40.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:40.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:40.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:40.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:40.660+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:40.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:40.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:40.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:40.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:40.773 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:02:40.773 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:02:40.773 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:02:40.891 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:02:40.892+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:02:40.892 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:02:40.917 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:02:41.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:41.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:41.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:41.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:41.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:41.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:41.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.172+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:41.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:41.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:41.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:41.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:41.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:41.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:41.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:41.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:41.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.796+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:41.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:41.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:41.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:42.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:42.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:42.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:42.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:42.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:42.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:42.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.212+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:42.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:42.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.220+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:42.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:42.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:42.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:02:42.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:02:42.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:42.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:42.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:42.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:42.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:42.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.276+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:42.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:42.288+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:43.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:43.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:43.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:43.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:43.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:43.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:43.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:43.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:43.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:43.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:43.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:43.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:43.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:43.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:43.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:43.740+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:43.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:43.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:43.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:43.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:44.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:02:44.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:44.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:44.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:44.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:44.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:44.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:44.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:44.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:44.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:44.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.512+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:44.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:44.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:44.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:45.067 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:02:45.064+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:02:45.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:45.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:45.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:45.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:45.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:45.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:45.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:45.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:45.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.248+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:45.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:45.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:45.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:02:45.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:02:45.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:45.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:45.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:45.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:45.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:45.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:45.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:45.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:45.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:45.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.612+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:45.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:45.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:45.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:45.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:45.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:45.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:45.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:45.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:45.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:45.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:46.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:46.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:46.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:46.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:46.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:46.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:46.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.120+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:46.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:02:46.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:46.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:46.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:46.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:46.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:46.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:46.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:46.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:46.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.636+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:46.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.636+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:46.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:46.636+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:49.565 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:02:49.564+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:02:50.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:50.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:50.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:50.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:50.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:50.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:50.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:50.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:50.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:50.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:50.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:50.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:50.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:50.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:50.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:50.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:50.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:50.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:50.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:50.156+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:50.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:50.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:50.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:50.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:50.919 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:02:50.919 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:02:50.919 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:02:51.041 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:02:51.040+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:02:51.042 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:02:51.070 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:02:51.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:51.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:51.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:51.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:51.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:51.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:51.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:51.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:51.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:51.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:51.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:51.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:51.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:52.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:02:52.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:52.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:52.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:52.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:52.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:52.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:52.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:52.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:52.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:52.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.856+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:52.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:52.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:52.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:53.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:53.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:02:53.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:53.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:53.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:53.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:53.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:53.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:53.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:53.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:53.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:53.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:53.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:53.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:53.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:53.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:53.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:53.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:53.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:53.376+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:54.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:54.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:54.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:54.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:54.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:54.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:54.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.268+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:54.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:54.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.304+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:54.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:54.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:54.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:54.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:54.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:54.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:54.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:54.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:54.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.972+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:54.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.972+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:54.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.980+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:54.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:54.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:02:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:54.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:55.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:55.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:55.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:55.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:55.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:55.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:55.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:55.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:55.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:55.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:55.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:55.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:55.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:55.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:55.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:55.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:55.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:55.212+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:55.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:55.212+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:55.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:55.212+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:55.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:55.212+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:56.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:56.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:56.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:56.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:56.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:56.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:56.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:56.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:56.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:56.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:56.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:56.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:56.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:56.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:56.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:56.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:56.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:56.104+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:56.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:56.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:56.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:56.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:57.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:57.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:57.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:57.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:57.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:57.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:57.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:57.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:57.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:57.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:57.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:57.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:57.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:57.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:57.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:57.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:57.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:57.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:57.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:57.739+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:57.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:57.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:58.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:58.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:58.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:58.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:58.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:58.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:58.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:58.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:58.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.363+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:58.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:58.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:02:58.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:58.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:58.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:58.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:58.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:02:59.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:02:59.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:02:59.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:02:59.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:02:59.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:02:59.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:02:59.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:02:59.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:02:59.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:02:59.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.483+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:02:59.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.487+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:02:59.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:02:59.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:02:59.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:00.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:00.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:00.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:00.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:00.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:00.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:00.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:00.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:00.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:00.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:00.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:00.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.347+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:00.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:00.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:00.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:00.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:00.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:00.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:00.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:00.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:00.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:00.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:00.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:00.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:00.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.807+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:00.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:00.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:00.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:01.087 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:03:01.087 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:03:01.087 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:03:01.197 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:03:01.195+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:03:01.198 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:03:01.227 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:03:02.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:02.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:02.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:02.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:02.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:02.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:02.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:02.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:02.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:02.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.391+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:02.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:02.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.419+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:02.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:02.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:02.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:02.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:02.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:02.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:02.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:02.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:02.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:02.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:02.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:02.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.591+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:02.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.591+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:02.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.591+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:02.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:02.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:02.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:02.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:02.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:02.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:02.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:02.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:02.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:02.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.943+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:02.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:02.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:02.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:03.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:03.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:03.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:03.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:03.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:03.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:03.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:03.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:03.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:03.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:03.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.815+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:03.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:03.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:03.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:07.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:07.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:07.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:07.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:07.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:07.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:07.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:07.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:07.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:07.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:07.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:07.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:07.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:07.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:07.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:07.591+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:07.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:07.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:07.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:07.599+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:07.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:07.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:07.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:07.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:08.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:08.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:08.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:08.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:08.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:08.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:08.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:08.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:08.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:08.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:08.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:08.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:08.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:08.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:08.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:08.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:08.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:08.239+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:08.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:08.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:08.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:08.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:11.228 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:03:11.229 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:03:11.229 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:03:11.342 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:03:11.339+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:03:11.345 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:03:11.351 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:03:12.264 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:03:12.263+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:03:12.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:12.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:12.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:12.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:12.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:12.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:12.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.391+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:12.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:12.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:12.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:12.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:12.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:12.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:12.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:12.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:12.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:12.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:12.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.959+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:12.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:12.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:12.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:13.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:13.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:13.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:13.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:13.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:13.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:13.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:13.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.307+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:13.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:13.340 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:03:13.339+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:03:13.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:13.354 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:03:13.351+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:03:13.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:13.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:13.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:13.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:13.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:13.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:13.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:13.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.423+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:13.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:13.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:13.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:13.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:13.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:13.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:13.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:13.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:13.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:15.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:15.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:15.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:15.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:15.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:15.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:15.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:15.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.407+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:15.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:15.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.431+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:15.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:15.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:15.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:15.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:15.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:15.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:15.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:15.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:15.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:15.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:15.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.507+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:15.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:15.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.563+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:15.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:15.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:15.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:16.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:16.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:16.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:16.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:16.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:16.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:16.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:16.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:16.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:16.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:16.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:16.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:16.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:16.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:16.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:16.495+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:16.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:16.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:16.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:16.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:17.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:17.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:17.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:17.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:17.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:17.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:17.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:17.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:17.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:17.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:17.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:17.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:17.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:17.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:17.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:17.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:17.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:17.667+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:17.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:17.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:17.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:17.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:17.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:17.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:18.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:18.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:18.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:18.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:18.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:18.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:18.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:18.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:18.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:18.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:18.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:18.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:18.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:18.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:18.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:18.343+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:18.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:18.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:18.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:18.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:19.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:19.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:19.133 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:03:19.127+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:03:19.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:19.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:19.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:19.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:19.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:19.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:19.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:19.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:19.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:19.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.207+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:19.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.207+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:19.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:19.207+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:19.331 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:03:19.327+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:03:19.979 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:03:19.975+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:03:20.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:20.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:20.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:20.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:20.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:20.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:20.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:20.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:20.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:20.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:20.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:20.531+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:20.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:20.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:20.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:20.551+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:20.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:20.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:20.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:20.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:21.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:21.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:21.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:21.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:21.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:21.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:21.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:21.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:21.357 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:03:21.357 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:03:21.358 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:03:21.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:21.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.363+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:21.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:21.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:21.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:21.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:21.577 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:03:21.575+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:03:21.577 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:03:21.582 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:03:21.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:21.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:21.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:22.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:21.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:22.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:22.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:22.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.039+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:22.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.039+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:22.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.055+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:22.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:22.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:22.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:22.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:22.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:22.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:22.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:22.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:22.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:22.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.707+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:22.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:22.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:22.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:24.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:24.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:24.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:24.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:24.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:24.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:24.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:24.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:24.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.935+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:24.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:24.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.967+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:24.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:24.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:24.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:25.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:25.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:25.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:25.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:25.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:25.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:25.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:25.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:25.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:25.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:25.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:25.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:25.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:25.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:25.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:25.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:25.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:25.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:25.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:25.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:25.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.659+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:25.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:25.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:25.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:26.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:26.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:26.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:26.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:26.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:26.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:26.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:26.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.103+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:26.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.123+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:26.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:26.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:26.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:26.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:26.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:26.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.283+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:26.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.283+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:26.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.355+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:26.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:26.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:26.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:26.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:26.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:26.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:26.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:26.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:26.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:26.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:26.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:26.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.599+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:26.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:26.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:26.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:27.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:27.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:27.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:27.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:27.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:27.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:27.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:27.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:27.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:27.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:27.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:27.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:27.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:27.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:27.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:27.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:28.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:28.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:28.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:28.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:28.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:28.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:28.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:28.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:28.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:28.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:28.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:28.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:28.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:28.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:28.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:29.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:29.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:29.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:29.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:29.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:29.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:29.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:29.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:29.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:29.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:29.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:29.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:29.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.811+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:29.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:29.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:29.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:30.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:30.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:30.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:30.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:30.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:30.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:30.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:30.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:30.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:30.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:30.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:30.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:30.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:30.867+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:30.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:30.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:30.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:30.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:30.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:30.867+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:30.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:30.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:30.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:30.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:31.584 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:03:31.584 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:03:31.584 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:03:31.738 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:03:31.735+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:03:31.738 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:03:31.754 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:03:31.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:31.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:31.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:31.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:31.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:31.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:31.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:31.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:31.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:31.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:31.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:31.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:31.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:31.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:31.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:31.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:31.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:31.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:31.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:31.867+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:31.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:31.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:31.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:31.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:32.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:32.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:32.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:32.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:32.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:32.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:32.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:32.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:32.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:32.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:32.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.335+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:32.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:32.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:32.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:33.837 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:03:33.835+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:03:33.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:33.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:33.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:33.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:33.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:33.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:34.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:34.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:34.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:34.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:34.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:34.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.067+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:34.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:34.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.067+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:34.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:34.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:34.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:34.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:34.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:34.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:34.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:34.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:34.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:34.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:34.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:34.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.495+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:34.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:34.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:34.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:35.103 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:03:35.099+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:03:35.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:35.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:35.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:35.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:35.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:35.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:35.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:35.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:35.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:35.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:35.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:35.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:35.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:35.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:35.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:35.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:35.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:35.291+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:36.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:36.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:36.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:36.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:36.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:36.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:36.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:36.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.647+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:36.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:36.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:36.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:36.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:36.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:36.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:36.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:36.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:36.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:36.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:36.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:36.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:36.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:36.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:36.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:36.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:36.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:36.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.879+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:36.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:36.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:37.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:37.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:37.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:37.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:37.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:37.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:37.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:37.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:37.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:37.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:37.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:37.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:37.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:37.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:37.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:37.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:37.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:37.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:37.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:37.475+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:37.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:37.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:37.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:37.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:39.099 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:03:39.095+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:03:41.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:41.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:41.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:41.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:41.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:41.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:41.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:41.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:41.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:41.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.411+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:41.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:41.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:41.758 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:03:41.758 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:03:41.758 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:03:41.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:41.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:41.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:41.854 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:03:41.851+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:03:41.855 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:03:41.872 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:03:41.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:41.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:41.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:41.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:41.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:41.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:41.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:41.995+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:42.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.015+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:42.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.015+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:42.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:42.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:42.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:42.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:42.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:42.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:42.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:42.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.131+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:42.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.179+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:42.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:42.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:42.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:42.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:42.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:42.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:42.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:42.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:42.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:42.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:42.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:42.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.599+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:42.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:42.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:42.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:43.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:43.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:43.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:43.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:43.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:43.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:43.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:43.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:43.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:43.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:43.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:43.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.875+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:43.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.875+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:43.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:43.875+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:44.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:44.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:44.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:44.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:44.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:44.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:44.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:44.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:44.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:44.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.107+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:44.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:44.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:44.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:44.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:44.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:44.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:44.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:44.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:44.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:44.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:44.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.371+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:44.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:44.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:44.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:44.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:44.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:44.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:44.694 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:03:44.691+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:03:45.880 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:03:45.879+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:03:45.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:45.959+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:46.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:46.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:46.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:46.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:46.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:46.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:46.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:46.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:46.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.087+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:46.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:46.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:46.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:46.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:46.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:46.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:46.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:46.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:46.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:46.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:46.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:46.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.899+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:46.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:46.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.959+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:46.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:46.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:46.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:46.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:46.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:47.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:47.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:47.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:47.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:47.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:47.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:47.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:47.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:47.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:47.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:47.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.143+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:47.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:47.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:47.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:47.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.155+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:47.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:47.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:47.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:47.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:47.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:47.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:47.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:47.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:47.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:47.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:47.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:47.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.307+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:47.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:47.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:47.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:47.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:47.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:47.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:47.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:47.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:47.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:47.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:47.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.827+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:47.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:47.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:47.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:48.108 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:03:48.107+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:03:48.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:48.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:48.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:48.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:48.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:48.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:48.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:48.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:48.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:48.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:48.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:48.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:48.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:48.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:48.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:48.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:48.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:48.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:48.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:48.963+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:48.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:48.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:48.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:48.963+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:49.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:49.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:49.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:49.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:49.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:49.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:49.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:49.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:49.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:49.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:49.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:49.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.379+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:49.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:49.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:49.379+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:51.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:51.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:51.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:51.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:51.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:51.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:51.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:51.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:51.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:51.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:51.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:51.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:51.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:51.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:51.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:51.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:51.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:51.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:51.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:51.755+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:51.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:51.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:51.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:51.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:51.874 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:03:51.874 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:03:51.875 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:03:51.994 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:03:51.991+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:03:51.995 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:03:52.005 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:03:52.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:52.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:52.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:52.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:52.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:52.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:52.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:52.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:52.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:52.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:52.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.591+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:52.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.591+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:52.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.591+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:52.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:52.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:03:52.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:52.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:52.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:52.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:52.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:52.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:52.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:52.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.831+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:52.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.831+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:52.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.831+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:52.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:52.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:52.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:52.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:52.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:52.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:56.674 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:03:56.671+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:03:56.674 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:03:56.671+0000 7f30478aa640 -1 reset not still connected to 0x55c894ab09c0 2023-10-14T01:03:57.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:57.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:03:57.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:57.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:03:57.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:57.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:03:57.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:57.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:03:57.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:57.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:03:57.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:57.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:03:57.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:57.455+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:03:57.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:57.459+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:03:57.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:57.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:03:57.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:57.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:03:59.859 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:03:59.854+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:03:59.868 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:03:59.866+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:03:59.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:59.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:03:59.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:59.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:03:59.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:59.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:03:59.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:59.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:03:59.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:59.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:00.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:59.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:00.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:59.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:00.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:03:59.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:00.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:00.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:00.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:00.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:00.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:00.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:00.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:00.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:00.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:00.018+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:00.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:00.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:00.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:00.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:02.011 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:04:02.012 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:04:02.012 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:04:02.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:02.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:02.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:02.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.130+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:02.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:02.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:04:02.158 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:04:02.154+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:04:02.158 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:04:02.180 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:04:02.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:02.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:02.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:02.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:02.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:02.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.546+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:02.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:02.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:02.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:02.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:02.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:03.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:03.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:03.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:03.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:03.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:03.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:03.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:03.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:03.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:03.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:03.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:03.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:03.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:03.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:03.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:03.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:03.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:03.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:03.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:03.154+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:03.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:03.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:04.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:04.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:04.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:04.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:04.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:04.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:04.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:04.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:04.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:04.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:04.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:04.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:05.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:04:05.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:05.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:05.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:05.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:05.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:05.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:05.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:05.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:05.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:05.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.358+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:05.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:05.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:05.358+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:06.410 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:04:06.406+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:04:09.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:04:09.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:09.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:09.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:09.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:09.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:09.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:09.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:09.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:09.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.426+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:09.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.438+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:09.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:09.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:09.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:11.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:11.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:11.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:11.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:11.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:11.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:11.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:11.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:11.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:04:11.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:11.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:11.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:11.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:11.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:11.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:11.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:11.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:11.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:11.634 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:04:11.630+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:04:12.181 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:04:12.181 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:04:12.182 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:04:12.282 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:04:12.278+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:04:12.283 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:04:12.301 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:04:12.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:12.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:12.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:12.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:12.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:12.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:12.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:12.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:12.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:12.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:12.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:12.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:12.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:12.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:12.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:12.518+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:12.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:12.538+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:12.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:12.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:12.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:12.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:14.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:14.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:14.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:14.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:14.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:14.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:14.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:14.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:14.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:14.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:14.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:14.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:14.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:14.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.706+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:14.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.706+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:14.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.722+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:14.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:14.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:14.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:16.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:16.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:16.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:16.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:16.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:16.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:16.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:16.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:16.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:16.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:16.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:16.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:16.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:16.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:16.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:16.550+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:16.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:16.554+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:16.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:16.554+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:17.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:04:17.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:17.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:17.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:17.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:17.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:17.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:17.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:17.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:17.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.206+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:17.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:17.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:17.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:04:17.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:17.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:17.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:17.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:17.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:17.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:17.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:17.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:18.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:04:18.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:18.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:18.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:18.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:18.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:18.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:18.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:18.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.854+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:18.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.854+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:18.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.854+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:18.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.854+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:18.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:18.854+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:19.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:19.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:04:19.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:19.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:19.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:19.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:19.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:19.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:19.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:19.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:19.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:19.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:20.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:04:20.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:04:20.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:04:20.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:20.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:20.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:20.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:20.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:20.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:20.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:20.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:20.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:20.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.558+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:20.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:20.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:20.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:04:20.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:04:20.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:20.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:20.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:20.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:20.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:20.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:20.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:20.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:20.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:20.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.618+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:20.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:20.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:21.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:20.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:21.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:21.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:21.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:21.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:21.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:21.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:21.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:21.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:21.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:21.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:21.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:21.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:21.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:21.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:21.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:21.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:21.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:21.050+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:21.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:21.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:22.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:22.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:22.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:22.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:22.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:22.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:22.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:22.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:22.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:22.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:22.305 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:04:22.305 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:04:22.305 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:04:22.424 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:04:22.422+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:04:22.424 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:04:22.428 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:04:22.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:22.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:22.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:22.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:22.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:22.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:22.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:22.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:22.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:22.938+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:22.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:22.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:23.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:23.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:23.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:23.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:23.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:23.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:23.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:23.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:23.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:23.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:23.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:23.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:23.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:23.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:23.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:23.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:23.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:23.434+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:23.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:23.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:23.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:23.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:26.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:04:26.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:26.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:26.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:26.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:26.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:26.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:26.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:26.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:26.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.774+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:26.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:26.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:26.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:26.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:27.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:04:27.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:27.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:27.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:27.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:27.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:27.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:27.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:27.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:27.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:27.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.822+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:27.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:27.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:27.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:27.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:27.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:27.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:27.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:27.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:27.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:27.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.986+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:27.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:27.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:27.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:28.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:28.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:28.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:28.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:28.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:28.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:28.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:28.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:28.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:28.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:28.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:28.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:28.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:28.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:28.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:28.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:28.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:28.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:28.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:28.466+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:28.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:28.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:28.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:28.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:29.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:29.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:29.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:29.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:29.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:29.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.554+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:29.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:29.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.598+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:29.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:29.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:29.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:29.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:29.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:29.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:29.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:29.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:29.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.690+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:29.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:29.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:29.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:30.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:30.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:30.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:30.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:30.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:30.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:30.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:30.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.254+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:30.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:30.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:30.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:30.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:30.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:30.428 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:04:30.422+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:04:30.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:30.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:30.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:30.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:31.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:31.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:31.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:31.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:31.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:31.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:31.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:31.082+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:31.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:31.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:31.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:31.134+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:31.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:31.134+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:31.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:31.134+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:32.434 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:04:32.435 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:04:32.435 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:04:32.586 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:04:32.582+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:04:32.589 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:04:32.594 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:04:33.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:33.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:33.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:33.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:38.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:38.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:38.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:38.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:38.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:38.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:38.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:38.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:38.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:04:38.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:04:38.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:38.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:38.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:38.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:38.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:38.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:38.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:38.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:39.671 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:04:39.666+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:04:39.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:39.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:04:39.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:39.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:39.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:39.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:39.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:39.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:39.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:39.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:39.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:39.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:39.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:39.798+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:39.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:39.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:39.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:39.806+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:39.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:39.806+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:39.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:39.806+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:40.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:04:40.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:40.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:40.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:40.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:40.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:40.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:40.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:40.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.658+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:40.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:40.682 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:04:40.678+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:04:40.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.686+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:40.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:40.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:40.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:04:40.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:04:40.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:40.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:40.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:40.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:40.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:40.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:40.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:40.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:40.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:40.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.802+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:40.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:40.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:40.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:42.595 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:04:42.596 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:04:42.596 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:04:42.695 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:04:42.690+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:04:42.695 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:04:42.704 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:04:44.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:44.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:04:44.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:44.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:44.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:44.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:44.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:44.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:44.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:44.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:44.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:44.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:44.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:44.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:44.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:44.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:44.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:44.254+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:44.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:44.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:44.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:44.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:45.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:45.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:45.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:45.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:45.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:45.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:45.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:45.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:45.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:45.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:45.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:45.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:45.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:45.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:45.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:45.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:45.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:45.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:45.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:45.406+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:45.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:45.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:45.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:45.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:50.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:50.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:50.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:50.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:50.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:50.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:50.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:50.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:50.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:50.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:50.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:50.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:50.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:50.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:50.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:50.482+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:50.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:50.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:50.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:50.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:50.708 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:04:50.698+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:04:51.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:04:51.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:04:51.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:51.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:51.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:51.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:51.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:51.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:51.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:51.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.746+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:51.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.746+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:51.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.746+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:51.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.746+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:51.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:51.746+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:52.708 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:04:52.709 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:04:52.709 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:04:52.853 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:04:52.850+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:04:52.854 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:04:52.891 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:04:54.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:54.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:54.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:54.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:54.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:54.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:54.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:54.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:54.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:54.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.118+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:54.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:54.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:54.521 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:04:54.518+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:04:54.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:54.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:54.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:54.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:54.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:54.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:54.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:54.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:54.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:54.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.830+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:54.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:54.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:55.305 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:04:55.302+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:04:55.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:55.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:55.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:55.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:55.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:55.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:55.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:55.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:55.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.414+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:55.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:55.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:55.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:55.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:55.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:55.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:55.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:55.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:55.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:55.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.770+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:55.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:55.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:55.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:56.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:04:56.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:04:56.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:56.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:56.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:56.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:56.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:56.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:56.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:56.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:56.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:56.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.262+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:56.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:56.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:56.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:04:56.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:56.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:56.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:56.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:56.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:56.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:56.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:56.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:56.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:56.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.562+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:56.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.562+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:56.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:56.562+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:58.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:58.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:58.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:58.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:58.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:58.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:58.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:58.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:58.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.094+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:58.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:58.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:58.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:04:58.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:04:58.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:58.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:58.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:58.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:58.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:58.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:58.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:58.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.206+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:58.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:58.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:58.475 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:04:58.474+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:04:58.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:58.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:58.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:58.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:58.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:58.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:59.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:59.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:59.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:59.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.090+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:59.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:59.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:04:59.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:04:59.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:04:59.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:04:59.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:04:59.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:04:59.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:04:59.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:04:59.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:04:59.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:04:59.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.634+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:04:59.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:04:59.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:04:59.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:00.846 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:05:00.842+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T01:05:00.847 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:05:00.842+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:05:01.646 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:05:01.641+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:05:02.893 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:05:02.894 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:05:02.894 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:05:03.005 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:05:03.001+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:05:03.006 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:05:03.030 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:05:04.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:04.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:04.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:04.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:04.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:04.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:04.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:04.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:04.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:04.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:04.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:04.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:04.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:04.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:04.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:04.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:04.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:04.705+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:04.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:04.705+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:04.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:04.705+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:06.188 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:05:06.185+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:05:08.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:08.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:08.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:08.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:08.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:08.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:08.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:08.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:08.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.249+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:08.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:08.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:08.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:08.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:08.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:08.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:08.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:08.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:08.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:08.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:08.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:08.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.969+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:08.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:08.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:08.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:09.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:09.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:09.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:09.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:09.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:09.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:09.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:09.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:09.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:09.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:09.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:09.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:09.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:09.173+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:09.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:09.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:09.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:09.205+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:09.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:09.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:09.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:09.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:10.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:10.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:10.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:10.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:10.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:10.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:10.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:10.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:10.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:10.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:10.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:10.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:10.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:10.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:10.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:10.085+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:10.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:10.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:10.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:10.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:12.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:12.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:12.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:12.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:12.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:12.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:12.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:12.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:12.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.429+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:12.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:12.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:12.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:12.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:12.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:12.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:12.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:12.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:12.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:12.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:12.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.585+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:12.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:12.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:12.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:13.036 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:05:13.036 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:05:13.036 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:05:13.106 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:05:13.101+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:05:13.131 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:05:13.125+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:05:13.132 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:05:13.153 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:05:15.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:15.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:15.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:15.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:15.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.269+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:15.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:15.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:15.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:15.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:15.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:15.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:15.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:15.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:15.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:15.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:15.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:15.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:15.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:15.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:15.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:15.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:15.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:15.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:15.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:05:15.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:15.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:15.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:15.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:15.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:15.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:15.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:15.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:15.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:15.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.777+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:15.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:15.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:15.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:15.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:15.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:15.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:15.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:15.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:16.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:16.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:16.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:16.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:16.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.057+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:16.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:16.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:16.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:16.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:16.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:16.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:16.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:16.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:16.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:16.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:16.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.301+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:16.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.329+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:16.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.329+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:16.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:16.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:05:16.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:05:17.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:17.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:17.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:16.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:17.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:17.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:17.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:17.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:17.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:17.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:17.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:17.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:17.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:17.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:17.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:17.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:17.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:17.073+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:17.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:17.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:17.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:17.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:19.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:19.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:19.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:19.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:19.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:19.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:19.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:19.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:19.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:19.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:19.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:19.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:19.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:19.441+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:19.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:19.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:19.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:19.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:21.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:21.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:21.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:21.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:21.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:21.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:21.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:21.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.117+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:21.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:21.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.121+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:21.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:21.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:21.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:21.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:21.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:22.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:22.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:22.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:22.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:22.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:22.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.497+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:22.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.501+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:22.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:22.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:22.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:22.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:22.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:22.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:22.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:22.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:22.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:22.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:22.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:22.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.621+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:22.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:22.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:22.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:22.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:22.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:22.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:22.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:22.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:22.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:22.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:22.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.813+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:22.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:22.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:22.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:23.158 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:05:23.158 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:05:23.159 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:05:23.243 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:05:23.237+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:05:23.244 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:05:23.250 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:05:25.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:25.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:25.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:25.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:25.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:25.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:25.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:25.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.113+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:25.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:25.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.161+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:25.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:25.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.169+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:25.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:25.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:25.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:25.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:25.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:25.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:25.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:25.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:25.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:27.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:27.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:05:27.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:27.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:27.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:27.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:27.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:27.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:27.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:27.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:27.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:27.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.409+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:27.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:27.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:27.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:27.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:27.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:27.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:27.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.973+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:27.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:27.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:27.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:28.978 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:05:28.973+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:05:30.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:30.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:30.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:30.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:30.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:30.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:30.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:30.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:30.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:30.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:30.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:30.325+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:30.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:30.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:31.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:05:31.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:31.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:31.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:31.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:31.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:31.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:31.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.109+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:31.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:31.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:31.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:31.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:31.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:31.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:31.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:31.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:31.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:31.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:31.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:31.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.593+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:31.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:31.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:32.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:32.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:32.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:32.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:32.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:32.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:33.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:33.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:33.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:33.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:33.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:33.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:33.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:33.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:33.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:33.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:33.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:33.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:33.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:33.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:33.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:33.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:33.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:33.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:33.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:33.225+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:33.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:33.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:33.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:33.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:33.283 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:05:33.284 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:05:33.284 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule add -p rbd --image image1 2m 2023-10-14T01:05:33.403 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:05:33.401+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:05:33.406 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule add failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:05:33.440 INFO:tasks.workunit.client.0.smithi191.stderr:+ sleep 10 2023-10-14T01:05:35.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:05:35.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:35.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:35.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:35.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:35.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:35.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:35.588 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:05:35.585+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:05:35.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:35.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:35.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:35.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.601+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:35.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:35.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:05:35.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:35.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:35.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:35.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:35.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:35.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:35.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:35.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:05:35.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:35.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:35.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:35.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:35.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:35.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:35.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:35.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:05:35.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:35.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:35.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:35.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:35.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:35.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:36.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:36.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:36.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:36.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:36.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:36.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:36.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:36.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:36.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:36.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:36.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:36.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:36.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:36.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:36.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:36.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:36.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:36.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:36.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:36.773+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:36.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:36.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:36.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:36.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:37.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:37.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:37.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:37.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:37.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:37.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:37.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:37.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:37.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:37.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:37.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:37.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:39.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:39.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:39.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:39.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:39.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:39.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:39.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:39.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:39.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:39.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:39.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:39.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:39.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:39.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:39.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:39.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:39.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:39.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:39.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:39.881+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:39.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:39.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:39.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:39.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:41.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:41.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:41.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:41.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:41.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:41.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:41.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:41.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:41.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:41.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:41.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:41.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:41.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:41.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:41.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:41.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:41.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:41.337+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:41.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:41.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:41.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:41.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:42.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:42.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:05:42.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:05:42.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:42.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:42.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:42.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:42.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:42.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:42.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:42.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:42.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:42.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.857+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:42.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:42.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:42.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:42.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:42.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:42.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:43.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:43.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.013+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:43.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:43.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.085+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:43.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:43.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:43.441 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i++ )) 2023-10-14T01:05:43.441 INFO:tasks.workunit.client.0.smithi191.stderr:+ (( i <= 24 )) 2023-10-14T01:05:43.442 INFO:tasks.workunit.client.0.smithi191.stderr:+ grep 'every 2m' 2023-10-14T01:05:43.443 INFO:tasks.workunit.client.0.smithi191.stderr:+ rbd mirror snapshot schedule ls -p rbd --image image1 2023-10-14T01:05:43.539 INFO:tasks.ceph.mgr.x.smithi191.stderr:2023-10-14T01:05:43.537+0000 7f3dc475d640 -1 mgr.server reply reply (11) Resource temporarily unavailable rbd_support module is not ready, try again 2023-10-14T01:05:43.543 INFO:tasks.workunit.client.0.smithi191.stderr:rbd: rbd mirror snapshot schedule list failed: (11) Resource temporarily unavailable: rbd_support module is not ready, try again 2023-10-14T01:05:43.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T01:05:43.840 INFO:tasks.workunit:Stopping ['rbd/rbd_support_module_recovery.sh'] on client.0... 2023-10-14T01:05:43.840 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-14T01:05:43.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:43.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:05:43.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:05:43.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:43.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:43.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:44.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:44.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:43.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:44.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:44.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:44.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:44.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:44.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.009+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:44.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:44.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:44.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:44.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:44.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:44.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:44.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.261+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:44.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:44.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:44.404 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:05:44.401+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:05:44.439 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:05:44.433+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:05:44.822 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_idryomov_ceph_735f68d7bf91d643813a8420fc2b11441f4bd8c4/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_idryomov_ceph_735f68d7bf91d643813a8420fc2b11441f4bd8c4/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/rbd_support_module_recovery.sh) on smithi191 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=735f68d7bf91d643813a8420fc2b11441f4bd8c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_support_module_recovery.sh' 2023-10-14T01:05:44.887 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9c1878e8b80a48598997d1721abb1bf2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_idryomov_ceph_735f68d7bf91d643813a8420fc2b11441f4bd8c4/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_idryomov_ceph_735f68d7bf91d643813a8420fc2b11441f4bd8c4/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/rbd_support_module_recovery.sh) on smithi191 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=735f68d7bf91d643813a8420fc2b11441f4bd8c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_support_module_recovery.sh' 2023-10-14T01:05:44.890 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T01:05:44.937 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T01:05:44.952 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T01:05:44.953 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:05:45.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:45.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:45.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:45.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:45.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:45.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.609+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:45.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:45.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:45.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:45.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:45.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:45.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:05:45.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:05:45.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:45.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:45.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:45.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:45.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:45.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:45.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:45.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:45.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:45.846 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:05:45.846 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:05:45.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.849+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:45.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.849+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:45.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:45.849+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:45.902 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2111,"stamp":"2023-10-14T01:05:45.293799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27918254547,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1916432,"num_read_kb":7407300,"num_write":1869158,"num_write_kb":7475167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80550,"ondisk_log_size":80550,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20486420,"kb_used_data":14947124,"kb_used_omap":2749,"kb_used_meta":5536514,"kb_avail":262629100,"statfs":{"total":289910292480,"available":268932198400,"internally_reserved":0,"allocated":15305854976,"data_stored":27877161446,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2815434,"internal_metadata":5669390902},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,5,10,18,22,12,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17240064,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4368,"num_read_kb":17388,"num_write":4420,"num_write_kb":17680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002097"},"pg_stats":[{"pgid":"2.7","version":"143'239669","reported_seq":470245,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.596703+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:05:42.596703+0000","last_peered":"2023-10-14T01:05:42.596703+0000","last_clean":"2023-10-14T01:05:42.596703+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:05:42.596703+0000","last_undegraded":"2023-10-14T01:05:42.596703+0000","last_fullsized":"2023-10-14T01:05:42.596703+0000","mapping_epoch":13,"log_start":"141'229617","ondisk_log_start":"141'229617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:07:47.599731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3395662360,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":233342,"num_read_kb":901252,"num_write":226737,"num_write_kb":906601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"143'252439","reported_seq":498046,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.658758+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:05:42.658758+0000","last_peered":"2023-10-14T01:05:42.658758+0000","last_clean":"2023-10-14T01:05:42.658758+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:05:42.658758+0000","last_undegraded":"2023-10-14T01:05:42.658758+0000","last_fullsized":"2023-10-14T01:05:42.658758+0000","mapping_epoch":13,"log_start":"141'242416","ondisk_log_start":"141'242416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T02:38:50.082944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3592011994,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":249870,"num_read_kb":956320,"num_write":239509,"num_write_kb":957565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"143'234884","reported_seq":462752,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.625085+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:05:42.625085+0000","last_peered":"2023-10-14T01:05:42.625085+0000","last_clean":"2023-10-14T01:05:42.625085+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:05:42.625085+0000","last_undegraded":"2023-10-14T01:05:42.625085+0000","last_fullsized":"2023-10-14T01:05:42.625085+0000","mapping_epoch":13,"log_start":"141'224823","ondisk_log_start":"141'224823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:07:43.532756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3373261504,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":230325,"num_read_kb":893339,"num_write":225634,"num_write_kb":902226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"143'232744","reported_seq":461893,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.575743+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:05:42.575743+0000","last_peered":"2023-10-14T01:05:42.575743+0000","last_clean":"2023-10-14T01:05:42.575743+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:05:42.575743+0000","last_undegraded":"2023-10-14T01:05:42.575743+0000","last_fullsized":"2023-10-14T01:05:42.575743+0000","mapping_epoch":13,"log_start":"141'222717","ondisk_log_start":"141'222717","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T05:57:10.751271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3390419626,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":231208,"num_read_kb":900124,"num_write":227268,"num_write_kb":908821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"143'235992","reported_seq":471977,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:40.639048+0000","last_change":"2023-10-14T00:36:03.097871+0000","last_active":"2023-10-14T01:05:40.639048+0000","last_peered":"2023-10-14T01:05:40.639048+0000","last_clean":"2023-10-14T01:05:40.639048+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:05:40.639048+0000","last_undegraded":"2023-10-14T01:05:40.639048+0000","last_fullsized":"2023-10-14T01:05:40.639048+0000","mapping_epoch":13,"log_start":"141'225921","ondisk_log_start":"141'225921","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:23:14.633352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3456102921,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":238910,"num_read_kb":918326,"num_write":231950,"num_write_kb":927321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"143'237493","reported_seq":471440,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:41.082034+0000","last_change":"2023-10-14T00:36:03.085343+0000","last_active":"2023-10-14T01:05:41.082034+0000","last_peered":"2023-10-14T01:05:41.082034+0000","last_clean":"2023-10-14T01:05:41.082034+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:05:41.082034+0000","last_undegraded":"2023-10-14T01:05:41.082034+0000","last_fullsized":"2023-10-14T01:05:41.082034+0000","mapping_epoch":13,"log_start":"141'227411","ondisk_log_start":"141'227411","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T00:37:09.705962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3497685310,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":235959,"num_read_kb":921918,"num_write":234202,"num_write_kb":936647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"143'238754","reported_seq":475122,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:41.058988+0000","last_change":"2023-10-14T00:36:03.133826+0000","last_active":"2023-10-14T01:05:41.058988+0000","last_peered":"2023-10-14T01:05:41.058988+0000","last_clean":"2023-10-14T01:05:41.058988+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:05:41.058988+0000","last_undegraded":"2023-10-14T01:05:41.058988+0000","last_fullsized":"2023-10-14T01:05:41.058988+0000","mapping_epoch":13,"log_start":"141'228716","ondisk_log_start":"141'228716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:46:23.253542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3527959079,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":238168,"num_read_kb":931904,"num_write":235449,"num_write_kb":941659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"143'272015","reported_seq":526637,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.568872+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:05:42.568872+0000","last_peered":"2023-10-14T01:05:42.568872+0000","last_clean":"2023-10-14T01:05:42.568872+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:05:42.568872+0000","last_undegraded":"2023-10-14T01:05:42.568872+0000","last_fullsized":"2023-10-14T01:05:42.568872+0000","mapping_epoch":13,"log_start":"141'261916","ondisk_log_start":"141'261916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:19:00.717469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3684561385,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":258544,"num_read_kb":984026,"num_write":248272,"num_write_kb":992433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":301,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:04:39.769802+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:04:39.769802+0000","last_peered":"2023-10-14T01:04:39.769802+0000","last_clean":"2023-10-14T01:04:39.769802+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:04:39.769802+0000","last_undegraded":"2023-10-14T01:04:39.769802+0000","last_fullsized":"2023-10-14T01:04:39.769802+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T04:40:30.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":27917664179,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1916326,"num_read_kb":7407209,"num_write":1869021,"num_write_kb":7473273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15304351744,"data_stored":27876843366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80453,"ondisk_log_size":80453,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739154,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4427104,"kb_used_data":2871320,"kb_used_omap":494,"kb_used_meta":1555281,"kb_avail":89944736,"statfs":{"total":96636764160,"available":92103409664,"internally_reserved":0,"allocated":2940231680,"data_stored":5330231822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1592608515},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,7,4,4,5,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:05:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":0.874,"15min":0.84499999999999997},"min":{"1min":0.22800000000000001,"5min":0.186,"15min":0.17899999999999999},"max":{"1min":8.5800000000000001,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.247},{"interface":"front","average":{"1min":1.365,"5min":0.91900000000000004,"15min":0.89300000000000002},"min":{"1min":0.28599999999999998,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":8.6140000000000008,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":0.27200000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":1.071,"15min":0.91200000000000003},"min":{"1min":0.21299999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":3.012,"5min":11.999000000000001,"15min":11.999000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91500000000000004,"15min":0.999},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":3.3149999999999999,"5min":9.2300000000000004,"15min":16.649000000000001},"last":0.29299999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739143,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9365984,"kb_used_data":7473872,"kb_used_omap":1390,"kb_used_meta":1890705,"kb_avail":85005856,"statfs":{"total":96636764160,"available":87045996544,"internally_reserved":0,"allocated":7653244928,"data_stored":13939273363,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1424135,"internal_metadata":1936082169},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,4,3,12,10,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.83499999999999996,"15min":1.169},"min":{"1min":0.19900000000000001,"5min":0.17999999999999999,"15min":0.16900000000000001},"max":{"1min":4.0919999999999996,"5min":6.3380000000000001,"15min":22.082999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.1839999999999999,"15min":1.4199999999999999},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.19800000000000001},"max":{"1min":11.252000000000001,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.28499999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:05:08 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.0580000000000001,"15min":1.266},"min":{"1min":0.222,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":6.0060000000000002,"5min":10.866,"15min":11.945},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.63700000000000001,"15min":0.80000000000000004},"min":{"1min":0.23799999999999999,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.72799999999999998,"5min":7.6550000000000002,"15min":10.311999999999999},"last":0.253}]}]},{"osd":0,"up_from":8,"seq":34359739154,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6693332,"kb_used_data":4601932,"kb_used_omap":864,"kb_used_meta":2090527,"kb_avail":87678508,"statfs":{"total":96636764160,"available":89782792192,"internally_reserved":0,"allocated":4712378368,"data_stored":8607656261,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":2140700218},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,2,8,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:05:14 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.083,"15min":0.73399999999999999},"min":{"1min":0.216,"5min":0.19600000000000001,"15min":0.153},"max":{"1min":6.1500000000000004,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.28899999999999998},{"interface":"front","average":{"1min":1.169,"5min":1.1679999999999999,"15min":0.83699999999999997},"min":{"1min":0.27400000000000002,"5min":0.189,"15min":0.187},"max":{"1min":4.5999999999999996,"5min":11.304,"15min":11.304},"last":0.20599999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:05:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.86899999999999999,"15min":0.746},"min":{"1min":0.218,"5min":0.191,"15min":0.191},"max":{"1min":3.5649999999999999,"5min":7.5990000000000002,"15min":10.106},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.1379999999999999,"15min":1},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.187},"max":{"1min":7.7610000000000001,"5min":10.228999999999999,"15min":16.913},"last":0.26900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4711362560,"data_stored":8606857829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7653724160,"data_stored":13939969971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2939265024,"data_stored":5330015566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:05:45.903 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:05:46.805 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:05:46.806 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:05:46.863 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2111,"stamp":"2023-10-14T01:05:45.293799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27918254547,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1916432,"num_read_kb":7407300,"num_write":1869158,"num_write_kb":7475167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80550,"ondisk_log_size":80550,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20486420,"kb_used_data":14947124,"kb_used_omap":2749,"kb_used_meta":5536514,"kb_avail":262629100,"statfs":{"total":289910292480,"available":268932198400,"internally_reserved":0,"allocated":15305854976,"data_stored":27877161446,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2815434,"internal_metadata":5669390902},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,5,10,18,22,12,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17240064,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4368,"num_read_kb":17388,"num_write":4420,"num_write_kb":17680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002097"},"pg_stats":[{"pgid":"2.7","version":"143'239669","reported_seq":470245,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.596703+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:05:42.596703+0000","last_peered":"2023-10-14T01:05:42.596703+0000","last_clean":"2023-10-14T01:05:42.596703+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:05:42.596703+0000","last_undegraded":"2023-10-14T01:05:42.596703+0000","last_fullsized":"2023-10-14T01:05:42.596703+0000","mapping_epoch":13,"log_start":"141'229617","ondisk_log_start":"141'229617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:07:47.599731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3395662360,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":233342,"num_read_kb":901252,"num_write":226737,"num_write_kb":906601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"143'252439","reported_seq":498046,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.658758+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:05:42.658758+0000","last_peered":"2023-10-14T01:05:42.658758+0000","last_clean":"2023-10-14T01:05:42.658758+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:05:42.658758+0000","last_undegraded":"2023-10-14T01:05:42.658758+0000","last_fullsized":"2023-10-14T01:05:42.658758+0000","mapping_epoch":13,"log_start":"141'242416","ondisk_log_start":"141'242416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T02:38:50.082944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3592011994,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":249870,"num_read_kb":956320,"num_write":239509,"num_write_kb":957565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"143'234884","reported_seq":462752,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.625085+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:05:42.625085+0000","last_peered":"2023-10-14T01:05:42.625085+0000","last_clean":"2023-10-14T01:05:42.625085+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:05:42.625085+0000","last_undegraded":"2023-10-14T01:05:42.625085+0000","last_fullsized":"2023-10-14T01:05:42.625085+0000","mapping_epoch":13,"log_start":"141'224823","ondisk_log_start":"141'224823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:07:43.532756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3373261504,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":230325,"num_read_kb":893339,"num_write":225634,"num_write_kb":902226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"143'232744","reported_seq":461893,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.575743+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:05:42.575743+0000","last_peered":"2023-10-14T01:05:42.575743+0000","last_clean":"2023-10-14T01:05:42.575743+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:05:42.575743+0000","last_undegraded":"2023-10-14T01:05:42.575743+0000","last_fullsized":"2023-10-14T01:05:42.575743+0000","mapping_epoch":13,"log_start":"141'222717","ondisk_log_start":"141'222717","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T05:57:10.751271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3390419626,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":231208,"num_read_kb":900124,"num_write":227268,"num_write_kb":908821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"143'235992","reported_seq":471977,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:40.639048+0000","last_change":"2023-10-14T00:36:03.097871+0000","last_active":"2023-10-14T01:05:40.639048+0000","last_peered":"2023-10-14T01:05:40.639048+0000","last_clean":"2023-10-14T01:05:40.639048+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:05:40.639048+0000","last_undegraded":"2023-10-14T01:05:40.639048+0000","last_fullsized":"2023-10-14T01:05:40.639048+0000","mapping_epoch":13,"log_start":"141'225921","ondisk_log_start":"141'225921","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:23:14.633352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3456102921,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":238910,"num_read_kb":918326,"num_write":231950,"num_write_kb":927321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"143'237493","reported_seq":471440,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:41.082034+0000","last_change":"2023-10-14T00:36:03.085343+0000","last_active":"2023-10-14T01:05:41.082034+0000","last_peered":"2023-10-14T01:05:41.082034+0000","last_clean":"2023-10-14T01:05:41.082034+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:05:41.082034+0000","last_undegraded":"2023-10-14T01:05:41.082034+0000","last_fullsized":"2023-10-14T01:05:41.082034+0000","mapping_epoch":13,"log_start":"141'227411","ondisk_log_start":"141'227411","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T00:37:09.705962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3497685310,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":235959,"num_read_kb":921918,"num_write":234202,"num_write_kb":936647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"143'238754","reported_seq":475122,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:41.058988+0000","last_change":"2023-10-14T00:36:03.133826+0000","last_active":"2023-10-14T01:05:41.058988+0000","last_peered":"2023-10-14T01:05:41.058988+0000","last_clean":"2023-10-14T01:05:41.058988+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:05:41.058988+0000","last_undegraded":"2023-10-14T01:05:41.058988+0000","last_fullsized":"2023-10-14T01:05:41.058988+0000","mapping_epoch":13,"log_start":"141'228716","ondisk_log_start":"141'228716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:46:23.253542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3527959079,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":238168,"num_read_kb":931904,"num_write":235449,"num_write_kb":941659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"143'272015","reported_seq":526637,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.568872+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:05:42.568872+0000","last_peered":"2023-10-14T01:05:42.568872+0000","last_clean":"2023-10-14T01:05:42.568872+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:05:42.568872+0000","last_undegraded":"2023-10-14T01:05:42.568872+0000","last_fullsized":"2023-10-14T01:05:42.568872+0000","mapping_epoch":13,"log_start":"141'261916","ondisk_log_start":"141'261916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:19:00.717469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3684561385,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":258544,"num_read_kb":984026,"num_write":248272,"num_write_kb":992433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":301,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:04:39.769802+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:04:39.769802+0000","last_peered":"2023-10-14T01:04:39.769802+0000","last_clean":"2023-10-14T01:04:39.769802+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:04:39.769802+0000","last_undegraded":"2023-10-14T01:04:39.769802+0000","last_fullsized":"2023-10-14T01:04:39.769802+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T04:40:30.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":27917664179,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1916326,"num_read_kb":7407209,"num_write":1869021,"num_write_kb":7473273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15304351744,"data_stored":27876843366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80453,"ondisk_log_size":80453,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739154,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4427104,"kb_used_data":2871320,"kb_used_omap":494,"kb_used_meta":1555281,"kb_avail":89944736,"statfs":{"total":96636764160,"available":92103409664,"internally_reserved":0,"allocated":2940231680,"data_stored":5330231822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1592608515},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,7,4,4,5,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:05:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":0.874,"15min":0.84499999999999997},"min":{"1min":0.22800000000000001,"5min":0.186,"15min":0.17899999999999999},"max":{"1min":8.5800000000000001,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.247},{"interface":"front","average":{"1min":1.365,"5min":0.91900000000000004,"15min":0.89300000000000002},"min":{"1min":0.28599999999999998,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":8.6140000000000008,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":0.27200000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":1.071,"15min":0.91200000000000003},"min":{"1min":0.21299999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":3.012,"5min":11.999000000000001,"15min":11.999000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91500000000000004,"15min":0.999},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":3.3149999999999999,"5min":9.2300000000000004,"15min":16.649000000000001},"last":0.29299999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739143,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9365984,"kb_used_data":7473872,"kb_used_omap":1390,"kb_used_meta":1890705,"kb_avail":85005856,"statfs":{"total":96636764160,"available":87045996544,"internally_reserved":0,"allocated":7653244928,"data_stored":13939273363,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1424135,"internal_metadata":1936082169},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,4,3,12,10,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.83499999999999996,"15min":1.169},"min":{"1min":0.19900000000000001,"5min":0.17999999999999999,"15min":0.16900000000000001},"max":{"1min":4.0919999999999996,"5min":6.3380000000000001,"15min":22.082999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.1839999999999999,"15min":1.4199999999999999},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.19800000000000001},"max":{"1min":11.252000000000001,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.28499999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:05:08 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.0580000000000001,"15min":1.266},"min":{"1min":0.222,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":6.0060000000000002,"5min":10.866,"15min":11.945},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.63700000000000001,"15min":0.80000000000000004},"min":{"1min":0.23799999999999999,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.72799999999999998,"5min":7.6550000000000002,"15min":10.311999999999999},"last":0.253}]}]},{"osd":0,"up_from":8,"seq":34359739154,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6693332,"kb_used_data":4601932,"kb_used_omap":864,"kb_used_meta":2090527,"kb_avail":87678508,"statfs":{"total":96636764160,"available":89782792192,"internally_reserved":0,"allocated":4712378368,"data_stored":8607656261,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":2140700218},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,2,8,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:05:14 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.083,"15min":0.73399999999999999},"min":{"1min":0.216,"5min":0.19600000000000001,"15min":0.153},"max":{"1min":6.1500000000000004,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.28899999999999998},{"interface":"front","average":{"1min":1.169,"5min":1.1679999999999999,"15min":0.83699999999999997},"min":{"1min":0.27400000000000002,"5min":0.189,"15min":0.187},"max":{"1min":4.5999999999999996,"5min":11.304,"15min":11.304},"last":0.20599999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:05:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.86899999999999999,"15min":0.746},"min":{"1min":0.218,"5min":0.191,"15min":0.191},"max":{"1min":3.5649999999999999,"5min":7.5990000000000002,"15min":10.106},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.1379999999999999,"15min":1},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.187},"max":{"1min":7.7610000000000001,"5min":10.228999999999999,"15min":16.913},"last":0.26900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4711362560,"data_stored":8606857829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7653724160,"data_stored":13939969971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2939265024,"data_stored":5330015566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:05:46.865 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T01:05:46.865 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:05:47.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:47.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:47.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:47.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:47.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:47.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:47.795 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:05:47.796 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:05:47.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:47.843 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2112,"stamp":"2023-10-14T01:05:47.294101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27921211859,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1917186,"num_read_kb":7410308,"num_write":1869910,"num_write_kb":7478175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80510,"ondisk_log_size":80510,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20548520,"kb_used_data":14955076,"kb_used_omap":2749,"kb_used_meta":5590658,"kb_avail":262567000,"statfs":{"total":289910292480,"available":268868608000,"internally_reserved":0,"allocated":15313997824,"data_stored":27885304294,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2815434,"internal_metadata":5724834358},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,1,6,13,17,21,15],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20197376,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5122,"num_read_kb":20396,"num_write":5172,"num_write_kb":20688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002078"},"pg_stats":[{"pgid":"2.7","version":"143'239669","reported_seq":470245,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.596703+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:05:42.596703+0000","last_peered":"2023-10-14T01:05:42.596703+0000","last_clean":"2023-10-14T01:05:42.596703+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:05:42.596703+0000","last_undegraded":"2023-10-14T01:05:42.596703+0000","last_fullsized":"2023-10-14T01:05:42.596703+0000","mapping_epoch":13,"log_start":"141'229617","ondisk_log_start":"141'229617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:07:47.599731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3395662360,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":233342,"num_read_kb":901252,"num_write":226737,"num_write_kb":906601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"143'252439","reported_seq":498046,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.658758+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:05:42.658758+0000","last_peered":"2023-10-14T01:05:42.658758+0000","last_clean":"2023-10-14T01:05:42.658758+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:05:42.658758+0000","last_undegraded":"2023-10-14T01:05:42.658758+0000","last_fullsized":"2023-10-14T01:05:42.658758+0000","mapping_epoch":13,"log_start":"141'242416","ondisk_log_start":"141'242416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T02:38:50.082944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3592011994,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":249870,"num_read_kb":956320,"num_write":239509,"num_write_kb":957565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"143'234884","reported_seq":462752,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.625085+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:05:42.625085+0000","last_peered":"2023-10-14T01:05:42.625085+0000","last_clean":"2023-10-14T01:05:42.625085+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:05:42.625085+0000","last_undegraded":"2023-10-14T01:05:42.625085+0000","last_fullsized":"2023-10-14T01:05:42.625085+0000","mapping_epoch":13,"log_start":"141'224823","ondisk_log_start":"141'224823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:07:43.532756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3373261504,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":230325,"num_read_kb":893339,"num_write":225634,"num_write_kb":902226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"143'232744","reported_seq":461893,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.575743+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:05:42.575743+0000","last_peered":"2023-10-14T01:05:42.575743+0000","last_clean":"2023-10-14T01:05:42.575743+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:05:42.575743+0000","last_undegraded":"2023-10-14T01:05:42.575743+0000","last_fullsized":"2023-10-14T01:05:42.575743+0000","mapping_epoch":13,"log_start":"141'222717","ondisk_log_start":"141'222717","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T05:57:10.751271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3390419626,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":231208,"num_read_kb":900124,"num_write":227268,"num_write_kb":908821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"143'236250","reported_seq":472506,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:45.679441+0000","last_change":"2023-10-14T00:36:03.097871+0000","last_active":"2023-10-14T01:05:45.679441+0000","last_peered":"2023-10-14T01:05:45.679441+0000","last_clean":"2023-10-14T01:05:45.679441+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:05:45.679441+0000","last_undegraded":"2023-10-14T01:05:45.679441+0000","last_fullsized":"2023-10-14T01:05:45.679441+0000","mapping_epoch":13,"log_start":"141'226221","ondisk_log_start":"141'226221","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:23:14.633352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3457102345,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":239175,"num_read_kb":919386,"num_write":232202,"num_write_kb":928329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"143'237748","reported_seq":471922,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:46.086135+0000","last_change":"2023-10-14T00:36:03.085343+0000","last_active":"2023-10-14T01:05:46.086135+0000","last_peered":"2023-10-14T01:05:46.086135+0000","last_clean":"2023-10-14T01:05:46.086135+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:05:46.086135+0000","last_undegraded":"2023-10-14T01:05:46.086135+0000","last_fullsized":"2023-10-14T01:05:46.086135+0000","mapping_epoch":13,"log_start":"141'227711","ondisk_log_start":"141'227711","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T00:37:09.705962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3498684734,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":236183,"num_read_kb":922810,"num_write":234456,"num_write_kb":937663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"143'239001","reported_seq":475635,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:46.119067+0000","last_change":"2023-10-14T00:36:03.133826+0000","last_active":"2023-10-14T01:05:46.119067+0000","last_peered":"2023-10-14T01:05:46.119067+0000","last_clean":"2023-10-14T01:05:46.119067+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:05:46.119067+0000","last_undegraded":"2023-10-14T01:05:46.119067+0000","last_fullsized":"2023-10-14T01:05:46.119067+0000","mapping_epoch":13,"log_start":"141'228916","ondisk_log_start":"141'228916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:46:23.253542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3528917543,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":238433,"num_read_kb":932960,"num_write":235695,"num_write_kb":942643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"143'272015","reported_seq":526637,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:42.568872+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:05:42.568872+0000","last_peered":"2023-10-14T01:05:42.568872+0000","last_clean":"2023-10-14T01:05:42.568872+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:05:42.568872+0000","last_undegraded":"2023-10-14T01:05:42.568872+0000","last_fullsized":"2023-10-14T01:05:42.568872+0000","mapping_epoch":13,"log_start":"141'261916","ondisk_log_start":"141'261916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:19:00.717469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3684561385,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":258544,"num_read_kb":984026,"num_write":248272,"num_write_kb":992433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":301,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:04:39.769802+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:04:39.769802+0000","last_peered":"2023-10-14T01:04:39.769802+0000","last_clean":"2023-10-14T01:04:39.769802+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:04:39.769802+0000","last_undegraded":"2023-10-14T01:04:39.769802+0000","last_fullsized":"2023-10-14T01:04:39.769802+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T04:40:30.009822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":27920621491,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1917080,"num_read_kb":7410217,"num_write":1869773,"num_write_kb":7476281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15312420864,"data_stored":27884912486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80413,"ondisk_log_size":80413,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739155,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4448244,"kb_used_data":2874408,"kb_used_omap":494,"kb_used_meta":1573329,"kb_avail":89923596,"statfs":{"total":96636764160,"available":92081762304,"internally_reserved":0,"allocated":2943393792,"data_stored":5333393934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1611089667},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,6,1,7,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:05:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":0.874,"15min":0.84499999999999997},"min":{"1min":0.22800000000000001,"5min":0.186,"15min":0.17899999999999999},"max":{"1min":8.5800000000000001,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.315},{"interface":"front","average":{"1min":1.365,"5min":0.91900000000000004,"15min":0.89300000000000002},"min":{"1min":0.28599999999999998,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":8.6140000000000008,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":0.35299999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":1.071,"15min":0.91200000000000003},"min":{"1min":0.21299999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":3.012,"5min":11.999000000000001,"15min":11.999000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91500000000000004,"15min":0.999},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":3.3149999999999999,"5min":9.2300000000000004,"15min":16.649000000000001},"last":6.4359999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739143,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9365984,"kb_used_data":7473872,"kb_used_omap":1390,"kb_used_meta":1890705,"kb_avail":85005856,"statfs":{"total":96636764160,"available":87045996544,"internally_reserved":0,"allocated":7653244928,"data_stored":13939273363,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1424135,"internal_metadata":1936082169},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,1,4,3,12,10,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.83499999999999996,"15min":1.169},"min":{"1min":0.19900000000000001,"5min":0.17999999999999999,"15min":0.16900000000000001},"max":{"1min":4.0919999999999996,"5min":6.3380000000000001,"15min":22.082999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.1839999999999999,"15min":1.4199999999999999},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.19800000000000001},"max":{"1min":11.252000000000001,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.28499999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:05:08 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.0580000000000001,"15min":1.266},"min":{"1min":0.222,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":6.0060000000000002,"5min":10.866,"15min":11.945},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.63700000000000001,"15min":0.80000000000000004},"min":{"1min":0.23799999999999999,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.72799999999999998,"5min":7.6550000000000002,"15min":10.311999999999999},"last":0.253}]}]},{"osd":0,"up_from":8,"seq":34359739155,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6734292,"kb_used_data":4606796,"kb_used_omap":864,"kb_used_meta":2126623,"kb_avail":87637548,"statfs":{"total":96636764160,"available":89740849152,"internally_reserved":0,"allocated":4717359104,"data_stored":8612636997,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":2177662522},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,2,4,4,4,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:05:14 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.083,"15min":0.73399999999999999},"min":{"1min":0.216,"5min":0.19600000000000001,"15min":0.153},"max":{"1min":6.1500000000000004,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":5.4900000000000002},{"interface":"front","average":{"1min":1.169,"5min":1.1679999999999999,"15min":0.83699999999999997},"min":{"1min":0.27400000000000002,"5min":0.189,"15min":0.187},"max":{"1min":4.5999999999999996,"5min":11.304,"15min":11.304},"last":5.5389999999999997}]},{"osd":2,"last update":"Sat Oct 14 01:05:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.86899999999999999,"15min":0.746},"min":{"1min":0.218,"5min":0.191,"15min":0.191},"max":{"1min":3.5649999999999999,"5min":7.5990000000000002,"15min":10.106},"last":0.222},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.1379999999999999,"15min":1},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.187},"max":{"1min":7.7610000000000001,"5min":10.228999999999999,"15min":16.913},"last":2.105}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4716236800,"data_stored":8611732069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7653724160,"data_stored":13939969971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2942459904,"data_stored":5333210446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:05:47.845 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T01:05:47.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:05:47.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:47.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:47.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:47.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:47.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:47.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:47.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:47.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:47.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:47.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.961+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:47.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:47.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:47.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:48.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:48.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:48.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:48.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:48.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:48.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:48.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:48.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:48.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:48.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:48.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:48.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:48.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:48.429+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:05:48.619 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":143,"fsid":"45aee46f-9711-4acb-8786-feff8e40632d","created":"2023-10-13T23:59:53.196388+0000","modified":"2023-10-14T01:04:39.711668+0000","last_up_change":"2023-10-14T00:00:02.297223+0000","last_in_change":"2023-10-13T23:59:54.136833+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T00:00:04.183601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-14T00:00:08.397834+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":122,"snap_epoch":133,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ad26bebb-f6ee-40e4-8bf6-3231095fe456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6801","nonce":2437613027}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6803","nonce":2437613027}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6807","nonce":2437613027}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":2437613027},{"type":"v1","addr":"172.21.15.191:6805","nonce":2437613027}]},"public_addr":"172.21.15.191:6801/2437613027","cluster_addr":"172.21.15.191:6803/2437613027","heartbeat_back_addr":"172.21.15.191:6807/2437613027","heartbeat_front_addr":"172.21.15.191:6805/2437613027","state":["exists","up"]},{"osd":1,"uuid":"fe08648a-14db-41f2-990d-2d94f09e937e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6810","nonce":769566580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6814","nonce":769566580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6822","nonce":769566580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":769566580},{"type":"v1","addr":"172.21.15.191:6818","nonce":769566580}]},"public_addr":"172.21.15.191:6810/769566580","cluster_addr":"172.21.15.191:6814/769566580","heartbeat_back_addr":"172.21.15.191:6822/769566580","heartbeat_front_addr":"172.21.15.191:6818/769566580","state":["exists","up"]},{"osd":2,"uuid":"8fd960bd-52c1-4fa2-9144-79ebbcebc0fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6809","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6811","nonce":26623802}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6813","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6815","nonce":26623802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6821","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6823","nonce":26623802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6817","nonce":26623802},{"type":"v1","addr":"172.21.15.191:6819","nonce":26623802}]},"public_addr":"172.21.15.191:6811/26623802","cluster_addr":"172.21.15.191:6815/26623802","heartbeat_back_addr":"172.21.15.191:6823/26623802","heartbeat_front_addr":"172.21.15.191:6819/26623802","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-13T23:59:59.739091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-13T23:59:59.682828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-13T23:59:59.560459+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.191:0/3900852568":"2023-10-14T01:37:13.521449+0000","172.21.15.191:0/885920144":"2023-10-14T01:36:01.716202+0000","172.21.15.191:0/4140905281":"2023-10-14T01:34:49.540591+0000","172.21.15.191:0/4249645525":"2023-10-14T01:34:34.710423+0000","172.21.15.191:0/4060154092":"2023-10-14T01:30:59.474358+0000","172.21.15.191:0/384413792":"2023-10-14T01:30:44.403213+0000","172.21.15.191:0/123804192":"2023-10-14T01:15:47.882712+0000","172.21.15.191:0/40477746":"2023-10-14T01:10:57.070391+0000","172.21.15.191:0/4130539932":"2023-10-14T01:33:22.882086+0000","172.21.15.191:0/3829908932":"2023-10-14T01:08:31.864939+0000","172.21.15.191:0/271917931":"2023-10-14T01:19:24.136966+0000","172.21.15.191:0/222793192":"2023-10-14T01:20:51.571887+0000","172.21.15.191:0/1445207090":"2023-10-14T01:07:04.649603+0000","172.21.15.191:0/2424388657":"2023-10-14T01:38:26.261797+0000","172.21.15.191:0/1467302996":"2023-10-14T01:24:27.021601+0000","172.21.15.191:0/1935273287":"2023-10-14T01:13:21.457683+0000","172.21.15.191:0/3906586957":"2023-10-14T01:06:05.165208+0000","172.21.15.191:0/3674977100":"2023-10-14T01:14:34.474173+0000","172.21.15.191:0/526315954":"2023-10-14T01:17:00.756685+0000","172.21.15.191:0/47890785":"2023-10-14T01:18:12.054336+0000","172.21.15.191:0/1301423837":"2023-10-14T01:19:39.186079+0000","172.21.15.191:0/3282223265":"2023-10-14T01:22:03.426709+0000","172.21.15.191:0/2179266399":"2023-10-14T01:12:08.925376+0000","172.21.15.191:0/744012462":"2023-10-14T01:23:14.586290+0000","172.21.15.191:0/1490587570":"2023-10-14T01:32:10.607596+0000","172.21.15.191:0/76236964":"2023-10-14T01:24:42.228990+0000","172.21.15.191:0/3232052750":"2023-10-14T01:28:18.896858+0000","172.21.15.191:0/1363504459":"2023-10-14T01:25:54.390291+0000","172.21.15.191:0/2614774899":"2023-10-14T01:08:16.913376+0000","172.21.15.191:0/1812105209":"2023-10-14T01:05:51.212419+0000","172.21.15.191:0/3080644989":"2023-10-14T01:26:54.831882+0000","172.21.15.191:0/1404028810":"2023-10-14T01:27:08.684953+0000","172.21.15.191:0/2527626298":"2023-10-14T01:09:44.457351+0000","172.21.15.191:0/1401424761":"2023-10-14T01:29:32.001181+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T01:05:49.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:49.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:49.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:49.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:49.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:49.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:49.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:49.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:49.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:49.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:49.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:49.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:49.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:49.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:49.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:49.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:49.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:49.309+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:49.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:49.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:49.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:49.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:49.701 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T01:05:49.701 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T01:05:50.110 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2023-10-14T01:05:50.110 INFO:teuthology.orchestra.run.smithi191.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T01:05:50.111 INFO:teuthology.orchestra.run.smithi191.stdout:} 2023-10-14T01:05:50.174 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-14T01:05:50.949 INFO:teuthology.orchestra.run.smithi191.stderr:instructed osd(s) 0 to deep-scrub 2023-10-14T01:05:50.985 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T01:05:50.985 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T01:05:51.329 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2023-10-14T01:05:51.330 INFO:teuthology.orchestra.run.smithi191.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T01:05:51.330 INFO:teuthology.orchestra.run.smithi191.stdout:} 2023-10-14T01:05:51.406 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-14T01:05:52.262 INFO:teuthology.orchestra.run.smithi191.stderr:instructed osd(s) 1 to deep-scrub 2023-10-14T01:05:52.312 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T01:05:52.312 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T01:05:52.707 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2023-10-14T01:05:52.708 INFO:teuthology.orchestra.run.smithi191.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T01:05:52.708 INFO:teuthology.orchestra.run.smithi191.stdout:} 2023-10-14T01:05:52.745 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T01:05:53.523 INFO:teuthology.orchestra.run.smithi191.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T01:05:53.584 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:05:54.389 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:05:54.390 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:05:54.450 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2115,"stamp":"2023-10-14T01:05:53.295072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27934294483,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1920448,"num_read_kb":7423276,"num_write":1873291,"num_write_kb":7491699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80556,"ondisk_log_size":80556,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":19722272,"kb_used_data":14980744,"kb_used_omap":2749,"kb_used_meta":4738754,"kb_avail":263393248,"statfs":{"total":289910292480,"available":269714685952,"internally_reserved":0,"allocated":15340281856,"data_stored":27911588326,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2815434,"internal_metadata":4852484662},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,4,2,14,6,21,16,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21393408,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5392,"num_read_kb":21456,"num_write":5511,"num_write_kb":22044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001917"},"pg_stats":[{"pgid":"2.7","version":"143'240209","reported_seq":471312,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:53.032248+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:05:53.032248+0000","last_peered":"2023-10-14T01:05:53.032248+0000","last_clean":"2023-10-14T01:05:53.032248+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:05:53.032248+0000","last_undegraded":"2023-10-14T01:05:53.032248+0000","last_fullsized":"2023-10-14T01:05:53.032248+0000","mapping_epoch":13,"log_start":"141'230117","ondisk_log_start":"141'230117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3397689880,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":233862,"num_read_kb":903320,"num_write":227249,"num_write_kb":908649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"143'253017","reported_seq":499146,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:53.005721+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:05:53.005721+0000","last_peered":"2023-10-14T01:05:53.005721+0000","last_clean":"2023-10-14T01:05:53.005721+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:05:53.005721+0000","last_undegraded":"2023-10-14T01:05:53.005721+0000","last_fullsized":"2023-10-14T01:05:53.005721+0000","mapping_epoch":13,"log_start":"141'243016","ondisk_log_start":"141'243016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3594125530,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":250383,"num_read_kb":958360,"num_write":240053,"num_write_kb":959741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"143'235398","reported_seq":463748,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:52.965280+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:05:52.965280+0000","last_peered":"2023-10-14T01:05:52.965280+0000","last_clean":"2023-10-14T01:05:52.965280+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:05:52.965280+0000","last_undegraded":"2023-10-14T01:05:52.965280+0000","last_fullsized":"2023-10-14T01:05:52.965280+0000","mapping_epoch":13,"log_start":"141'225323","ondisk_log_start":"141'225323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3375186624,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":230803,"num_read_kb":895231,"num_write":226126,"num_write_kb":904194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"143'233240","reported_seq":462900,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:52.970024+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:05:52.970024+0000","last_peered":"2023-10-14T01:05:52.970024+0000","last_clean":"2023-10-14T01:05:52.970024+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:05:52.970024+0000","last_undegraded":"2023-10-14T01:05:52.970024+0000","last_fullsized":"2023-10-14T01:05:52.970024+0000","mapping_epoch":13,"log_start":"141'223217","ondisk_log_start":"141'223217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3392262826,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":231715,"num_read_kb":902140,"num_write":227753,"num_write_kb":910761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"143'236519","reported_seq":473002,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:50.708472+0000","last_change":"2023-10-14T00:36:03.097871+0000","last_active":"2023-10-14T01:05:50.708472+0000","last_peered":"2023-10-14T01:05:50.708472+0000","last_clean":"2023-10-14T01:05:50.708472+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:05:50.708472+0000","last_undegraded":"2023-10-14T01:05:50.708472+0000","last_fullsized":"2023-10-14T01:05:50.708472+0000","mapping_epoch":13,"log_start":"141'226421","ondisk_log_start":"141'226421","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:23:14.633352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3458138633,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":239403,"num_read_kb":920290,"num_write":232468,"num_write_kb":929393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"143'238002","reported_seq":472430,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:51.182462+0000","last_change":"2023-10-14T00:36:03.085343+0000","last_active":"2023-10-14T01:05:51.182462+0000","last_peered":"2023-10-14T01:05:51.182462+0000","last_clean":"2023-10-14T01:05:51.182462+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:05:51.182462+0000","last_undegraded":"2023-10-14T01:05:51.182462+0000","last_fullsized":"2023-10-14T01:05:51.182462+0000","mapping_epoch":13,"log_start":"141'227911","ondisk_log_start":"141'227911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T00:37:09.705962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3499667774,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":236435,"num_read_kb":923806,"num_write":234709,"num_write_kb":938675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"143'239265","reported_seq":476164,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:51.148708+0000","last_change":"2023-10-14T00:36:03.133826+0000","last_active":"2023-10-14T01:05:51.148708+0000","last_peered":"2023-10-14T01:05:51.148708+0000","last_clean":"2023-10-14T01:05:51.148708+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:05:51.148708+0000","last_undegraded":"2023-10-14T01:05:51.148708+0000","last_fullsized":"2023-10-14T01:05:51.148708+0000","mapping_epoch":13,"log_start":"141'229216","ondisk_log_start":"141'229216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T01:46:23.253542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3529949735,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":238697,"num_read_kb":934016,"num_write":235958,"num_write_kb":943695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"143'272646","reported_seq":527779,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:52.980751+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:05:52.980751+0000","last_peered":"2023-10-14T01:05:52.980751+0000","last_clean":"2023-10-14T01:05:52.980751+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:05:52.980751+0000","last_undegraded":"2023-10-14T01:05:52.980751+0000","last_fullsized":"2023-10-14T01:05:52.980751+0000","mapping_epoch":13,"log_start":"141'262616","ondisk_log_start":"141'262616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3686683113,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":259044,"num_read_kb":986022,"num_write":248838,"num_write_kb":994697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":302,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:32.330603+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:05:32.330603+0000","last_peered":"2023-10-14T01:05:32.330603+0000","last_clean":"2023-10-14T01:05:32.330603+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:05:32.330603+0000","last_undegraded":"2023-10-14T01:05:32.330603+0000","last_fullsized":"2023-10-14T01:05:32.330603+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":27933704115,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1920342,"num_read_kb":7423185,"num_write":1873154,"num_write_kb":7489805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15337926656,"data_stored":27910418278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80459,"ondisk_log_size":80459,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739156,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4456956,"kb_used_data":2877556,"kb_used_omap":494,"kb_used_meta":1578897,"kb_avail":89914884,"statfs":{"total":96636764160,"available":92072841216,"internally_reserved":0,"allocated":2946617344,"data_stored":5336617486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1616791299},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,0,1,2,2,2,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:05:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":0.874,"15min":0.84499999999999997},"min":{"1min":0.22800000000000001,"5min":0.186,"15min":0.17899999999999999},"max":{"1min":8.5800000000000001,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":1.365,"5min":0.91900000000000004,"15min":0.89300000000000002},"min":{"1min":0.28599999999999998,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":8.6140000000000008,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":0.46100000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":1.071,"15min":0.91200000000000003},"min":{"1min":0.21299999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":3.012,"5min":11.999000000000001,"15min":11.999000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91500000000000004,"15min":0.999},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":3.3149999999999999,"5min":9.2300000000000004,"15min":16.649000000000001},"last":0.38200000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739145,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284132,"kb_used_data":7491420,"kb_used_omap":1390,"kb_used_meta":1791313,"kb_avail":85087708,"statfs":{"total":96636764160,"available":87129812992,"internally_reserved":0,"allocated":7671214080,"data_stored":13957242515,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1424135,"internal_metadata":1834304761},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,0,10,2,13,11,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.83499999999999996,"15min":1.169},"min":{"1min":0.19900000000000001,"5min":0.17999999999999999,"15min":0.16900000000000001},"max":{"1min":4.0919999999999996,"5min":6.3380000000000001,"15min":22.082999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.1839999999999999,"15min":1.4199999999999999},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.19800000000000001},"max":{"1min":11.252000000000001,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.86899999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:05:08 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.0580000000000001,"15min":1.266},"min":{"1min":0.222,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":6.0060000000000002,"5min":10.866,"15min":11.945},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.63700000000000001,"15min":0.80000000000000004},"min":{"1min":0.23799999999999999,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.72799999999999998,"5min":7.6550000000000002,"15min":10.311999999999999},"last":0.26600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739156,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5981184,"kb_used_data":4611768,"kb_used_omap":864,"kb_used_meta":1368543,"kb_avail":88390656,"statfs":{"total":96636764160,"available":90512031744,"internally_reserved":0,"allocated":4722450432,"data_stored":8617728325,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":1401388602},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2,2,3,2,6,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:05:14 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.083,"15min":0.73399999999999999},"min":{"1min":0.216,"5min":0.19600000000000001,"15min":0.153},"max":{"1min":6.1500000000000004,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.30199999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.1679999999999999,"15min":0.83699999999999997},"min":{"1min":0.27400000000000002,"5min":0.189,"15min":0.187},"max":{"1min":4.5999999999999996,"5min":11.304,"15min":11.304},"last":0.379}]},{"osd":2,"last update":"Sat Oct 14 01:05:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.86899999999999999,"15min":0.746},"min":{"1min":0.218,"5min":0.191,"15min":0.191},"max":{"1min":3.5649999999999999,"5min":7.5990000000000002,"15min":10.106},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.1379999999999999,"15min":1},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.187},"max":{"1min":7.7610000000000001,"5min":10.228999999999999,"15min":16.913},"last":0.46400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4721377280,"data_stored":8616872549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7670816768,"data_stored":13957062579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2945732608,"data_stored":5336483150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:05:54.454 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:05:54.455 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:05:54.455 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:05:54.455 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:05:54.456 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:05:54.456 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:05:54.456 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:05:54.457 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:05:54.457 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:05:54.458 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:05:55.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:55.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:05:55.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:55.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:55.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:55.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:55.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:55.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:55.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.377+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:55.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.377+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:55.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.377+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:55.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.377+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:55.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:55.377+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:56.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:56.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:56.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:56.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:56.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:56.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:56.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.065+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:56.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:56.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:56.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:56.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:56.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:56.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:56.961+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:57.407 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:05:57.401+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:05:57.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:57.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:57.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:57.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:57.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:57.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:57.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:57.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:57.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:57.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:57.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:57.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:57.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:57.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:57.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:57.829+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:57.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:57.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:57.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:57.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:58.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:58.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:58.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:58.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:58.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:58.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:58.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:58.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:58.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.645+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:58.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:58.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:05:58.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:58.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:58.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:58.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:58.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:58.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:58.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:58.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:58.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.953+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:58.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:58.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:58.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:59.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:05:59.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:59.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:59.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:59.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:59.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:59.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:59.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:59.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:59.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.033+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:59.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:59.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:05:59.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:05:59.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:05:59.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:05:59.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:05:59.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:05:59.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:05:59.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:05:59.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:05:59.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:05:59.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:05:59.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.237+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:05:59.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:05:59.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:05:59.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:00.626 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:06:00.621+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:06:01.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:06:01.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:01.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:01.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:01.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:01.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:01.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:01.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:01.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:01.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:01.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.581+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:01.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:01.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:01.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:01.593 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:06:01.589+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:06:03.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:03.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:03.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:03.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:03.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:03.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:03.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:03.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.597+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:03.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:03.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:06:03.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:03.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:03.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:03.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:03.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:03.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:03.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:03.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:03.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:03.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.973+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:03.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:03.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:03.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:06.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:06.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:06.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:06.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:06.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:06.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:06.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:06.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:06.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:06.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:06.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:06.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:06.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:06.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:06.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:06.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:06.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:06.724+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:06.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:06.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:06.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:06.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:09.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:06:09.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:09.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:09.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:09.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:09.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:09.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:09.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:09.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.380+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:09.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:09.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.424+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:09.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:09.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:09.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:06:09.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:09.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:09.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:09.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:09.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:09.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:09.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:09.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:09.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:09.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.656+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:09.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.692+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:09.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.692+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:09.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.692+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:09.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:06:09.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:09.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:09.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:09.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:09.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:09.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:09.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:09.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:09.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:09.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:09.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.864+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:09.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:09.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:09.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:10.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:10.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:10.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:10.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:10.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:10.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:10.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:10.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:10.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:10.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.204+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:10.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:10.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:10.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:06:10.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:10.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:06:10.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:10.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:10.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:10.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:10.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:10.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:10.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:10.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.820+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:10.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:10.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.840+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:10.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:10.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:10.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:11.063 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:06:11.060+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:06:13.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:13.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:13.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:13.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:13.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:13.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:13.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:13.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:13.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:13.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:13.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:13.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:13.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:13.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:13.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:13.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:13.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:13.780+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:13.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:13.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:13.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:13.780+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:14.459 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:06:15.226 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:06:15.227 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:06:15.284 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2127,"stamp":"2023-10-14T01:06:13.298311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27960312275,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1926830,"num_read_kb":7448700,"num_write":1879948,"num_write_kb":7518327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80382,"ondisk_log_size":80382,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":19897216,"kb_used_data":15035684,"kb_used_omap":2749,"kb_used_meta":4858754,"kb_avail":263218304,"statfs":{"total":289910292480,"available":269535543296,"internally_reserved":0,"allocated":15396540416,"data_stored":27967808330,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2815434,"internal_metadata":4975364662},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,1,0,12,11,14,9,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15605760,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3798,"num_read_kb":15148,"num_write":3998,"num_write_kb":15992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001647"},"pg_stats":[{"pgid":"2.7","version":"144'240988","reported_seq":472807,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-14T01:06:08.457038+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:06:08.457038+0000","last_peered":"2023-10-14T01:06:08.457038+0000","last_clean":"2023-10-14T01:06:08.457038+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:06:08.457038+0000","last_undegraded":"2023-10-14T01:06:08.457038+0000","last_fullsized":"2023-10-14T01:06:08.457038+0000","mapping_epoch":13,"log_start":"141'230917","ondisk_log_start":"141'230917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3400598040,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":234565,"num_read_kb":906124,"num_write":227989,"num_write_kb":911609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"144'253767","reported_seq":500611,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-14T01:06:08.495987+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:06:08.495987+0000","last_peered":"2023-10-14T01:06:08.495987+0000","last_clean":"2023-10-14T01:06:08.495987+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:06:08.495987+0000","last_undegraded":"2023-10-14T01:06:08.495987+0000","last_fullsized":"2023-10-14T01:06:08.495987+0000","mapping_epoch":13,"log_start":"141'243716","ondisk_log_start":"141'243716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3596927194,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":251088,"num_read_kb":961164,"num_write":240766,"num_write_kb":962593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"144'236170","reported_seq":465193,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-14T01:06:08.491784+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:06:08.491784+0000","last_peered":"2023-10-14T01:06:08.491784+0000","last_clean":"2023-10-14T01:06:08.491784+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:06:08.491784+0000","last_undegraded":"2023-10-14T01:06:08.491784+0000","last_fullsized":"2023-10-14T01:06:08.491784+0000","mapping_epoch":13,"log_start":"141'226123","ondisk_log_start":"141'226123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3378078400,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":231468,"num_read_kb":897883,"num_write":226872,"num_write_kb":907178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"144'233957","reported_seq":464317,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-14T01:06:08.496758+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:06:08.496758+0000","last_peered":"2023-10-14T01:06:08.496758+0000","last_clean":"2023-10-14T01:06:08.496758+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:06:08.496758+0000","last_undegraded":"2023-10-14T01:06:08.496758+0000","last_fullsized":"2023-10-14T01:06:08.496758+0000","mapping_epoch":13,"log_start":"141'223917","ondisk_log_start":"141'223917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3394945706,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":232411,"num_read_kb":904916,"num_write":228457,"num_write_kb":913577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"145'237557","reported_seq":475021,"reported_epoch":145,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:06:10.935541+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:06:10.935541+0000","last_peered":"2023-10-14T01:06:10.935541+0000","last_clean":"2023-10-14T01:06:10.935541+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:06:10.935541+0000","last_undegraded":"2023-10-14T01:06:10.935541+0000","last_fullsized":"2023-10-14T01:06:10.935541+0000","mapping_epoch":13,"log_start":"141'227521","ondisk_log_start":"141'227521","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":51,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 16s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3461988873,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":240357,"num_read_kb":924094,"num_write":233459,"num_write_kb":933357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"145'239031","reported_seq":474414,"reported_epoch":145,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:06:11.375753+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:06:11.375753+0000","last_peered":"2023-10-14T01:06:11.375753+0000","last_clean":"2023-10-14T01:06:11.375753+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:06:11.375753+0000","last_undegraded":"2023-10-14T01:06:11.375753+0000","last_fullsized":"2023-10-14T01:06:11.375753+0000","mapping_epoch":13,"log_start":"141'229011","ondisk_log_start":"141'229011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":73,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 15s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3503485246,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":237375,"num_read_kb":927550,"num_write":235680,"num_write_kb":942559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"145'240323","reported_seq":478196,"reported_epoch":145,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:06:11.363389+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:06:11.363389+0000","last_peered":"2023-10-14T01:06:11.363389+0000","last_clean":"2023-10-14T01:06:11.363389+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:06:11.363389+0000","last_undegraded":"2023-10-14T01:06:11.363389+0000","last_fullsized":"2023-10-14T01:06:11.363389+0000","mapping_epoch":13,"log_start":"141'230316","ondisk_log_start":"141'230316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":90,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 16s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3533881895,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":239658,"num_read_kb":937844,"num_write":236944,"num_write_kb":947639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"144'273529","reported_seq":529438,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-14T01:06:08.508239+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:06:08.508239+0000","last_peered":"2023-10-14T01:06:08.508239+0000","last_clean":"2023-10-14T01:06:08.508239+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:06:08.508239+0000","last_undegraded":"2023-10-14T01:06:08.508239+0000","last_fullsized":"2023-10-14T01:06:08.508239+0000","mapping_epoch":13,"log_start":"142'263516","ondisk_log_start":"142'263516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3689816553,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":259802,"num_read_kb":989034,"num_write":249644,"num_write_kb":997921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":303,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-14T01:05:52.332182+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:05:52.332182+0000","last_peered":"2023-10-14T01:05:52.332182+0000","last_clean":"2023-10-14T01:05:52.332182+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:05:52.332182+0000","last_undegraded":"2023-10-14T01:05:52.332182+0000","last_fullsized":"2023-10-14T01:05:52.332182+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":27959721907,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1926724,"num_read_kb":7448609,"num_write":1879811,"num_write_kb":7516433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15394377728,"data_stored":27966869350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80285,"ondisk_log_size":80285,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739160,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4535756,"kb_used_data":2889728,"kb_used_omap":494,"kb_used_meta":1645521,"kb_avail":89836084,"statfs":{"total":96636764160,"available":91992150016,"internally_reserved":0,"allocated":2959081472,"data_stored":5349066183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1685014275},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,1,0,2,4,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:05:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":0.874,"15min":0.84499999999999997},"min":{"1min":0.22800000000000001,"5min":0.186,"15min":0.17899999999999999},"max":{"1min":8.5800000000000001,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":4.8239999999999998},{"interface":"front","average":{"1min":1.365,"5min":0.91900000000000004,"15min":0.89300000000000002},"min":{"1min":0.28599999999999998,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":8.6140000000000008,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":4.8579999999999997}]},{"osd":1,"last update":"Sat Oct 14 01:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":1.071,"15min":0.91200000000000003},"min":{"1min":0.21299999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":3.012,"5min":11.999000000000001,"15min":11.999000000000001},"last":0.313},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.91500000000000004,"15min":0.999},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":3.3149999999999999,"5min":9.2300000000000004,"15min":16.649000000000001},"last":0.47799999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739148,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9302560,"kb_used_data":7514776,"kb_used_omap":1390,"kb_used_meta":1786385,"kb_avail":85069280,"statfs":{"total":96636764160,"available":87110942720,"internally_reserved":0,"allocated":7695130624,"data_stored":13981151365,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1424135,"internal_metadata":1829258489},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,9,6,13,9,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:05:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.83499999999999996,"15min":1.169},"min":{"1min":0.19900000000000001,"5min":0.17999999999999999,"15min":0.16900000000000001},"max":{"1min":4.0919999999999996,"5min":6.3380000000000001,"15min":22.082999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.1839999999999999,"15min":1.4199999999999999},"min":{"1min":0.23499999999999999,"5min":0.22,"15min":0.19800000000000001},"max":{"1min":11.252000000000001,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.23400000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:05:08 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.0580000000000001,"15min":1.266},"min":{"1min":0.222,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":6.0060000000000002,"5min":10.866,"15min":11.945},"last":2.2690000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.63700000000000001,"15min":0.80000000000000004},"min":{"1min":0.23799999999999999,"5min":0.20300000000000001,"15min":0.19},"max":{"1min":0.72799999999999998,"5min":7.6550000000000002,"15min":10.311999999999999},"last":0.29699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739160,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6058900,"kb_used_data":4631180,"kb_used_omap":864,"kb_used_meta":1426847,"kb_avail":88312940,"statfs":{"total":96636764160,"available":90432450560,"internally_reserved":0,"allocated":4742328320,"data_stored":8637590782,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":1461091898},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:05:14 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.083,"15min":0.73399999999999999},"min":{"1min":0.216,"5min":0.19600000000000001,"15min":0.153},"max":{"1min":6.1500000000000004,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.169,"5min":1.1679999999999999,"15min":0.83699999999999997},"min":{"1min":0.27400000000000002,"5min":0.189,"15min":0.187},"max":{"1min":4.5999999999999996,"5min":11.304,"15min":11.304},"last":0.48099999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:05:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.86899999999999999,"15min":0.746},"min":{"1min":0.218,"5min":0.191,"15min":0.191},"max":{"1min":3.5649999999999999,"5min":7.5990000000000002,"15min":10.106},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":1.1379999999999999,"15min":1},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.187},"max":{"1min":7.7610000000000001,"5min":10.228999999999999,"15min":16.913},"last":0.23300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4741226496,"data_stored":8636721765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7695163392,"data_stored":13981409203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2957987840,"data_stored":5348738382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:06:15.287 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:15.287 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:15.288 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:15.289 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:15.289 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:15.290 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:15.290 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:15.291 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:15.291 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:15.292 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:06:15.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:15.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:06:15.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:15.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:15.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:15.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:15.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:15.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:15.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:15.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:15.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.760+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:15.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.764+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:15.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:15.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:15.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:16.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:16.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:06:16.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:16.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:16.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:16.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:16.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:16.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:16.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:16.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:16.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:16.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:16.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:16.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:16.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:16.108+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:16.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:16.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:16.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:16.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:17.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:17.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:06:17.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:17.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:17.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:17.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:17.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:17.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:17.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:17.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:17.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:17.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.340+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:17.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:17.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:17.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:18.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:18.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:18.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:18.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:18.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:18.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:18.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:18.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:18.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.136+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:18.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:18.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:18.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:06:18.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:18.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:18.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:18.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:18.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:18.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:18.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:18.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:18.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:18.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:18.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.272+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:18.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:18.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:18.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:19.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:19.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:19.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:19.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:19.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:19.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:19.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:19.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:19.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:19.660+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:19.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:19.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:19.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:19.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:22.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:22.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:22.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:22.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:22.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:22.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:22.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:22.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:23.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:23.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:23.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:23.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:23.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:23.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:23.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:23.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.680+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:23.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:06:23.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:23.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:06:23.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:23.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:23.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:23.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:23.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:23.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:23.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:23.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:23.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:23.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:23.756+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:25.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:06:25.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:25.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:06:25.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:25.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:25.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:25.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:25.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:25.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:25.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:25.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:25.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.116+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:25.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:25.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:25.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:28.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:28.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:28.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:28.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:28.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:28.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:28.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:28.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:28.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:28.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:28.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:28.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:28.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:28.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:28.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:28.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:28.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:28.456+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:28.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:28.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:28.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:28.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:29.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:29.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:29.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:29.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:29.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:29.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:29.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:29.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:29.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:29.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:29.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.868+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:29.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:29.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:29.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:06:29.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:29.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:29.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:29.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:29.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:31.666 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:06:31.664+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:06:33.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:33.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:33.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:33.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:33.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:33.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:33.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:33.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:33.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:33.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.484+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:33.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:33.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:33.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:33.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:33.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:33.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:33.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:33.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:33.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:33.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.884+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:33.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:33.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:33.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:34.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:06:34.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:34.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:34.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:34.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:34.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:34.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:34.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:34.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:34.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:34.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.624+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:34.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:34.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:34.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:35.294 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:06:36.204 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:06:36.205 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:06:36.244 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2138,"stamp":"2023-10-14T01:06:35.301863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":27996443091,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1935653,"num_read_kb":7483836,"num_write":1889198,"num_write_kb":7555327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80569,"ondisk_log_size":80569,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20062216,"kb_used_data":15107568,"kb_used_omap":2751,"kb_used_meta":4951872,"kb_avail":263053304,"statfs":{"total":289910292480,"available":269366583296,"internally_reserved":0,"allocated":15470149632,"data_stored":28041409809,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2817113,"internal_metadata":5070717863},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,7,36,12,13,5,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20758528,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5060,"num_read_kb":20168,"num_write":5305,"num_write_kb":21220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001926"},"pg_stats":[{"pgid":"2.7","version":"145'242277","reported_seq":475269,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-14T01:06:33.986607+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:06:33.986607+0000","last_peered":"2023-10-14T01:06:33.986607+0000","last_clean":"2023-10-14T01:06:33.986607+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:06:33.986607+0000","last_undegraded":"2023-10-14T01:06:33.986607+0000","last_fullsized":"2023-10-14T01:06:33.986607+0000","mapping_epoch":13,"log_start":"142'232217","ondisk_log_start":"142'232217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3405451800,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":235721,"num_read_kb":910720,"num_write":229213,"num_write_kb":916505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"145'255112","reported_seq":503158,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-14T01:06:33.944788+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:06:33.944788+0000","last_peered":"2023-10-14T01:06:33.944788+0000","last_clean":"2023-10-14T01:06:33.944788+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:06:33.944788+0000","last_undegraded":"2023-10-14T01:06:33.944788+0000","last_fullsized":"2023-10-14T01:06:33.944788+0000","mapping_epoch":13,"log_start":"142'245016","ondisk_log_start":"142'245016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3601944794,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":252280,"num_read_kb":965904,"num_write":242046,"num_write_kb":967713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"145'237436","reported_seq":467638,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-14T01:06:33.942663+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:06:33.942663+0000","last_peered":"2023-10-14T01:06:33.942663+0000","last_clean":"2023-10-14T01:06:33.942663+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:06:33.942663+0000","last_undegraded":"2023-10-14T01:06:33.942663+0000","last_fullsized":"2023-10-14T01:06:33.942663+0000","mapping_epoch":13,"log_start":"141'227423","ondisk_log_start":"141'227423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3382862528,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":232635,"num_read_kb":902523,"num_write":228096,"num_write_kb":912074,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"145'235250","reported_seq":466774,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-14T01:06:33.930199+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:06:33.930199+0000","last_peered":"2023-10-14T01:06:33.930199+0000","last_clean":"2023-10-14T01:06:33.930199+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:06:33.930199+0000","last_undegraded":"2023-10-14T01:06:33.930199+0000","last_fullsized":"2023-10-14T01:06:33.930199+0000","mapping_epoch":13,"log_start":"141'225217","ondisk_log_start":"141'225217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3399893674,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":233573,"num_read_kb":909552,"num_write":229728,"num_write_kb":918661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"145'238592","reported_seq":476995,"reported_epoch":145,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:06:31.111978+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:06:31.111978+0000","last_peered":"2023-10-14T01:06:31.111978+0000","last_clean":"2023-10-14T01:06:31.111978+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:06:31.111978+0000","last_undegraded":"2023-10-14T01:06:31.111978+0000","last_fullsized":"2023-10-14T01:06:31.111978+0000","mapping_epoch":13,"log_start":"141'228521","ondisk_log_start":"141'228521","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":152,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 36s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3465712137,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":241270,"num_read_kb":927738,"num_write":234407,"num_write_kb":937149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"145'240128","reported_seq":476542,"reported_epoch":145,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:06:31.490558+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:06:31.490558+0000","last_peered":"2023-10-14T01:06:31.490558+0000","last_clean":"2023-10-14T01:06:31.490558+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:06:31.490558+0000","last_undegraded":"2023-10-14T01:06:31.490558+0000","last_fullsized":"2023-10-14T01:06:31.490558+0000","mapping_epoch":13,"log_start":"142'230111","ondisk_log_start":"142'230111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":160,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 36s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3507527998,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":238392,"num_read_kb":931586,"num_write":236708,"num_write_kb":946671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"145'241399","reported_seq":480231,"reported_epoch":145,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:06:31.503353+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:06:31.503353+0000","last_peered":"2023-10-14T01:06:31.503353+0000","last_clean":"2023-10-14T01:06:31.503353+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:06:31.503353+0000","last_undegraded":"2023-10-14T01:06:31.503353+0000","last_fullsized":"2023-10-14T01:06:31.503353+0000","mapping_epoch":13,"log_start":"141'231316","ondisk_log_start":"141'231316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":172,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 36s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3537842727,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":240598,"num_read_kb":941600,"num_write":237957,"num_write_kb":951691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"145'274915","reported_seq":532124,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-14T01:06:33.918534+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:06:33.918534+0000","last_peered":"2023-10-14T01:06:33.918534+0000","last_clean":"2023-10-14T01:06:33.918534+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:06:33.918534+0000","last_undegraded":"2023-10-14T01:06:33.918534+0000","last_fullsized":"2023-10-14T01:06:33.918534+0000","mapping_epoch":13,"log_start":"142'264816","ondisk_log_start":"142'264816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3694617065,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":261078,"num_read_kb":994122,"num_write":250906,"num_write_kb":1002969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":304,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-14T01:05:54.913153+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:05:54.913153+0000","last_peered":"2023-10-14T01:05:54.913153+0000","last_clean":"2023-10-14T01:05:54.913153+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:05:54.913153+0000","last_undegraded":"2023-10-14T01:05:54.913153+0000","last_fullsized":"2023-10-14T01:05:54.913153+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":27995852723,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1935547,"num_read_kb":7483745,"num_write":1889061,"num_write_kb":7553433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15468101632,"data_stored":28040593254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80472,"ondisk_log_size":80472,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739164,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4602136,"kb_used_data":2901968,"kb_used_omap":494,"kb_used_meta":1699665,"kb_avail":89769704,"statfs":{"total":96636764160,"available":91924176896,"internally_reserved":0,"allocated":2971615232,"data_stored":5361599943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1740457731},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,1,2,8,3,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.871,"15min":0.86399999999999999},"min":{"1min":0.223,"5min":0.186,"15min":0.17899999999999999},"max":{"1min":4.8239999999999998,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":5.8579999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91700000000000004,"15min":0.91300000000000003},"min":{"1min":0.27200000000000002,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":4.8579999999999997,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":5.8890000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.78500000000000003,"15min":0.90300000000000002},"min":{"1min":0.20399999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":1.095,"5min":8.2479999999999993,"15min":11.999000000000001},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.99199999999999999,"15min":0.98799999999999999},"min":{"1min":0.26400000000000001,"5min":0.222,"15min":0.222},"max":{"1min":6.4359999999999999,"5min":9.2300000000000004,"15min":16.649000000000001},"last":5.7990000000000004}]}]},{"osd":1,"up_from":8,"seq":34359739153,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9300940,"kb_used_data":7554756,"kb_used_omap":1392,"kb_used_meta":1744783,"kb_avail":85070900,"statfs":{"total":96636764160,"available":87112601600,"internally_reserved":0,"allocated":7736070144,"data_stored":14022083148,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1425814,"internal_metadata":1786658410},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,4,34,4,3,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:06:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":0.95399999999999996,"15min":1.1539999999999999},"min":{"1min":0.22500000000000001,"5min":0.187,"15min":0.16900000000000001},"max":{"1min":7.6459999999999999,"5min":7.6459999999999999,"15min":22.082999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.3080000000000001,"15min":1.425},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.19800000000000001},"max":{"1min":7.524,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:06:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.1919999999999999,"15min":1.2549999999999999},"min":{"1min":0.23599999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":7.9279999999999999,"5min":10.866,"15min":11.945},"last":0.314},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.70099999999999996,"15min":0.78900000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.19},"max":{"1min":4.1040000000000001,"5min":7.6550000000000002,"15min":10.311999999999999},"last":0.40400000000000003}]}]},{"osd":0,"up_from":8,"seq":34359739164,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6159140,"kb_used_data":4650844,"kb_used_omap":864,"kb_used_meta":1507423,"kb_avail":88212700,"statfs":{"total":96636764160,"available":90329804800,"internally_reserved":0,"allocated":4762464256,"data_stored":8657726718,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":1543601722},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,1,6,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:06:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.1850000000000001,"15min":0.80200000000000005},"min":{"1min":0.193,"5min":0.193,"15min":0.153},"max":{"1min":7.1180000000000003,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.42199999999999999},{"interface":"front","average":{"1min":1.722,"5min":1.196,"15min":0.90800000000000003},"min":{"1min":0.19500000000000001,"5min":0.189,"15min":0.187},"max":{"1min":10.791,"5min":10.791,"15min":11.304},"last":0.314}]},{"osd":2,"last update":"Sat Oct 14 01:06:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.95899999999999996,"15min":0.75700000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.191},"max":{"1min":6.7519999999999998,"5min":7.5990000000000002,"15min":10.106},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.151,"5min":1.226,"15min":1.0189999999999999},"min":{"1min":0.214,"5min":0.21299999999999999,"15min":0.187},"max":{"1min":8.7379999999999995,"5min":10.228999999999999,"15min":16.913},"last":0.27900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4761374720,"data_stored":8656869989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7736274944,"data_stored":14022520755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2970451968,"data_stored":5361202510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:06:36.245 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:36.245 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:36.246 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:36.246 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:36.247 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:36.247 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:36.248 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:36.248 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:36.248 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:36.249 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:06:36.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:36.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:36.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:36.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:36.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:36.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:36.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:36.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:36.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:36.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:36.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:36.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:36.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:36.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:36.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:36.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:36.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:36.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:36.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:36.684+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:36.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:36.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:36.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:36.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:37.448 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:06:37.448+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:06:37.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:37.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:37.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:37.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:37.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:37.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:37.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:37.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:37.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:37.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:37.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:37.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:37.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:37.832+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:37.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:37.840+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:37.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:37.864+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:38.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:38.140+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:38.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:38.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:38.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:38.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:38.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:38.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:38.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:38.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:38.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:38.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:38.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:38.208+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:38.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:38.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:38.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:38.272+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:38.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:38.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:38.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:38.272+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:40.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:40.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:40.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:40.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:40.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:40.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:40.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:40.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:40.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.476+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:40.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:40.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:40.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:40.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:40.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:40.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:40.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:40.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:40.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:40.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:40.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:40.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:40.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.728+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:40.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:40.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:40.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:40.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:40.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:41.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:41.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:41.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:41.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:41.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.052+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:41.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:41.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.068+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:41.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:41.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:41.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:41.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:41.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:41.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:41.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:41.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:41.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:41.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:41.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.796+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:41.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:41.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:41.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:42.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:42.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:42.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:42.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:42.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:42.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:42.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:42.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:42.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:42.720+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:42.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:42.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:42.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:42.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:43.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:43.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:43.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:43.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:43.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:43.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:43.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:43.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:43.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:43.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.364+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:43.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.368+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:43.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.368+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:43.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:43.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:43.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:43.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:43.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:43.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:43.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:43.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:43.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:43.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.964+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:43.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:43.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:44.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:44.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:44.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:44.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:44.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:44.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:44.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:44.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:44.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:44.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:44.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:44.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:46.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:46.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:46.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:46.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:46.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:46.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:46.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:46.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:46.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:46.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:46.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:46.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:46.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:46.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:46.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:46.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:46.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:46.996+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:46.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:46.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:46.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:46.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:47.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:47.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:47.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:47.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:47.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:47.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:47.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:47.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:47.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:47.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:47.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:47.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:47.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:47.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:47.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:47.132+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:47.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:47.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:47.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:47.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:49.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:49.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:49.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:49.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:49.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:49.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:49.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:49.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:49.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:49.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:49.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:49.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:49.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:49.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:49.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:49.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:49.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:49.620+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:49.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:49.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:49.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:49.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:50.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:50.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:50.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:50.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:50.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:50.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:50.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:50.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:50.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:50.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.596+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:50.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:50.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:50.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:50.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:50.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:50.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:50.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:50.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:50.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:54.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:54.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:54.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:54.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:54.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:54.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:54.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:54.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:54.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:54.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:54.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:54.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:54.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:54.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:54.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:54.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:54.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:54.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:54.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:54.792+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:54.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:54.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:54.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:54.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:56.250 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:06:56.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:56.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:56.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:56.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:56.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:56.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:56.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:56.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:56.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:56.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:56.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.992+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:56.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:06:56.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:56.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:06:57.065 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:06:57.066 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:06:57.125 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2148,"stamp":"2023-10-14T01:06:55.305527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28027507155,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1943337,"num_read_kb":7514468,"num_write":1897161,"num_write_kb":7587179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80561,"ondisk_log_size":80561,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20338884,"kb_used_data":15171816,"kb_used_omap":2751,"kb_used_meta":5164288,"kb_avail":262776636,"statfs":{"total":289910292480,"available":269083275264,"internally_reserved":0,"allocated":15535939584,"data_stored":28107199761,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2817113,"internal_metadata":5288231847},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,4,4,10,11,17,11],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20140032,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4981,"num_read_kb":19864,"num_write":5164,"num_write_kb":20656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002118"},"pg_stats":[{"pgid":"2.7","version":"145'243298","reported_seq":477235,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-14T01:06:54.377898+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:06:54.377898+0000","last_peered":"2023-10-14T01:06:54.377898+0000","last_clean":"2023-10-14T01:06:54.377898+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:06:54.377898+0000","last_undegraded":"2023-10-14T01:06:54.377898+0000","last_fullsized":"2023-10-14T01:06:54.377898+0000","mapping_epoch":13,"log_start":"142'233217","ondisk_log_start":"142'233217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3409273368,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":236658,"num_read_kb":914456,"num_write":230183,"num_write_kb":920385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"145'256161","reported_seq":505106,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-14T01:06:54.372915+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:06:54.372915+0000","last_peered":"2023-10-14T01:06:54.372915+0000","last_clean":"2023-10-14T01:06:54.372915+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:06:54.372915+0000","last_undegraded":"2023-10-14T01:06:54.372915+0000","last_fullsized":"2023-10-14T01:06:54.372915+0000","mapping_epoch":13,"log_start":"142'246116","ondisk_log_start":"142'246116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3605876954,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":253160,"num_read_kb":969416,"num_write":243044,"num_write_kb":971705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"145'238448","reported_seq":469635,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-14T01:06:54.353392+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:06:54.353392+0000","last_peered":"2023-10-14T01:06:54.353392+0000","last_clean":"2023-10-14T01:06:54.353392+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:06:54.353392+0000","last_undegraded":"2023-10-14T01:06:54.353392+0000","last_fullsized":"2023-10-14T01:06:54.353392+0000","mapping_epoch":13,"log_start":"142'228423","ondisk_log_start":"142'228423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3386708672,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":233613,"num_read_kb":906419,"num_write":229074,"num_write_kb":915986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"145'236267","reported_seq":468773,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-14T01:06:54.355990+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:06:54.355990+0000","last_peered":"2023-10-14T01:06:54.355990+0000","last_clean":"2023-10-14T01:06:54.355990+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:06:54.355990+0000","last_undegraded":"2023-10-14T01:06:54.355990+0000","last_fullsized":"2023-10-14T01:06:54.355990+0000","mapping_epoch":13,"log_start":"142'226217","ondisk_log_start":"142'226217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3403743914,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":234546,"num_read_kb":913416,"num_write":230728,"num_write_kb":922661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"145'239668","reported_seq":479022,"reported_epoch":145,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:06:51.326664+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:06:51.326664+0000","last_peered":"2023-10-14T01:06:51.326664+0000","last_clean":"2023-10-14T01:06:51.326664+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:06:51.326664+0000","last_undegraded":"2023-10-14T01:06:51.326664+0000","last_fullsized":"2023-10-14T01:06:51.326664+0000","mapping_epoch":13,"log_start":"142'229622","ondisk_log_start":"142'229622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":291,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 56s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3469521417,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":242200,"num_read_kb":931450,"num_write":235380,"num_write_kb":941041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"145'241206","reported_seq":478629,"reported_epoch":145,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:06:51.879650+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:06:51.879650+0000","last_peered":"2023-10-14T01:06:51.879650+0000","last_clean":"2023-10-14T01:06:51.879650+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:06:51.879650+0000","last_undegraded":"2023-10-14T01:06:51.879650+0000","last_fullsized":"2023-10-14T01:06:51.879650+0000","mapping_epoch":13,"log_start":"142'231111","ondisk_log_start":"142'231111","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":254,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 56s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3511451966,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":239394,"num_read_kb":935590,"num_write":237711,"num_write_kb":950683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"145'242453","reported_seq":482259,"reported_epoch":145,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:06:51.886752+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:06:51.886752+0000","last_peered":"2023-10-14T01:06:51.886752+0000","last_clean":"2023-10-14T01:06:51.886752+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:06:51.886752+0000","last_undegraded":"2023-10-14T01:06:51.886752+0000","last_fullsized":"2023-10-14T01:06:51.886752+0000","mapping_epoch":13,"log_start":"142'232416","ondisk_log_start":"142'232416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":291,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 57s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3541615143,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":241560,"num_read_kb":945436,"num_write":238914,"num_write_kb":955519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"145'276101","reported_seq":534364,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-14T01:06:54.359274+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:06:54.359274+0000","last_peered":"2023-10-14T01:06:54.359274+0000","last_clean":"2023-10-14T01:06:54.359274+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:06:54.359274+0000","last_undegraded":"2023-10-14T01:06:54.359274+0000","last_fullsized":"2023-10-14T01:06:54.359274+0000","mapping_epoch":13,"log_start":"142'266016","ondisk_log_start":"142'266016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3698725353,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":262100,"num_read_kb":998194,"num_write":251990,"num_write_kb":1007305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":304,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-10-14T01:05:54.913153+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:05:54.913153+0000","last_peered":"2023-10-14T01:05:54.913153+0000","last_clean":"2023-10-14T01:05:54.913153+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:05:54.913153+0000","last_undegraded":"2023-10-14T01:05:54.913153+0000","last_fullsized":"2023-10-14T01:05:54.913153+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28026916787,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1943231,"num_read_kb":7514377,"num_write":1897024,"num_write_kb":7585285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15533068288,"data_stored":28105559910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80464,"ondisk_log_size":80464,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739168,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4646132,"kb_used_data":2914028,"kb_used_omap":494,"kb_used_meta":1731601,"kb_avail":89725708,"statfs":{"total":96636764160,"available":91879124992,"internally_reserved":0,"allocated":2983964672,"data_stored":5373949383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1773160195},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,1,6,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.871,"15min":0.86399999999999999},"min":{"1min":0.223,"5min":0.186,"15min":0.17899999999999999},"max":{"1min":4.8239999999999998,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91700000000000004,"15min":0.91300000000000003},"min":{"1min":0.27200000000000002,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":4.8579999999999997,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":0.36299999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.78500000000000003,"15min":0.90300000000000002},"min":{"1min":0.20399999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":1.095,"5min":8.2479999999999993,"15min":11.999000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.99199999999999999,"15min":0.98799999999999999},"min":{"1min":0.26400000000000001,"5min":0.222,"15min":0.222},"max":{"1min":6.4359999999999999,"5min":9.2300000000000004,"15min":16.649000000000001},"last":4.7080000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739157,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9437920,"kb_used_data":7587604,"kb_used_omap":1392,"kb_used_meta":1848911,"kb_avail":84933920,"statfs":{"total":96636764160,"available":86972334080,"internally_reserved":0,"allocated":7769706496,"data_stored":14055719500,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1425814,"internal_metadata":1893285482},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,4,2,5,2,10,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:06:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":0.95399999999999996,"15min":1.1539999999999999},"min":{"1min":0.22500000000000001,"5min":0.187,"15min":0.16900000000000001},"max":{"1min":7.6459999999999999,"5min":7.6459999999999999,"15min":22.082999999999998},"last":0.20300000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.3080000000000001,"15min":1.425},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.19800000000000001},"max":{"1min":7.524,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.28699999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:06:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.1919999999999999,"15min":1.2549999999999999},"min":{"1min":0.23599999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":7.9279999999999999,"5min":10.866,"15min":11.945},"last":0.22},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.70099999999999996,"15min":0.78900000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.19},"max":{"1min":4.1040000000000001,"5min":7.6550000000000002,"15min":10.311999999999999},"last":0.26900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739168,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6254832,"kb_used_data":4670184,"kb_used_omap":864,"kb_used_meta":1583775,"kb_avail":88117008,"statfs":{"total":96636764160,"available":90231816192,"internally_reserved":0,"allocated":4782268416,"data_stored":8677530878,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":1621786170},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,5,8,1,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:06:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.1850000000000001,"15min":0.80200000000000005},"min":{"1min":0.193,"5min":0.193,"15min":0.153},"max":{"1min":7.1180000000000003,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.35999999999999999},{"interface":"front","average":{"1min":1.722,"5min":1.196,"15min":0.90800000000000003},"min":{"1min":0.19500000000000001,"5min":0.189,"15min":0.187},"max":{"1min":10.791,"5min":10.791,"15min":11.304},"last":0.20300000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:06:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.95899999999999996,"15min":0.75700000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.191},"max":{"1min":6.7519999999999998,"5min":7.5990000000000002,"15min":10.106},"last":0.27600000000000002},{"interface":"front","average":{"1min":1.151,"5min":1.226,"15min":1.0189999999999999},"min":{"1min":0.214,"5min":0.21299999999999999,"15min":0.187},"max":{"1min":8.7379999999999995,"5min":10.228999999999999,"15min":16.913},"last":0.31900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4781363200,"data_stored":8676858469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7768825856,"data_stored":14055071667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2982879232,"data_stored":5373629774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:06:57.126 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:57.127 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:57.127 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:57.127 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:57.128 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:57.128 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:57.129 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:57.129 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:57.129 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:06:57.130 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:06:58.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:58.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:58.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:58.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:58.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:58.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:58.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:58.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:58.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:58.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:58.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:58.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:58.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:58.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:58.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:58.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:58.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:58.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:58.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:58.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:58.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:58.828+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:06:59.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:59.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:06:59.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:59.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:06:59.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:59.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:06:59.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:59.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:06:59.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:59.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:06:59.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:59.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:06:59.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:59.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:06:59.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:59.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:06:59.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:59.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:06:59.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:59.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:06:59.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:59.956+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:06:59.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:06:59.972+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:01.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:01.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:01.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:01.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:01.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:01.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:01.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:01.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:01.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:01.760+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:01.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:01.772+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:01.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:01.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:01.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:01.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:03.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:07:03.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:03.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:03.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:03.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:03.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:03.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:03.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:03.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:03.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:03.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.508+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:03.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:03.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:03.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:05.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:07:05.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:05.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:05.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:05.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:05.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:05.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:05.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:05.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:05.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:05.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.672+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:05.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:05.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:05.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:07.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:07.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:07.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:07.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:07.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:07.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:07.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:07.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:07.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:07.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:07.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:07.464+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:07.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:07.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:07.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:07.504+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:07.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:07.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:07.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:07.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:08.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:07:08.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:08.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:08.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:08.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:08.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:08.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:08.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:08.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:08.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:08.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.448+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:08.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:08.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:08.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:08.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:08.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:08.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:08.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:08.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:08.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:08.587+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:09.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:07:09.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:07:09.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:09.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:09.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:09.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:09.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:09.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:09.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:09.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:09.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:09.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.863+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:09.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:09.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:09.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:07:09.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:09.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:09.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:09.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:09.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:09.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:09.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:10.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:10.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:10.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:10.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:10.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:10.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:10.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:10.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:10.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.935+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:10.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.951+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:10.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:10.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:10.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:07:10.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:10.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:07:11.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:07:11.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:11.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:11.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:11.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:11.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:11.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:11.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:11.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:11.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.159+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:11.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.175+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:11.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:11.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:11.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:11.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:07:12.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:12.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:12.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:12.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:12.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:12.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:12.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:12.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:12.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.195+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:12.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:12.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:12.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:07:12.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:07:12.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:12.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:12.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:12.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:12.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:12.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:12.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:12.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.435+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:12.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:12.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.487+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:12.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:12.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:12.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:12.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:12.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:12.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:12.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:12.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:12.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:12.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:12.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:12.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:12.939+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:13.238 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:07:13.235+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:07:14.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:14.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:14.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:14.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:14.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:14.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:14.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:14.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:14.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:14.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:14.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:14.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:14.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:14.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:14.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:14.591+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:14.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:14.591+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:14.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:14.591+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:15.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:07:15.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:15.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:15.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:15.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:15.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:15.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:15.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:15.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:15.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.775+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:15.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:15.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:15.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:15.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:15.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:15.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:15.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:15.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:15.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:15.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.975+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:15.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:15.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:15.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:17.131 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:07:17.971 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:07:17.972 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:07:17.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:17.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:17.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:17.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:17.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:17.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:17.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:17.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:17.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:17.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:18.032 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2160,"stamp":"2023-10-14T01:07:17.309097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28059021779,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1951030,"num_read_kb":7545164,"num_write":1905228,"num_write_kb":7619447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80348,"ondisk_log_size":80348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":19476508,"kb_used_data":15238588,"kb_used_omap":2751,"kb_used_meta":4235136,"kb_avail":263639012,"statfs":{"total":289910292480,"available":269966348288,"internally_reserved":0,"allocated":15604314112,"data_stored":28175550949,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2817113,"internal_metadata":4336780199},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,5,7,13,26,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16306176,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4011,"num_read_kb":16008,"num_write":4185,"num_write_kb":16740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001922"},"pg_stats":[{"pgid":"2.7","version":"146'244318","reported_seq":479208,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:14.822568+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:07:14.822568+0000","last_peered":"2023-10-14T01:07:14.822568+0000","last_clean":"2023-10-14T01:07:14.822568+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:07:14.822568+0000","last_undegraded":"2023-10-14T01:07:14.822568+0000","last_fullsized":"2023-10-14T01:07:14.822568+0000","mapping_epoch":13,"log_start":"142'234317","ondisk_log_start":"142'234317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3413070360,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":237598,"num_read_kb":918212,"num_write":231148,"num_write_kb":924245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"146'257277","reported_seq":507199,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:14.822898+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:07:14.822898+0000","last_peered":"2023-10-14T01:07:14.822898+0000","last_clean":"2023-10-14T01:07:14.822898+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:07:14.822898+0000","last_undegraded":"2023-10-14T01:07:14.822898+0000","last_fullsized":"2023-10-14T01:07:14.822898+0000","mapping_epoch":13,"log_start":"142'247216","ondisk_log_start":"142'247216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3610079450,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":254128,"num_read_kb":973272,"num_write":244106,"num_write_kb":975953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"146'239428","reported_seq":471534,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:14.791068+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:07:14.791068+0000","last_peered":"2023-10-14T01:07:14.791068+0000","last_clean":"2023-10-14T01:07:14.791068+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:07:14.791068+0000","last_undegraded":"2023-10-14T01:07:14.791068+0000","last_fullsized":"2023-10-14T01:07:14.791068+0000","mapping_epoch":13,"log_start":"142'229423","ondisk_log_start":"142'229423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3390419648,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":234524,"num_read_kb":910063,"num_write":230018,"num_write_kb":919762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"146'237196","reported_seq":470589,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:14.807894+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:07:14.807894+0000","last_peered":"2023-10-14T01:07:14.807894+0000","last_clean":"2023-10-14T01:07:14.807894+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:07:14.807894+0000","last_undegraded":"2023-10-14T01:07:14.807894+0000","last_fullsized":"2023-10-14T01:07:14.807894+0000","mapping_epoch":13,"log_start":"142'227117","ondisk_log_start":"142'227117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3407278762,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":235430,"num_read_kb":916936,"num_write":231639,"num_write_kb":926305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"146'240930","reported_seq":481486,"reported_epoch":146,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:07:16.514248+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:07:16.514248+0000","last_peered":"2023-10-14T01:07:16.514248+0000","last_clean":"2023-10-14T01:07:16.514248+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:07:16.514248+0000","last_undegraded":"2023-10-14T01:07:16.514248+0000","last_fullsized":"2023-10-14T01:07:16.514248+0000","mapping_epoch":13,"log_start":"142'230922","ondisk_log_start":"142'230922","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":375,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 81s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3474190857,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":243373,"num_read_kb":936130,"num_write":236574,"num_write_kb":945817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"146'242251","reported_seq":480645,"reported_epoch":146,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:07:12.505987+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:07:12.505987+0000","last_peered":"2023-10-14T01:07:12.505987+0000","last_clean":"2023-10-14T01:07:12.505987+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:07:12.505987+0000","last_undegraded":"2023-10-14T01:07:12.505987+0000","last_fullsized":"2023-10-14T01:07:12.505987+0000","mapping_epoch":13,"log_start":"142'232211","ondisk_log_start":"142'232211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":351,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 77s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3515207998,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":240342,"num_read_kb":939370,"num_write":238678,"num_write_kb":954551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"146'243562","reported_seq":484279,"reported_epoch":146,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:07:12.524083+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:07:12.524083+0000","last_peered":"2023-10-14T01:07:12.524083+0000","last_clean":"2023-10-14T01:07:12.524083+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:07:12.524083+0000","last_undegraded":"2023-10-14T01:07:12.524083+0000","last_fullsized":"2023-10-14T01:07:12.524083+0000","mapping_epoch":13,"log_start":"142'233516","ondisk_log_start":"142'233516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":418,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 77s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3545530919,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":242455,"num_read_kb":949008,"num_write":239920,"num_write_kb":959543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"146'277227","reported_seq":536473,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:14.811849+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:07:14.811849+0000","last_peered":"2023-10-14T01:07:14.811849+0000","last_clean":"2023-10-14T01:07:14.811849+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:07:14.811849+0000","last_undegraded":"2023-10-14T01:07:14.811849+0000","last_fullsized":"2023-10-14T01:07:14.811849+0000","mapping_epoch":13,"log_start":"142'267216","ondisk_log_start":"142'267216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3702653417,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":263074,"num_read_kb":1002082,"num_write":253008,"num_write_kb":1011377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":305,"reported_epoch":145,"state":"active+clean","last_fresh":"2023-10-14T01:06:09.789316+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:06:09.789316+0000","last_peered":"2023-10-14T01:06:09.789316+0000","last_clean":"2023-10-14T01:06:09.789316+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:06:09.789316+0000","last_undegraded":"2023-10-14T01:06:09.789316+0000","last_fullsized":"2023-10-14T01:06:09.789316+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28058431411,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1950924,"num_read_kb":7545073,"num_write":1905091,"num_write_kb":7617553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15602032640,"data_stored":28174524262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80251,"ondisk_log_size":80251,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739172,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4732164,"kb_used_data":2925884,"kb_used_omap":494,"kb_used_meta":1805777,"kb_avail":89639676,"statfs":{"total":96636764160,"available":91791028224,"internally_reserved":0,"allocated":2996105216,"data_stored":5386082147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1849116419},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,1,1,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.871,"15min":0.86399999999999999},"min":{"1min":0.223,"5min":0.186,"15min":0.17899999999999999},"max":{"1min":4.8239999999999998,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.91700000000000004,"15min":0.91300000000000003},"min":{"1min":0.27200000000000002,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":4.8579999999999997,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":0.378}]},{"osd":1,"last update":"Sat Oct 14 01:06:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.78500000000000003,"15min":0.90300000000000002},"min":{"1min":0.20399999999999999,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":1.095,"5min":8.2479999999999993,"15min":11.999000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.99199999999999999,"15min":0.98799999999999999},"min":{"1min":0.26400000000000001,"5min":0.222,"15min":0.222},"max":{"1min":6.4359999999999999,"5min":9.2300000000000004,"15min":16.649000000000001},"last":0.55600000000000005}]}]},{"osd":1,"up_from":8,"seq":34359739161,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8401612,"kb_used_data":7618492,"kb_used_omap":1392,"kb_used_meta":781711,"kb_avail":85970228,"statfs":{"total":96636764160,"available":88033513472,"internally_reserved":0,"allocated":7801335808,"data_stored":14087341032,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1425814,"internal_metadata":800472682},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,6,9,17,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:06:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":0.95399999999999996,"15min":1.1539999999999999},"min":{"1min":0.22500000000000001,"5min":0.187,"15min":0.16900000000000001},"max":{"1min":7.6459999999999999,"5min":7.6459999999999999,"15min":22.082999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.3080000000000001,"15min":1.425},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.19800000000000001},"max":{"1min":7.524,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.30599999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:06:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5589999999999999,"5min":1.1919999999999999,"15min":1.2549999999999999},"min":{"1min":0.23599999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":7.9279999999999999,"5min":10.866,"15min":11.945},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.70099999999999996,"15min":0.78900000000000003},"min":{"1min":0.222,"5min":0.222,"15min":0.19},"max":{"1min":4.1040000000000001,"5min":7.6550000000000002,"15min":10.311999999999999},"last":0.26900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739173,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6342732,"kb_used_data":4694212,"kb_used_omap":864,"kb_used_meta":1647647,"kb_avail":88029108,"statfs":{"total":96636764160,"available":90141806592,"internally_reserved":0,"allocated":4806873088,"data_stored":8702127770,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":1687191098},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,3,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.98399999999999999,"15min":0.80600000000000005},"min":{"1min":0.26300000000000001,"5min":0.193,"15min":0.153},"max":{"1min":0.76100000000000001,"5min":7.1180000000000003,"15min":8.3379999999999992},"last":0.309},{"interface":"front","average":{"1min":0.67300000000000004,"5min":1.113,"15min":0.92800000000000005},"min":{"1min":0.20300000000000001,"5min":0.189,"15min":0.187},"max":{"1min":3.5339999999999998,"5min":10.791,"15min":11.304},"last":3.5339999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.83999999999999997,"15min":0.76300000000000001},"min":{"1min":0.26000000000000001,"5min":0.214,"15min":0.191},"max":{"1min":1.135,"5min":7.5990000000000002,"15min":10.106},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":1.0920000000000001,"15min":1.04},"min":{"1min":0.24399999999999999,"5min":0.21299999999999999,"15min":0.187},"max":{"1min":3.5870000000000002,"5min":10.228999999999999,"15min":16.913},"last":3.5870000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4805955584,"data_stored":8701450853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7800868864,"data_stored":14087114675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2995208192,"data_stored":5385958734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:07:18.034 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:18.035 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:18.035 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:18.035 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:18.036 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:18.036 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:18.036 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:18.037 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:18.037 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:18.037 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:07:18.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:18.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:18.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:18.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:18.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:18.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:18.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:18.059+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:18.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:18.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:18.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:18.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:18.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:18.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:18.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:18.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:18.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:18.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:18.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:18.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:18.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:18.475+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:18.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:18.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:22.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:07:22.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:22.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:22.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:22.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:22.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:22.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:22.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:22.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.139+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:22.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.139+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:22.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.139+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:22.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.139+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:22.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.139+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:22.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:22.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:22.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:22.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:22.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:22.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:22.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:22.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:22.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.267+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:22.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:22.267+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:23.030 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:07:23.027+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:07:23.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:07:23.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:07:23.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:23.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:23.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:23.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:23.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:23.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:23.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:23.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:23.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.335+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:23.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:23.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:23.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:25.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:25.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:25.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:25.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:25.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:25.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:25.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:25.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:25.270 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:07:25.267+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:07:25.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:25.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:25.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:25.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:25.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:25.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:25.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:25.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:25.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:25.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:25.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:25.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:25.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:25.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:25.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:25.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:28.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:07:28.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:28.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:28.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:28.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:28.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:28.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:28.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:28.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:28.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.359+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:28.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:28.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:28.613 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:07:28.611+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:07:28.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:07:28.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:28.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:28.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:28.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:28.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:28.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:28.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.735+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:28.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:28.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:28.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:28.903 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:07:28.899+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:07:29.618 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:07:29.615+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:07:30.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:30.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:30.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:30.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:30.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:30.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:30.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:30.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:30.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:30.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:30.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:30.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:30.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:30.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:30.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:30.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:30.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:30.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:30.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:30.551+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:30.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:30.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:30.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:30.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:31.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:31.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:31.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:31.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:31.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:31.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:31.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:31.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:31.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:31.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:31.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:31.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:31.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:31.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:31.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:31.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:31.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:31.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:31.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:31.575+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:31.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:31.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:31.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:31.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:33.588 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:07:33.587+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:07:34.353 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:07:34.351+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:07:35.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:07:35.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:35.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:35.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:35.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:35.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:35.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:35.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:35.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:35.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.699+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:35.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:35.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:35.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:07:35.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:35.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:35.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:35.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:35.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:35.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:35.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:36.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:36.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:36.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:36.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:36.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:36.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:36.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:36.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:36.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:36.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:36.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:36.955+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:36.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:36.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:36.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:36.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:38.038 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:07:38.930 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:07:38.930 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:07:38.971 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2170,"stamp":"2023-10-14T01:07:37.320661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28089893331,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1958690,"num_read_kb":7575712,"num_write":1913140,"num_write_kb":7651095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80464,"ondisk_log_size":80464,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":19774744,"kb_used_data":15301376,"kb_used_omap":2751,"kb_used_meta":4470592,"kb_avail":263340776,"statfs":{"total":289910292480,"available":269660954624,"internally_reserved":0,"allocated":15668609024,"data_stored":28239845861,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2817113,"internal_metadata":4577887143},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,1,6,5,7,9,9,9,3],"upper_bound":1024},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16547840,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4128,"num_read_kb":16464,"num_write":4241,"num_write_kb":16964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010186"},"pg_stats":[{"pgid":"2.7","version":"146'245346","reported_seq":481170,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:35.208889+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:07:35.208889+0000","last_peered":"2023-10-14T01:07:35.208889+0000","last_clean":"2023-10-14T01:07:35.208889+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:07:35.208889+0000","last_undegraded":"2023-10-14T01:07:35.208889+0000","last_fullsized":"2023-10-14T01:07:35.208889+0000","mapping_epoch":13,"log_start":"142'235317","ondisk_log_start":"142'235317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3416977944,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":238519,"num_read_kb":921888,"num_write":232134,"num_write_kb":928189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"146'258326","reported_seq":509253,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:35.229490+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:07:35.229490+0000","last_peered":"2023-10-14T01:07:35.229490+0000","last_clean":"2023-10-14T01:07:35.229490+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:07:35.229490+0000","last_undegraded":"2023-10-14T01:07:35.229490+0000","last_fullsized":"2023-10-14T01:07:35.229490+0000","mapping_epoch":13,"log_start":"142'248316","ondisk_log_start":"142'248316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3613978842,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":255123,"num_read_kb":977240,"num_write":245113,"num_write_kb":979981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"146'240401","reported_seq":473425,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:35.226792+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:07:35.226792+0000","last_peered":"2023-10-14T01:07:35.226792+0000","last_clean":"2023-10-14T01:07:35.226792+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:07:35.226792+0000","last_undegraded":"2023-10-14T01:07:35.226792+0000","last_fullsized":"2023-10-14T01:07:35.226792+0000","mapping_epoch":13,"log_start":"142'230323","ondisk_log_start":"142'230323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3394130624,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":235436,"num_read_kb":913695,"num_write":230963,"num_write_kb":923542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"146'238198","reported_seq":472515,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:35.229992+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:07:35.229992+0000","last_peered":"2023-10-14T01:07:35.229992+0000","last_clean":"2023-10-14T01:07:35.229992+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:07:35.229992+0000","last_undegraded":"2023-10-14T01:07:35.229992+0000","last_fullsized":"2023-10-14T01:07:35.229992+0000","mapping_epoch":13,"log_start":"142'228117","ondisk_log_start":"142'228117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3411108522,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":236350,"num_read_kb":920608,"num_write":232627,"num_write_kb":930257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"146'241993","reported_seq":483515,"reported_epoch":146,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:07:36.676750+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:07:36.676750+0000","last_peered":"2023-10-14T01:07:36.676750+0000","last_clean":"2023-10-14T01:07:36.676750+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:07:36.676750+0000","last_undegraded":"2023-10-14T01:07:36.676750+0000","last_fullsized":"2023-10-14T01:07:36.676750+0000","mapping_epoch":13,"log_start":"142'231922","ondisk_log_start":"142'231922","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":474,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 102s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3478032905,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":244315,"num_read_kb":939882,"num_write":237560,"num_write_kb":949761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"146'243323","reported_seq":482716,"reported_epoch":146,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:07:32.822877+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:07:32.822877+0000","last_peered":"2023-10-14T01:07:32.822877+0000","last_clean":"2023-10-14T01:07:32.822877+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:07:32.822877+0000","last_undegraded":"2023-10-14T01:07:32.822877+0000","last_fullsized":"2023-10-14T01:07:32.822877+0000","mapping_epoch":13,"log_start":"142'233311","ondisk_log_start":"142'233311","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":458,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 97s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3519004990,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":241327,"num_read_kb":943306,"num_write":239658,"num_write_kb":958471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"146'244677","reported_seq":486354,"reported_epoch":146,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:07:32.801345+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:07:32.801345+0000","last_peered":"2023-10-14T01:07:32.801345+0000","last_clean":"2023-10-14T01:07:32.801345+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:07:32.801345+0000","last_undegraded":"2023-10-14T01:07:32.801345+0000","last_fullsized":"2023-10-14T01:07:32.801345+0000","mapping_epoch":13,"log_start":"142'234616","ondisk_log_start":"142'234616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":565,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 98s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3549479463,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":243398,"num_read_kb":952764,"num_write":240910,"num_write_kb":963503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"146'278341","reported_seq":538657,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:35.184820+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:07:35.184820+0000","last_peered":"2023-10-14T01:07:35.184820+0000","last_clean":"2023-10-14T01:07:35.184820+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:07:35.184820+0000","last_undegraded":"2023-10-14T01:07:35.184820+0000","last_fullsized":"2023-10-14T01:07:35.184820+0000","mapping_epoch":13,"log_start":"143'268316","ondisk_log_start":"143'268316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3706589673,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":264116,"num_read_kb":1006238,"num_write":254038,"num_write_kb":1015497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":306,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:04.828763+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:07:04.828763+0000","last_peered":"2023-10-14T01:07:04.828763+0000","last_clean":"2023-10-14T01:07:04.828763+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:07:04.828763+0000","last_undegraded":"2023-10-14T01:07:04.828763+0000","last_fullsized":"2023-10-14T01:07:04.828763+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28089302963,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1958584,"num_read_kb":7575621,"num_write":1913003,"num_write_kb":7649201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15666868224,"data_stored":28239359846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80367,"ondisk_log_size":80367,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739176,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4776096,"kb_used_data":2937880,"kb_used_omap":494,"kb_used_meta":1837713,"kb_avail":89595744,"statfs":{"total":96636764160,"available":91746041856,"internally_reserved":0,"allocated":3008389120,"data_stored":5398366051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1881818883},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,0,0,2,2,5,9,3],"upper_bound":1024},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:07:25 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.97399999999999998,"15min":0.89400000000000002},"min":{"1min":0.19700000000000001,"5min":0.186,"15min":0.17899999999999999},"max":{"1min":5.8579999999999997,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.036,"15min":0.94799999999999995},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":5.8890000000000002,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":0.45000000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.77000000000000002,"15min":0.84399999999999997},"min":{"1min":0.20100000000000001,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":3.5430000000000001,"5min":8.2479999999999993,"15min":11.999000000000001},"last":0.314},{"interface":"front","average":{"1min":1.534,"5min":1.0980000000000001,"15min":1.0289999999999999},"min":{"1min":0.252,"5min":0.222,"15min":0.222},"max":{"1min":5.7990000000000004,"5min":7.8470000000000004,"15min":16.649000000000001},"last":0.41899999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739165,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8538040,"kb_used_data":7649904,"kb_used_omap":1392,"kb_used_meta":886735,"kb_avail":85833800,"statfs":{"total":96636764160,"available":87893811200,"internally_reserved":0,"allocated":7833501696,"data_stored":14119506920,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1425814,"internal_metadata":908017258},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,3,4,3,7,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:07:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.81899999999999995,"15min":1.133},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.64100000000000001,"5min":7.6459999999999999,"15min":22.082999999999998},"last":0.26000000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.282,"15min":1.4430000000000001},"min":{"1min":0.23300000000000001,"5min":0.22600000000000001,"15min":0.19800000000000001},"max":{"1min":8.2850000000000001,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.71999999999999997}]},{"osd":2,"last update":"Sat Oct 14 01:07:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":1.071,"15min":1.1919999999999999},"min":{"1min":0.22,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.252,"5min":10.866,"15min":11.945},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.25900000000000001,"5min":0.222,"15min":0.20000000000000001},"max":{"1min":0.48699999999999999,"5min":7.6550000000000002,"15min":8.3170000000000002},"last":0.47999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739177,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6460608,"kb_used_data":4713592,"kb_used_omap":864,"kb_used_meta":1746143,"kb_avail":87911232,"statfs":{"total":96636764160,"available":90021101568,"internally_reserved":0,"allocated":4826718208,"data_stored":8721972890,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":1788051002},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.98399999999999999,"15min":0.80600000000000005},"min":{"1min":0.26300000000000001,"5min":0.193,"15min":0.153},"max":{"1min":0.76100000000000001,"5min":7.1180000000000003,"15min":8.3379999999999992},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":1.113,"15min":0.92800000000000005},"min":{"1min":0.20300000000000001,"5min":0.189,"15min":0.187},"max":{"1min":3.5339999999999998,"5min":10.791,"15min":11.304},"last":0.32700000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.83999999999999997,"15min":0.76300000000000001},"min":{"1min":0.26000000000000001,"5min":0.214,"15min":0.191},"max":{"1min":1.135,"5min":7.5990000000000002,"15min":10.106},"last":2.0499999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":1.0920000000000001,"15min":1.04},"min":{"1min":0.24399999999999999,"5min":0.21299999999999999,"15min":0.187},"max":{"1min":3.5870000000000002,"5min":10.228999999999999,"15min":16.913},"last":2.1379999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4825903104,"data_stored":8721398373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7833427968,"data_stored":14119673779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3007537152,"data_stored":5398287694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:07:38.973 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:38.973 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:38.974 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:38.974 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:38.975 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:38.975 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:38.975 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:38.976 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:38.976 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:07:38.977 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T01:07:39.750 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T01:07:39.807 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:07:40.570 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:07:40.609 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T01:07:41.362 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T01:07:41.433 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T01:07:42.259 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T01:07:42.320 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-10-14T01:07:42.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:42.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:42.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:42.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:42.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:42.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:42.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:42.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:42.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:42.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:42.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:42.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:42.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:42.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:42.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:42.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:42.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:42.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:43.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:43.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:43.045 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-10-14T01:07:43.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:43.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:43.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:43.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:43.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:43.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:43.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:43.115+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:43.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:43.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:43.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:43.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:07:43.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:43.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:43.131 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-10-14T01:07:43.926 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-10-14T01:07:43.975 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.0 2023-10-14T01:07:44.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:44.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:44.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:44.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:44.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:44.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:44.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:44.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:44.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:44.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:44.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:44.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:44.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:44.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:45.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:44.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:45.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:45.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:45.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:45.063+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:45.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:45.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:45.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:45.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:45.114 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.0 on osd.2 to deep-scrub 2023-10-14T01:07:45.192 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T01:07:45.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:45.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:45.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:45.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:45.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:45.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:45.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:45.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:45.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:45.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:45.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:45.927+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:45.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:45.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:45.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:45.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:46.040 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T01:07:46.073 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-10-14T01:07:47.062 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-10-14T01:07:47.187 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:07:47.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:47.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:47.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:47.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:47.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:47.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:47.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:47.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:47.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:47.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.747+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:47.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:47.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:47.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:07:47.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:07:47.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:07:47.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:47.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:47.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:47.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:47.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:47.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:47.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:47.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:47.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:47.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.851+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:47.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:47.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:47.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:48.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:48.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:48.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:48.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:48.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:48.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:48.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:48.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:48.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.439+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:48.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:48.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:48.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:48.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:48.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:48.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:48.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:48.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:48.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:48.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.991+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:49.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:49.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.999+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:49.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:49.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:48.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:50.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:50.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:50.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:50.095+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:52.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:52.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:52.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:52.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:52.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:52.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:52.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:52.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:52.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:52.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:52.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:52.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:53.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:53.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:53.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:53.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:53.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:53.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:53.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:53.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:53.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:53.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:53.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:53.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:53.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:53.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:53.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:53.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:53.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:53.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:53.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:53.743+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:53.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:53.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:53.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:53.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:55.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:55.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:55.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:55.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:55.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:55.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:55.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:55.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:55.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:55.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:55.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:55.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:55.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:55.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:55.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:55.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:55.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:55.235+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:55.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:55.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:55.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:55.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:56.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:56.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:56.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:56.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:56.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:56.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:56.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:56.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:56.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:56.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:56.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:56.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:56.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:56.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:56.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:56.135+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:56.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:56.143+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:56.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:56.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:56.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:56.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:57.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:57.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:57.696 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:07:57.695+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:07:57.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:57.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:57.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:57.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:07:57.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:57.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:07:57.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:57.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:07:57.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:57.739+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:07:57.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:57.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:07:57.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:57.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:07:59.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:59.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:07:59.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:59.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:07:59.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:59.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:07:59.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:59.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:07:59.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:59.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:07:59.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:59.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:07:59.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:07:59.611+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:00.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:00.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:00.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:00.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:00.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:00.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:00.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:00.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:00.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:00.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:00.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.391+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:00.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.391+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:00.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:00.391+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:01.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:01.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:01.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:01.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:01.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:01.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:01.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:01.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:01.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:01.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:01.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:01.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:08:01.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:01.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:01.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:01.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:01.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:01.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:01.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:01.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:01.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:01.399+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:03.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:03.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:03.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:03.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:03.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:03.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:03.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:03.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:03.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:03.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:03.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.931+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:03.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:03.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:03.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:04.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:04.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:04.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:04.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:04.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:04.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:04.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:04.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:04.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.899+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:04.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.899+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:04.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.915+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:04.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:04.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:04.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:07.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:07.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:07.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:07.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:07.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:07.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:07.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:07.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:07.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:07.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:07.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:07.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.147+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:07.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:07.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:07.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:07.188 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:08:07.961 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:08:07.962 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:08:08.024 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2185,"stamp":"2023-10-14T01:08:07.330612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28135956947,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1970476,"num_read_kb":7622748,"num_write":1924985,"num_write_kb":7698475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80641,"ondisk_log_size":80641,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20221152,"kb_used_data":15396360,"kb_used_omap":2751,"kb_used_meta":4822016,"kb_avail":262894368,"statfs":{"total":289910292480,"available":269203832832,"internally_reserved":0,"allocated":15765872640,"data_stored":28337109477,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2817113,"internal_metadata":4937745319},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,1,1,9,8,10,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21258240,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5453,"num_read_kb":21776,"num_write":5484,"num_write_kb":21936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003101"},"pg_stats":[{"pgid":"2.7","version":"146'246865","reported_seq":484163,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:08:06.131420+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:08:06.131420+0000","last_peered":"2023-10-14T01:08:06.131420+0000","last_clean":"2023-10-14T01:08:06.131420+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:08:06.131420+0000","last_undegraded":"2023-10-14T01:08:06.131420+0000","last_fullsized":"2023-10-14T01:08:06.131420+0000","mapping_epoch":13,"log_start":"143'236817","ondisk_log_start":"143'236817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3422642712,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":239978,"num_read_kb":927708,"num_write":233574,"num_write_kb":933949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"146'259898","reported_seq":512367,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:08:06.076624+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:08:06.076624+0000","last_peered":"2023-10-14T01:08:06.076624+0000","last_clean":"2023-10-14T01:08:06.076624+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:08:06.076624+0000","last_undegraded":"2023-10-14T01:08:06.076624+0000","last_fullsized":"2023-10-14T01:08:06.076624+0000","mapping_epoch":13,"log_start":"143'249816","ondisk_log_start":"143'249816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3619815642,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":256643,"num_read_kb":983308,"num_write":246607,"num_write_kb":985957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"146'241874","reported_seq":476318,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:08:06.072228+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:08:06.072228+0000","last_peered":"2023-10-14T01:08:06.072228+0000","last_clean":"2023-10-14T01:08:06.072228+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:08:06.072228+0000","last_undegraded":"2023-10-14T01:08:06.072228+0000","last_fullsized":"2023-10-14T01:08:06.072228+0000","mapping_epoch":13,"log_start":"143'231823","ondisk_log_start":"143'231823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3399615168,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":236848,"num_read_kb":919331,"num_write":232383,"num_write_kb":929222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"146'239679","reported_seq":475460,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:08:06.077564+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:08:06.077564+0000","last_peered":"2023-10-14T01:08:06.077564+0000","last_clean":"2023-10-14T01:08:06.077564+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:08:06.077564+0000","last_undegraded":"2023-10-14T01:08:06.077564+0000","last_fullsized":"2023-10-14T01:08:06.077564+0000","mapping_epoch":13,"log_start":"143'229617","ondisk_log_start":"143'229617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3416720042,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":237806,"num_read_kb":926408,"num_write":234080,"num_write_kb":936069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"146'243603","reported_seq":486609,"reported_epoch":146,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:08:07.036750+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:08:07.036750+0000","last_peered":"2023-10-14T01:08:07.036750+0000","last_clean":"2023-10-14T01:08:07.036750+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:08:07.036750+0000","last_undegraded":"2023-10-14T01:08:07.036750+0000","last_fullsized":"2023-10-14T01:08:07.036750+0000","mapping_epoch":13,"log_start":"143'233522","ondisk_log_start":"143'233522","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":616,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 132s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3483800073,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":245769,"num_read_kb":945690,"num_write":239036,"num_write_kb":955665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"146'244899","reported_seq":485761,"reported_epoch":146,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:08:03.163507+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:08:03.163507+0000","last_peered":"2023-10-14T01:08:03.163507+0000","last_clean":"2023-10-14T01:08:03.163507+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:08:03.163507+0000","last_undegraded":"2023-10-14T01:08:03.163507+0000","last_fullsized":"2023-10-14T01:08:03.163507+0000","mapping_epoch":13,"log_start":"143'234811","ondisk_log_start":"143'234811","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":602,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 127s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3524694334,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":242770,"num_read_kb":949062,"num_write":241119,"num_write_kb":964315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"146'246256","reported_seq":489423,"reported_epoch":146,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:08:03.143504+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:08:03.143504+0000","last_peered":"2023-10-14T01:08:03.143504+0000","last_clean":"2023-10-14T01:08:03.143504+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:08:03.143504+0000","last_undegraded":"2023-10-14T01:08:03.143504+0000","last_fullsized":"2023-10-14T01:08:03.143504+0000","mapping_epoch":13,"log_start":"143'236216","ondisk_log_start":"143'236216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":681,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 128s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3555344935,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":244870,"num_read_kb":958640,"num_write":242396,"num_write_kb":969447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"146'280108","reported_seq":542024,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:08:06.059224+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:08:06.059224+0000","last_peered":"2023-10-14T01:08:06.059224+0000","last_clean":"2023-10-14T01:08:06.059224+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:08:06.059224+0000","last_undegraded":"2023-10-14T01:08:06.059224+0000","last_fullsized":"2023-10-14T01:08:06.059224+0000","mapping_epoch":13,"log_start":"143'270016","ondisk_log_start":"143'270016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3712733673,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":265686,"num_read_kb":1012510,"num_write":255653,"num_write_kb":1021957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":307,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:35.228012+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:07:35.228012+0000","last_peered":"2023-10-14T01:07:35.228012+0000","last_clean":"2023-10-14T01:07:35.228012+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:07:35.228012+0000","last_undegraded":"2023-10-14T01:07:35.228012+0000","last_fullsized":"2023-10-14T01:07:35.228012+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28135366579,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1970370,"num_read_kb":7622657,"num_write":1924848,"num_write_kb":7696581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15763828736,"data_stored":28336320358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80544,"ondisk_log_size":80544,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739182,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4852440,"kb_used_data":2955920,"kb_used_omap":494,"kb_used_meta":1896017,"kb_avail":89519400,"statfs":{"total":96636764160,"available":91667865600,"internally_reserved":0,"allocated":3026862080,"data_stored":5416839011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1941522179},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:07:25 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.97399999999999998,"15min":0.89400000000000002},"min":{"1min":0.19700000000000001,"5min":0.186,"15min":0.17899999999999999},"max":{"1min":5.8579999999999997,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":1.385,"5min":1.036,"15min":0.94799999999999995},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":5.8890000000000002,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":0.434}]},{"osd":1,"last update":"Sat Oct 14 01:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.77000000000000002,"15min":0.84399999999999997},"min":{"1min":0.20100000000000001,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":3.5430000000000001,"5min":8.2479999999999993,"15min":11.999000000000001},"last":0.28899999999999998},{"interface":"front","average":{"1min":1.534,"5min":1.0980000000000001,"15min":1.0289999999999999},"min":{"1min":0.252,"5min":0.222,"15min":0.222},"max":{"1min":5.7990000000000004,"5min":7.8470000000000004,"15min":16.649000000000001},"last":0.307}]}]},{"osd":1,"up_from":8,"seq":34359739171,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8766856,"kb_used_data":7698240,"kb_used_omap":1392,"kb_used_meta":1067215,"kb_avail":85604984,"statfs":{"total":96636764160,"available":87659503616,"internally_reserved":0,"allocated":7882997760,"data_stored":14169002984,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1425814,"internal_metadata":1092828778},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,7,6,7,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:07:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.81899999999999995,"15min":1.133},"min":{"1min":0.154,"5min":0.154,"15min":0.154},"max":{"1min":0.64100000000000001,"5min":7.6459999999999999,"15min":22.082999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.282,"15min":1.4430000000000001},"min":{"1min":0.23300000000000001,"5min":0.22600000000000001,"15min":0.19800000000000001},"max":{"1min":8.2850000000000001,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.58999999999999997}]},{"osd":2,"last update":"Sat Oct 14 01:07:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":1.071,"15min":1.1919999999999999},"min":{"1min":0.22,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":1.252,"5min":10.866,"15min":11.945},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.70499999999999996,"15min":0.71099999999999997},"min":{"1min":0.25900000000000001,"5min":0.222,"15min":0.20000000000000001},"max":{"1min":0.48699999999999999,"5min":7.6550000000000002,"15min":8.3170000000000002},"last":0.28999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739183,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6601856,"kb_used_data":4742200,"kb_used_omap":864,"kb_used_meta":1858783,"kb_avail":87769984,"statfs":{"total":96636764160,"available":89876463616,"internally_reserved":0,"allocated":4856012800,"data_stored":8751267482,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":1903394362},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,1,1,2,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.98399999999999999,"15min":0.80600000000000005},"min":{"1min":0.26300000000000001,"5min":0.193,"15min":0.153},"max":{"1min":0.76100000000000001,"5min":7.1180000000000003,"15min":8.3379999999999992},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":1.113,"15min":0.92800000000000005},"min":{"1min":0.20300000000000001,"5min":0.189,"15min":0.187},"max":{"1min":3.5339999999999998,"5min":10.791,"15min":11.304},"last":0.27700000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:07:15 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.83999999999999997,"15min":0.76300000000000001},"min":{"1min":0.26000000000000001,"5min":0.214,"15min":0.191},"max":{"1min":1.135,"5min":7.5990000000000002,"15min":10.106},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":1.0920000000000001,"15min":1.04},"min":{"1min":0.24399999999999999,"5min":0.21299999999999999,"15min":0.187},"max":{"1min":3.5870000000000002,"5min":10.228999999999999,"15min":16.913},"last":0.308}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4855431168,"data_stored":8750926437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7882326016,"data_stored":14168571827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3026071552,"data_stored":5416822094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:08:08.026 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:08.027 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:08.027 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:08.028 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:08.028 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:08.029 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:08.030 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:08.030 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:08.031 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:08.031 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:08:09.487 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:09.483+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:10.158 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:10.155+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:11.254 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:11.251+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:12.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:12.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:12.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:12.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:12.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:12.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:12.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:12.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:12.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.087+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:12.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:12.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:12.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:12.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:12.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:12.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:12.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:12.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:12.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:12.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:12.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:12.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.231+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:12.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:12.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:12.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:13.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:08:13.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:13.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:13.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:13.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:13.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:13.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:13.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:13.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:13.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:13.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:13.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.438+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:13.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:13.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:13.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:08:13.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:13.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:13.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:13.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:13.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:13.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:13.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:13.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:13.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:13.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.498+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:13.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:13.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.502+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:13.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:13.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:13.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:14.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:14.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:14.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:14.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:14.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:14.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:14.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:14.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:14.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:14.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:14.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:14.426+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:14.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:14.426+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:14.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:14.426+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:14.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:14.426+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:14.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:14.426+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:16.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:16.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:16.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:16.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:16.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:16.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:16.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:16.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:16.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.574+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:16.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:16.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.630+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:16.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.630+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:16.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:16.630+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:17.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:17.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:17.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:17.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:17.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:17.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:17.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:17.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:17.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:17.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:17.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:17.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:18.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:18.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:18.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:18.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:18.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:18.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:18.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:18.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:18.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:18.086+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:18.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:18.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:18.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:18.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:20.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:20.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:20.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:20.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:20.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:20.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:20.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:20.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:20.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:20.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:20.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:20.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.478+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:20.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:20.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:20.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:20.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:20.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:20.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:20.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:20.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:20.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:20.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:20.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.990+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:20.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:20.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:20.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:21.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:21.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:21.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:21.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:22.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:21.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:22.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:22.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:22.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:22.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:22.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:22.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:22.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:22.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:22.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:22.070+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:22.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:22.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:22.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:22.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:23.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:23.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:23.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:23.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:23.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:23.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:23.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:23.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:23.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:23.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:23.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:23.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:23.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:23.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:23.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:23.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:23.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:23.330+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:23.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:23.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:23.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:23.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:24.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:08:24.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:24.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:24.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:24.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:24.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:24.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:24.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:24.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:24.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:24.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.214+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:24.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:24.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:24.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:24.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:24.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:24.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:24.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:24.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:24.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:24.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.918+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:24.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.938+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:24.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:24.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:24.946+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:27.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:27.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:27.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:27.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:27.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:27.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:27.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.346+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:27.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:27.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:27.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:08:27.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:27.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:27.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:27.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:27.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:27.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:27.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:27.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.606+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:27.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.606+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:27.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.606+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:27.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.606+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:27.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:27.606+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:28.032 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:08:28.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:28.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:28.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:28.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:28.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:28.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:28.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:28.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:28.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:28.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:28.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:28.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:28.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:28.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:28.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:28.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:28.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:28.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:28.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:28.198+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:28.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:28.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:28.798 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:08:28.799 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:08:28.895 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2196,"stamp":"2023-10-14T01:08:27.338542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28166947283,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1978444,"num_read_kb":7654492,"num_write":1932935,"num_write_kb":7730275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80590,"ondisk_log_size":80590,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20527468,"kb_used_data":15459732,"kb_used_omap":2751,"kb_used_meta":5064960,"kb_avail":262588052,"statfs":{"total":289910292480,"available":268890165248,"internally_reserved":0,"allocated":15830765568,"data_stored":28401978936,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2817113,"internal_metadata":5186519975},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,4,2,2,9,19,18,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15327232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3973,"num_read_kb":15832,"num_write":3941,"num_write_kb":15764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001679"},"pg_stats":[{"pgid":"2.7","version":"147'247903","reported_seq":486100,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-14T01:08:26.443396+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:08:26.443396+0000","last_peered":"2023-10-14T01:08:26.443396+0000","last_clean":"2023-10-14T01:08:26.443396+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:08:26.443396+0000","last_undegraded":"2023-10-14T01:08:26.443396+0000","last_fullsized":"2023-10-14T01:08:26.443396+0000","mapping_epoch":13,"log_start":"143'237817","ondisk_log_start":"143'237817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3426533912,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":240862,"num_read_kb":931244,"num_write":234564,"num_write_kb":937909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"147'260967","reported_seq":514470,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-14T01:08:26.414732+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:08:26.414732+0000","last_peered":"2023-10-14T01:08:26.414732+0000","last_clean":"2023-10-14T01:08:26.414732+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:08:26.414732+0000","last_undegraded":"2023-10-14T01:08:26.414732+0000","last_fullsized":"2023-10-14T01:08:26.414732+0000","mapping_epoch":13,"log_start":"143'250916","ondisk_log_start":"143'250916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3623755994,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":257665,"num_read_kb":987392,"num_write":247628,"num_write_kb":990041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"147'242877","reported_seq":478288,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-14T01:08:26.428710+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:08:26.428710+0000","last_peered":"2023-10-14T01:08:26.428710+0000","last_clean":"2023-10-14T01:08:26.428710+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:08:26.428710+0000","last_undegraded":"2023-10-14T01:08:26.428710+0000","last_fullsized":"2023-10-14T01:08:26.428710+0000","mapping_epoch":13,"log_start":"143'232823","ondisk_log_start":"143'232823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3403461312,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":237800,"num_read_kb":923115,"num_write":233354,"num_write_kb":933106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"147'240681","reported_seq":477495,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-14T01:08:26.432841+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:08:26.432841+0000","last_peered":"2023-10-14T01:08:26.432841+0000","last_clean":"2023-10-14T01:08:26.432841+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:08:26.432841+0000","last_undegraded":"2023-10-14T01:08:26.432841+0000","last_fullsized":"2023-10-14T01:08:26.432841+0000","mapping_epoch":13,"log_start":"143'230617","ondisk_log_start":"143'230617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3420557994,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":238833,"num_read_kb":930496,"num_write":235066,"num_write_kb":940013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"147'244656","reported_seq":488745,"reported_epoch":147,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:08:27.300061+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:08:27.300061+0000","last_peered":"2023-10-14T01:08:27.300061+0000","last_clean":"2023-10-14T01:08:27.300061+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:08:27.300061+0000","last_undegraded":"2023-10-14T01:08:27.300061+0000","last_fullsized":"2023-10-14T01:08:27.300061+0000","mapping_epoch":13,"log_start":"143'234622","ondisk_log_start":"143'234622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":716,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 152s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3487519241,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":246827,"num_read_kb":949902,"num_write":239990,"num_write_kb":959481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"147'246016","reported_seq":487826,"reported_epoch":147,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:08:23.513388+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:08:23.513388+0000","last_peered":"2023-10-14T01:08:23.513388+0000","last_clean":"2023-10-14T01:08:23.513388+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:08:23.513388+0000","last_undegraded":"2023-10-14T01:08:23.513388+0000","last_fullsized":"2023-10-14T01:08:23.513388+0000","mapping_epoch":13,"log_start":"143'236011","ondisk_log_start":"143'236011","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":690,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 148s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3528753470,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":243705,"num_read_kb":952774,"num_write":242164,"num_write_kb":968495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"147'247316","reported_seq":491527,"reported_epoch":147,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:08:23.543670+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:08:23.543670+0000","last_peered":"2023-10-14T01:08:23.543670+0000","last_clean":"2023-10-14T01:08:23.543670+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:08:23.543670+0000","last_undegraded":"2023-10-14T01:08:23.543670+0000","last_fullsized":"2023-10-14T01:08:23.543670+0000","mapping_epoch":13,"log_start":"143'237216","ondisk_log_start":"143'237216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":794,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 148s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3559170599,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":245896,"num_read_kb":962728,"num_write":243368,"num_write_kb":973335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"147'281215","reported_seq":544221,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-14T01:08:26.430474+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:08:26.430474+0000","last_peered":"2023-10-14T01:08:26.430474+0000","last_clean":"2023-10-14T01:08:26.430474+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:08:26.430474+0000","last_undegraded":"2023-10-14T01:08:26.430474+0000","last_fullsized":"2023-10-14T01:08:26.430474+0000","mapping_epoch":13,"log_start":"143'271116","ondisk_log_start":"143'271116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3716604393,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":266750,"num_read_kb":1016750,"num_write":256664,"num_write_kb":1026001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":308,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-14T01:07:47.107554+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:07:47.107554+0000","last_peered":"2023-10-14T01:07:47.107554+0000","last_clean":"2023-10-14T01:07:47.107554+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:07:47.107554+0000","last_undegraded":"2023-10-14T01:07:47.107554+0000","last_fullsized":"2023-10-14T01:07:47.107554+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28166356915,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1978338,"num_read_kb":7654401,"num_write":1932798,"num_write_kb":7728381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15828828160,"data_stored":28401319782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80493,"ondisk_log_size":80493,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739186,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4914648,"kb_used_data":2968144,"kb_used_omap":494,"kb_used_meta":1946001,"kb_avail":89457192,"statfs":{"total":96636764160,"available":91604164608,"internally_reserved":0,"allocated":3039379456,"data_stored":5429348564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1992705795},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,1,1,1,4,7,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:07:25 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":0.97399999999999998,"15min":0.89400000000000002},"min":{"1min":0.19700000000000001,"5min":0.186,"15min":0.17899999999999999},"max":{"1min":5.8579999999999997,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":2.129},{"interface":"front","average":{"1min":1.385,"5min":1.036,"15min":0.94799999999999995},"min":{"1min":0.28699999999999998,"5min":0.25,"15min":0.23300000000000001},"max":{"1min":5.8890000000000002,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":2.1680000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:07:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.77000000000000002,"15min":0.84399999999999997},"min":{"1min":0.20100000000000001,"5min":0.19500000000000001,"15min":0.183},"max":{"1min":3.5430000000000001,"5min":8.2479999999999993,"15min":11.999000000000001},"last":0.20699999999999999},{"interface":"front","average":{"1min":1.534,"5min":1.0980000000000001,"15min":1.0289999999999999},"min":{"1min":0.252,"5min":0.222,"15min":0.222},"max":{"1min":5.7990000000000004,"5min":7.8470000000000004,"15min":16.649000000000001},"last":0.42599999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739175,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8915160,"kb_used_data":7729936,"kb_used_omap":1392,"kb_used_meta":1183823,"kb_avail":85456680,"statfs":{"total":96636764160,"available":87507640320,"internally_reserved":0,"allocated":7915454464,"data_stored":14201451865,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1425814,"internal_metadata":1212235370},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,0,6,13,10,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89300000000000002,"15min":1.1639999999999999},"min":{"1min":0.20899999999999999,"5min":0.154,"15min":0.154},"max":{"1min":6.0300000000000002,"5min":7.6459999999999999,"15min":22.082999999999998},"last":0.25},{"interface":"front","average":{"1min":1.506,"5min":1.286,"15min":1.514},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":9.782,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.32300000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:08:16 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1990000000000001,"15min":1.198},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":6.476,"5min":10.866,"15min":11.945},"last":4.7800000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.68300000000000005,"15min":0.71299999999999997},"min":{"1min":0.247,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":2.2410000000000001,"5min":7.6550000000000002,"15min":8.3170000000000002},"last":0.81999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359739187,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6697660,"kb_used_data":4761652,"kb_used_omap":864,"kb_used_meta":1935135,"kb_avail":87674180,"statfs":{"total":96636764160,"available":89778360320,"internally_reserved":0,"allocated":4875931648,"data_stored":8771178507,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":1981578810},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,2,2,1,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.86899999999999999,"15min":0.82499999999999996},"min":{"1min":0.23499999999999999,"5min":0.193,"15min":0.153},"max":{"1min":3.2389999999999999,"5min":7.1180000000000003,"15min":8.3379999999999992},"last":0.28999999999999998},{"interface":"front","average":{"1min":1.337,"5min":1.1870000000000001,"15min":0.99399999999999999},"min":{"1min":0.23400000000000001,"5min":0.19500000000000001,"15min":0.187},"max":{"1min":9.8190000000000008,"5min":10.791,"15min":11.304},"last":0.30499999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.219,"5min":0.214,"15min":0.191},"max":{"1min":3.9540000000000002,"5min":7.5990000000000002,"15min":10.106},"last":0.376},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.127,"15min":1.044},"min":{"1min":0.221,"5min":0.214,"15min":0.187},"max":{"1min":4.0650000000000004,"5min":10.228999999999999,"15min":16.913},"last":0.35399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4875444224,"data_stored":8770939493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7914962944,"data_stored":14201208755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3038420992,"data_stored":5429171534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:08:28.897 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:28.897 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:28.897 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:28.898 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:28.898 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:28.898 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:28.899 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:28.899 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:28.899 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:28.900 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:08:29.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:29.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:29.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:29.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:29.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:29.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:29.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:29.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:29.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:29.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:29.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:29.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:29.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:29.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:29.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:29.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:29.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:29.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:29.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:29.790+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:29.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:29.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:29.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:29.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:30.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:30.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:30.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:30.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:30.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:30.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:30.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:30.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:30.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:30.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:30.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:30.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.106+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:30.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:30.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:30.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:33.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:33.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:33.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:33.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:33.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:33.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:33.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:33.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:33.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:33.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:33.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:33.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:33.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:33.706+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:33.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:33.706+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:33.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:33.706+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:33.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:33.710+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:33.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:33.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:33.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:33.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:35.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:35.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:35.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:35.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:35.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:35.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:35.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:35.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:35.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.142+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:35.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:35.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:35.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:08:35.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:35.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:35.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:35.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:35.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:35.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:35.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:36.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:36.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:36.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:36.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:36.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:36.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:36.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:36.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:36.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:36.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:36.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:36.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:36.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:36.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:36.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:36.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:36.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:36.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:37.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:37.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:37.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:37.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:37.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:37.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:37.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:37.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:37.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:37.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:37.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:37.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:37.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:37.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:37.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:37.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:37.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:37.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:37.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:37.410+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:37.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:37.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:37.514 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:37.510+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:38.099 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:38.094+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:40.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:40.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:40.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:40.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:40.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:40.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:40.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:40.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:40.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:40.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.710+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:40.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:40.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:40.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:08:40.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:40.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:40.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:40.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:40.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:40.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:40.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:40.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:40.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.982+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:40.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:40.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:41.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:41.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:41.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:08:41.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:41.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:41.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:41.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:41.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:41.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:41.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:41.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.122+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:41.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.134+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:41.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.142+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:41.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:41.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:41.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:08:41.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:41.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:41.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:41.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:41.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:41.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:41.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:41.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:41.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:42.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:42.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:42.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:42.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:42.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:42.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:42.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:42.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:42.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.386+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:42.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:42.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:42.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:08:42.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:42.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:42.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:42.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:42.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:42.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:42.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:42.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:42.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:42.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:42.414+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:43.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:43.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:43.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:43.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:43.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:43.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:43.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:43.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:43.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:43.482+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:43.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:43.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:43.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:43.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:43.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:43.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:44.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:44.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:44.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:44.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:44.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:44.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:44.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:44.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:44.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:44.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:44.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.398+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:44.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:44.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:44.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:44.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:44.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:44.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:44.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:44.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:44.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:44.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:44.654+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:46.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:46.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:46.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:46.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:46.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:46.746+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:46.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:46.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:46.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:46.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:46.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:46.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:46.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:46.762+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:46.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:46.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:46.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:46.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:47.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:47.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:47.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:47.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:47.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:47.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:47.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:47.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:47.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:47.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:47.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:47.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:47.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:47.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:47.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:47.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:48.900 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:08:49.047 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:49.042+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:49.555 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:08:49.556 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:08:49.625 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2208,"stamp":"2023-10-14T01:08:49.344061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28199789011,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1986677,"num_read_kb":7687276,"num_write":1941399,"num_write_kb":7764131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80453,"ondisk_log_size":80453,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20860660,"kb_used_data":15527572,"kb_used_omap":2751,"kb_used_meta":5330304,"kb_avail":262254860,"statfs":{"total":289910292480,"available":268548976640,"internally_reserved":0,"allocated":15900233728,"data_stored":28471423498,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2817113,"internal_metadata":5458232231},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,3,5,5,13,6,14,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18313216,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4608,"num_read_kb":18348,"num_write":4718,"num_write_kb":18872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003889"},"pg_stats":[{"pgid":"2.7","version":"148'248941","reported_seq":488116,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:08:47.131396+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:08:47.131396+0000","last_peered":"2023-10-14T01:08:47.131396+0000","last_clean":"2023-10-14T01:08:47.131396+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:08:47.131396+0000","last_undegraded":"2023-10-14T01:08:47.131396+0000","last_fullsized":"2023-10-14T01:08:47.131396+0000","mapping_epoch":13,"log_start":"143'238917","ondisk_log_start":"143'238917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3430343192,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":241827,"num_read_kb":935080,"num_write":235535,"num_write_kb":941793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'262061","reported_seq":516576,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:08:47.128415+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:08:47.128415+0000","last_peered":"2023-10-14T01:08:47.128415+0000","last_clean":"2023-10-14T01:08:47.128415+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:08:47.128415+0000","last_undegraded":"2023-10-14T01:08:47.128415+0000","last_fullsized":"2023-10-14T01:08:47.128415+0000","mapping_epoch":13,"log_start":"143'252016","ondisk_log_start":"143'252016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3627737306,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":258665,"num_read_kb":991388,"num_write":248656,"num_write_kb":994153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'243884","reported_seq":480202,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:08:47.097021+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:08:47.097021+0000","last_peered":"2023-10-14T01:08:47.097021+0000","last_clean":"2023-10-14T01:08:47.097021+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:08:47.097021+0000","last_undegraded":"2023-10-14T01:08:47.097021+0000","last_fullsized":"2023-10-14T01:08:47.097021+0000","mapping_epoch":13,"log_start":"143'233823","ondisk_log_start":"143'233823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3407225536,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":238698,"num_read_kb":926691,"num_write":234315,"num_write_kb":936950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"148'241685","reported_seq":479503,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:08:47.100110+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:08:47.100110+0000","last_peered":"2023-10-14T01:08:47.100110+0000","last_clean":"2023-10-14T01:08:47.100110+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:08:47.100110+0000","last_undegraded":"2023-10-14T01:08:47.100110+0000","last_fullsized":"2023-10-14T01:08:47.100110+0000","mapping_epoch":13,"log_start":"143'231617","ondisk_log_start":"143'231617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3424383658,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":239834,"num_read_kb":934484,"num_write":236050,"num_write_kb":943949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"148'245660","reported_seq":490701,"reported_epoch":148,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:08:47.434419+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:08:47.434419+0000","last_peered":"2023-10-14T01:08:47.434419+0000","last_clean":"2023-10-14T01:08:47.434419+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:08:47.434419+0000","last_undegraded":"2023-10-14T01:08:47.434419+0000","last_fullsized":"2023-10-14T01:08:47.434419+0000","mapping_epoch":13,"log_start":"143'235622","ondisk_log_start":"143'235622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":813,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 172s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3491086857,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":247757,"num_read_kb":953598,"num_write":240904,"num_write_kb":963137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"148'247434","reported_seq":490510,"reported_epoch":148,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:08:48.932592+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:08:48.932592+0000","last_peered":"2023-10-14T01:08:48.932592+0000","last_clean":"2023-10-14T01:08:48.932592+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:08:48.932592+0000","last_undegraded":"2023-10-14T01:08:48.932592+0000","last_fullsized":"2023-10-14T01:08:48.932592+0000","mapping_epoch":13,"log_start":"143'237411","ondisk_log_start":"143'237411","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":796,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 173s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3533939006,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":244954,"num_read_kb":957746,"num_write":243493,"num_write_kb":973811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"148'248651","reported_seq":494095,"reported_epoch":148,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:08:48.890783+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:08:48.890783+0000","last_peered":"2023-10-14T01:08:48.890783+0000","last_clean":"2023-10-14T01:08:48.890783+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:08:48.890783+0000","last_undegraded":"2023-10-14T01:08:48.890783+0000","last_fullsized":"2023-10-14T01:08:48.890783+0000","mapping_epoch":13,"log_start":"143'238616","ondisk_log_start":"143'238616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":918,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 174s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3563942439,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":247110,"num_read_kb":967564,"num_write":244603,"num_write_kb":978275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"148'282378","reported_seq":546377,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:08:47.118879+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:08:47.118879+0000","last_peered":"2023-10-14T01:08:47.118879+0000","last_clean":"2023-10-14T01:08:47.118879+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:08:47.118879+0000","last_undegraded":"2023-10-14T01:08:47.118879+0000","last_fullsized":"2023-10-14T01:08:47.118879+0000","mapping_epoch":13,"log_start":"143'272316","ondisk_log_start":"143'272316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3720540649,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":267726,"num_read_kb":1020634,"num_write":257706,"num_write_kb":1030169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":309,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-14T01:08:19.858213+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:08:19.858213+0000","last_peered":"2023-10-14T01:08:19.858213+0000","last_clean":"2023-10-14T01:08:19.858213+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:08:19.858213+0000","last_undegraded":"2023-10-14T01:08:19.858213+0000","last_fullsized":"2023-10-14T01:08:19.858213+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28199198643,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1986571,"num_read_kb":7687185,"num_write":1941262,"num_write_kb":7762237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15896788992,"data_stored":28469280614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80356,"ondisk_log_size":80356,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739191,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4966040,"kb_used_data":2983436,"kb_used_omap":494,"kb_used_meta":1982097,"kb_avail":89405800,"statfs":{"total":96636764160,"available":91551539200,"internally_reserved":0,"allocated":3055038464,"data_stored":5444999706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":2029668099},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,4,1,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.133,"15min":0.94599999999999995},"min":{"1min":0.192,"5min":0.192,"15min":0.17899999999999999},"max":{"1min":6.4359999999999999,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":3.5590000000000002},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1950000000000001,"15min":0.999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23300000000000001},"max":{"1min":6.4720000000000004,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":3.5939999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.68400000000000005,"15min":0.79700000000000004},"min":{"1min":0.20699999999999999,"5min":0.19800000000000001,"15min":0.183},"max":{"1min":0.53200000000000003,"5min":5.9649999999999999,"15min":11.999000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1779999999999999,"15min":1.04},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.222},"max":{"1min":6.2960000000000003,"5min":7.8470000000000004,"15min":16.649000000000001},"last":0.26700000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739179,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9078356,"kb_used_data":7762636,"kb_used_omap":1392,"kb_used_meta":1314319,"kb_avail":85293484,"statfs":{"total":96636764160,"available":87340527616,"internally_reserved":0,"allocated":7948939264,"data_stored":14234928799,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1425814,"internal_metadata":1345863274},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,2,1,3,6,5,4,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89300000000000002,"15min":1.1639999999999999},"min":{"1min":0.20899999999999999,"5min":0.154,"15min":0.154},"max":{"1min":6.0300000000000002,"5min":7.6459999999999999,"15min":22.082999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":1.506,"5min":1.286,"15min":1.514},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":9.782,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Sat Oct 14 01:08:16 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1990000000000001,"15min":1.198},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":6.476,"5min":10.866,"15min":11.945},"last":1.147},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.68300000000000005,"15min":0.71299999999999997},"min":{"1min":0.247,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":2.2410000000000001,"5min":7.6550000000000002,"15min":8.3170000000000002},"last":0.52100000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739191,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6816264,"kb_used_data":4781500,"kb_used_omap":864,"kb_used_meta":2033887,"kb_avail":87555576,"statfs":{"total":96636764160,"available":89656909824,"internally_reserved":0,"allocated":4896256000,"data_stored":8791494993,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":2082700858},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,0,3,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.86899999999999999,"15min":0.82499999999999996},"min":{"1min":0.23499999999999999,"5min":0.193,"15min":0.153},"max":{"1min":3.2389999999999999,"5min":7.1180000000000003,"15min":8.3379999999999992},"last":0.26700000000000002},{"interface":"front","average":{"1min":1.337,"5min":1.1870000000000001,"15min":0.99399999999999999},"min":{"1min":0.23400000000000001,"5min":0.19500000000000001,"15min":0.187},"max":{"1min":9.8190000000000008,"5min":10.791,"15min":11.304},"last":0.28299999999999997}]},{"osd":2,"last update":"Sat Oct 14 01:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.219,"5min":0.214,"15min":0.191},"max":{"1min":3.9540000000000002,"5min":7.5990000000000002,"15min":10.106},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.127,"15min":1.044},"min":{"1min":0.221,"5min":0.214,"15min":0.187},"max":{"1min":4.0650000000000004,"5min":10.228999999999999,"15min":16.913},"last":0.32300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4894867456,"data_stored":8790362725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7947689984,"data_stored":14233935795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3054231552,"data_stored":5444982094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:08:49.627 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:49.627 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:49.628 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:49.628 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:49.628 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:49.629 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:49.629 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:49.629 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:49.630 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:08:49.630 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:08:49.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:49.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:49.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:49.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:49.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:49.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:49.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:49.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:49.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:49.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:49.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.958+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:49.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:49.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:49.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:50.682 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:50.678+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:51.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:51.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:51.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:51.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:51.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:51.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:51.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:51.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:51.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:51.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:51.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.226+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:51.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:51.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:51.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:51.785 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:51.782+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:52.393 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:52.390+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:53.002 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:52.994+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:53.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:53.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:53.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:53.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:53.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:53.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:53.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:53.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:53.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:53.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:53.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:53.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:53.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:53.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:53.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:53.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:53.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:53.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:53.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:53.138+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:53.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:53.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:53.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:53.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:54.075 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:54.074+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:54.312 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:54.306+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:54.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:54.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:54.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:54.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:54.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:54.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:54.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:54.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:54.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:54.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:54.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.506+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:54.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:54.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:54.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:55.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:55.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:08:55.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:55.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:55.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:55.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:55.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:55.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:55.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:55.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:55.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:55.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:55.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:55.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:55.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:55.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:55.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:55.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:55.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:55.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:55.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:55.430+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:55.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:55.430+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:56.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:56.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:08:56.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:56.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:56.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:56.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:56.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:56.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:56.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:56.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:56.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:56.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:56.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:56.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:56.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:56.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:56.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:56.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:56.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:56.146+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:56.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:56.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:56.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:56.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:57.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:57.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:58.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:58.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:58.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:58.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:58.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.426+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:58.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.446+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:58.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:58.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:08:58.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:58.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:58.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:58.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:58.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:58.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:58.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:58.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:58.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.790+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:08:58.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:08:58.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:58.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:08:59.061 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:59.054+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:59.306 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:08:59.302+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:08:59.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:59.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:08:59.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:59.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:08:59.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:59.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:08:59.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:59.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:08:59.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:59.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:08:59.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:59.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:08:59.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:59.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:08:59.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:59.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:08:59.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:08:59.582+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:00.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:00.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:00.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:00.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:00.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:00.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:00.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:00.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:00.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:00.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:00.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:00.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:00.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:00.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:01.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:01.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:09:01.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:01.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:01.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:01.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:01.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:01.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:01.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:01.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:01.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:01.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:01.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:01.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:01.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:01.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:01.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:01.986+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:01.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:01.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:01.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:01.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:07.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:07.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:09:07.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:07.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:07.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:07.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:07.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:07.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:07.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:07.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:07.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:07.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:07.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:07.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:07.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:07.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:07.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:07.410+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:07.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:07.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:07.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:07.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:08.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:08.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:08.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:08.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:08.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:08.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:08.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:08.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:08.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:08.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:08.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:08.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:08.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:08.846+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:08.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:08.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:08.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:08.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:09.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:09.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:09.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:09.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:09.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:09.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.082+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:09.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.086+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:09.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:09.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:09.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:09:09.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:09:09.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:09:09.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:09.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:09.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:09.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:09.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:09.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:09.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:09.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.342+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:09.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.342+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:09.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.342+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:09.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:09.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:09.631 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:09:09.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:09:09.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:09:09.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:09.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:09.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:09.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:09.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:09.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:09.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:09.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.858+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:09.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:09.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.870+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:09.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:09.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:09.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:10.407 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:09:10.408 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:09:10.456 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2218,"stamp":"2023-10-14T01:09:09.347418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28230496723,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":1994506,"num_read_kb":7718448,"num_write":1949298,"num_write_kb":7795727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80508,"ondisk_log_size":80508,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20484664,"kb_used_data":15589596,"kb_used_omap":2751,"kb_used_meta":4892288,"kb_avail":262630856,"statfs":{"total":289910292480,"available":268933996544,"internally_reserved":0,"allocated":15963746304,"data_stored":28534936074,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2817113,"internal_metadata":5009703847},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,2,3,8,6,12,8,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23076864,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5813,"num_read_kb":23140,"num_write":5933,"num_write_kb":23732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002006"},"pg_stats":[{"pgid":"2.7","version":"148'249927","reported_seq":490035,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:09:07.590258+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:09:07.590258+0000","last_peered":"2023-10-14T01:09:07.590258+0000","last_clean":"2023-10-14T01:09:07.590258+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:09:07.590258+0000","last_undegraded":"2023-10-14T01:09:07.590258+0000","last_fullsized":"2023-10-14T01:09:07.590258+0000","mapping_epoch":13,"log_start":"143'239917","ondisk_log_start":"143'239917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3434058264,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":242748,"num_read_kb":938756,"num_write":236479,"num_write_kb":945569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'263169","reported_seq":518681,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:09:07.593124+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:09:07.593124+0000","last_peered":"2023-10-14T01:09:07.593124+0000","last_clean":"2023-10-14T01:09:07.593124+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:09:07.593124+0000","last_undegraded":"2023-10-14T01:09:07.593124+0000","last_fullsized":"2023-10-14T01:09:07.593124+0000","mapping_epoch":13,"log_start":"144'253116","ondisk_log_start":"144'253116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3631919322,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":259654,"num_read_kb":995328,"num_write":249722,"num_write_kb":998417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'244867","reported_seq":482137,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:09:07.619206+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:09:07.619206+0000","last_peered":"2023-10-14T01:09:07.619206+0000","last_clean":"2023-10-14T01:09:07.619206+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:09:07.619206+0000","last_undegraded":"2023-10-14T01:09:07.619206+0000","last_fullsized":"2023-10-14T01:09:07.619206+0000","mapping_epoch":13,"log_start":"143'234823","ondisk_log_start":"143'234823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3410916032,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":239643,"num_read_kb":930447,"num_write":235270,"num_write_kb":940770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"148'242690","reported_seq":481478,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:09:07.590069+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:09:07.590069+0000","last_peered":"2023-10-14T01:09:07.590069+0000","last_clean":"2023-10-14T01:09:07.590069+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:09:07.590069+0000","last_undegraded":"2023-10-14T01:09:07.590069+0000","last_fullsized":"2023-10-14T01:09:07.590069+0000","mapping_epoch":13,"log_start":"143'232617","ondisk_log_start":"143'232617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3428217514,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":240801,"num_read_kb":938340,"num_write":237041,"num_write_kb":947913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"148'246709","reported_seq":492734,"reported_epoch":148,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:09:07.592499+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:09:07.592499+0000","last_peered":"2023-10-14T01:09:07.592499+0000","last_clean":"2023-10-14T01:09:07.592499+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:09:07.592499+0000","last_undegraded":"2023-10-14T01:09:07.592499+0000","last_fullsized":"2023-10-14T01:09:07.592499+0000","mapping_epoch":13,"log_start":"143'236622","ondisk_log_start":"143'236622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":896,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 193s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3494892041,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":248722,"num_read_kb":957438,"num_write":241881,"num_write_kb":967045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"148'248483","reported_seq":492548,"reported_epoch":148,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:09:09.097413+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:09:09.097413+0000","last_peered":"2023-10-14T01:09:09.097413+0000","last_clean":"2023-10-14T01:09:09.097413+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:09:09.097413+0000","last_undegraded":"2023-10-14T01:09:09.097413+0000","last_fullsized":"2023-10-14T01:09:09.097413+0000","mapping_epoch":13,"log_start":"144'238411","ondisk_log_start":"144'238411","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":875,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 193s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3537715518,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":245931,"num_read_kb":961634,"num_write":244471,"num_write_kb":977723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"148'249735","reported_seq":496176,"reported_epoch":148,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:09:09.140393+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:09:09.140393+0000","last_peered":"2023-10-14T01:09:09.140393+0000","last_clean":"2023-10-14T01:09:09.140393+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:09:09.140393+0000","last_undegraded":"2023-10-14T01:09:09.140393+0000","last_fullsized":"2023-10-14T01:09:09.140393+0000","mapping_epoch":13,"log_start":"144'239716","ondisk_log_start":"144'239716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1039,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 194s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3567796775,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":248096,"num_read_kb":971484,"num_write":245584,"num_write_kb":982199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"148'283469","reported_seq":548566,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:09:07.526849+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:09:07.526849+0000","last_peered":"2023-10-14T01:09:07.526849+0000","last_clean":"2023-10-14T01:09:07.526849+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:09:07.526849+0000","last_undegraded":"2023-10-14T01:09:07.526849+0000","last_fullsized":"2023-10-14T01:09:07.526849+0000","mapping_epoch":13,"log_start":"144'273416","ondisk_log_start":"144'273416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3724390889,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":268805,"num_read_kb":1024930,"num_write":258713,"num_write_kb":1034197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":309,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-14T01:08:19.858213+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:08:19.858213+0000","last_peered":"2023-10-14T01:08:19.858213+0000","last_clean":"2023-10-14T01:08:19.858213+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:08:19.858213+0000","last_undegraded":"2023-10-14T01:08:19.858213+0000","last_fullsized":"2023-10-14T01:08:19.858213+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28229906355,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":1994400,"num_read_kb":7718357,"num_write":1949161,"num_write_kb":7793833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":15961473024,"data_stored":28533964646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80411,"ondisk_log_size":80411,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739195,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4328724,"kb_used_data":2995404,"kb_used_omap":494,"kb_used_meta":1332817,"kb_avail":90043116,"statfs":{"total":96636764160,"available":92204150784,"internally_reserved":0,"allocated":3067293696,"data_stored":5457254938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1364805379},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,2,1,6,3,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.133,"15min":0.94599999999999995},"min":{"1min":0.192,"5min":0.192,"15min":0.17899999999999999},"max":{"1min":6.4359999999999999,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1950000000000001,"15min":0.999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23300000000000001},"max":{"1min":6.4720000000000004,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Oct 14 01:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.68400000000000005,"15min":0.79700000000000004},"min":{"1min":0.20699999999999999,"5min":0.19800000000000001,"15min":0.183},"max":{"1min":0.53200000000000003,"5min":5.9649999999999999,"15min":11.999000000000001},"last":0.22600000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1779999999999999,"15min":1.04},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.222},"max":{"1min":6.2960000000000003,"5min":7.8470000000000004,"15min":16.649000000000001},"last":0.374}]}]},{"osd":1,"up_from":8,"seq":34359739183,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9226660,"kb_used_data":7794072,"kb_used_omap":1392,"kb_used_meta":1431183,"kb_avail":85145180,"statfs":{"total":96636764160,"available":87188664320,"internally_reserved":0,"allocated":7981129728,"data_stored":14267119263,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1425814,"internal_metadata":1465532010},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,1,5,3,6,5,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:08:16 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.89300000000000002,"15min":1.1639999999999999},"min":{"1min":0.20899999999999999,"5min":0.154,"15min":0.154},"max":{"1min":6.0300000000000002,"5min":7.6459999999999999,"15min":22.082999999999998},"last":0.375},{"interface":"front","average":{"1min":1.506,"5min":1.286,"15min":1.514},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":9.782,"5min":11.252000000000001,"15min":39.978999999999999},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:08:16 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1990000000000001,"15min":1.198},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":6.476,"5min":10.866,"15min":11.945},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.68300000000000005,"15min":0.71299999999999997},"min":{"1min":0.247,"5min":0.222,"15min":0.20300000000000001},"max":{"1min":2.2410000000000001,"5min":7.6550000000000002,"15min":8.3170000000000002},"last":0.52000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739195,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6929280,"kb_used_data":4800120,"kb_used_omap":864,"kb_used_meta":2128287,"kb_avail":87442560,"statfs":{"total":96636764160,"available":89541181440,"internally_reserved":0,"allocated":4915322880,"data_stored":8810561873,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":885190,"internal_metadata":2179366458},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.86899999999999999,"15min":0.82499999999999996},"min":{"1min":0.23499999999999999,"5min":0.193,"15min":0.153},"max":{"1min":3.2389999999999999,"5min":7.1180000000000003,"15min":8.3379999999999992},"last":0.28499999999999998},{"interface":"front","average":{"1min":1.337,"5min":1.1870000000000001,"15min":0.99399999999999999},"min":{"1min":0.23400000000000001,"5min":0.19500000000000001,"15min":0.187},"max":{"1min":9.8190000000000008,"5min":10.791,"15min":11.304},"last":0.27400000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:08:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.77000000000000002,"15min":0.77400000000000002},"min":{"1min":0.219,"5min":0.214,"15min":0.191},"max":{"1min":3.9540000000000002,"5min":7.5990000000000002,"15min":10.106},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":1.127,"15min":1.044},"min":{"1min":0.221,"5min":0.214,"15min":0.187},"max":{"1min":4.0650000000000004,"5min":10.228999999999999,"15min":16.913},"last":0.23999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4914864128,"data_stored":8810359397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7980249088,"data_stored":14266494899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3066359808,"data_stored":5457110350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:09:10.458 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:10.458 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:10.459 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:10.459 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:10.459 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:10.460 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:10.460 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:10.460 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:10.461 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:10.461 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:09:11.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:11.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:09:11.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:11.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:11.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:11.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:11.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:11.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:11.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:11.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:11.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:11.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:11.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:11.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:11.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:11.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:11.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:11.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:11.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:11.582+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:11.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:11.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:11.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:11.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:14.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:14.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:14.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:14.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:14.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:14.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:14.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:14.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:14.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:14.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:14.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:14.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:14.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:14.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:14.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:14.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:14.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:14.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:14.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:14.166+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:14.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:14.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:14.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:14.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:15.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:15.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:15.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:15.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:15.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:15.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:15.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:15.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:15.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:15.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:15.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:15.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:15.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:15.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:15.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:15.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:15.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:15.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:15.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:15.378+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:15.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:15.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:15.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:15.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:16.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:09:16.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:09:16.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:16.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:16.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:16.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:16.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:16.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:16.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:16.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:16.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:16.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:16.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:16.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:16.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:16.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:16.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:16.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:16.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.770+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:16.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.794+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:16.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:16.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:17.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:17.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:17.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:17.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:19.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:09:19.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:19.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:19.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:19.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:19.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:19.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:19.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:19.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:19.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:19.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.737+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:19.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:19.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:19.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:20.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:20.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:20.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:20.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:20.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:20.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:20.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:20.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:20.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.293+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:20.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.313+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:20.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:20.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:20.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:09:20.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:09:20.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:20.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:20.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:20.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:20.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:20.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:20.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:20.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:20.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:20.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.457+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:20.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:20.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:20.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:22.461 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:09:22.457+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:09:23.261 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:09:23.257+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:09:23.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:23.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:09:23.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:23.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:23.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:23.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:23.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:23.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:23.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:23.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:23.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:23.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:23.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:23.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:23.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:23.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:23.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:23.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:23.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:23.709+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:23.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:23.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:23.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:23.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:23.870 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:09:23.865+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:09:25.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:25.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:25.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:25.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:25.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:25.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:25.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:25.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:25.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:25.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:25.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:25.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:25.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:25.897+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:25.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:25.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:25.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:25.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:25.984 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:09:25.981+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:09:30.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:30.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:30.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:30.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:30.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.229+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:30.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.249+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:30.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:30.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:30.462 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:09:30.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:30.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:30.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:30.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:30.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:30.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:30.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:30.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.857+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:30.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:30.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:30.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:30.964 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:09:30.961+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:09:31.298 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:09:31.299 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:09:31.360 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2228,"stamp":"2023-10-14T01:09:29.350768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28259627475,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2001740,"num_read_kb":7747272,"num_write":1956813,"num_write_kb":7825787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80457,"ondisk_log_size":80457,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":19794672,"kb_used_data":15649556,"kb_used_omap":2752,"kb_used_meta":4142335,"kb_avail":263320848,"statfs":{"total":289910292480,"available":269640548352,"internally_reserved":0,"allocated":16025145344,"data_stored":28596335114,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2818793,"internal_metadata":4241751319},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,3,3,5,11,14,13,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21372928,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5313,"num_read_kb":21168,"num_write":5520,"num_write_kb":22080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001992"},"pg_stats":[{"pgid":"2.7","version":"148'250952","reported_seq":492023,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:09:28.127991+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:09:28.127991+0000","last_peered":"2023-10-14T01:09:28.127991+0000","last_clean":"2023-10-14T01:09:28.127991+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:09:28.127991+0000","last_undegraded":"2023-10-14T01:09:28.127991+0000","last_fullsized":"2023-10-14T01:09:28.127991+0000","mapping_epoch":13,"log_start":"144'240917","ondisk_log_start":"144'240917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3437912600,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":243699,"num_read_kb":942544,"num_write":237456,"num_write_kb":949477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"148'264219","reported_seq":520761,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:09:28.135788+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:09:28.135788+0000","last_peered":"2023-10-14T01:09:28.135788+0000","last_clean":"2023-10-14T01:09:28.135788+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:09:28.135788+0000","last_undegraded":"2023-10-14T01:09:28.135788+0000","last_fullsized":"2023-10-14T01:09:28.135788+0000","mapping_epoch":13,"log_start":"145'254216","ondisk_log_start":"145'254216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3635843290,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":260668,"num_read_kb":999356,"num_write":250725,"num_write_kb":1002429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"148'245883","reported_seq":484108,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:09:28.133561+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:09:28.133561+0000","last_peered":"2023-10-14T01:09:28.133561+0000","last_clean":"2023-10-14T01:09:28.133561+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:09:28.133561+0000","last_undegraded":"2023-10-14T01:09:28.133561+0000","last_fullsized":"2023-10-14T01:09:28.133561+0000","mapping_epoch":13,"log_start":"144'235823","ondisk_log_start":"144'235823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3414676160,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":240590,"num_read_kb":934227,"num_write":236254,"num_write_kb":944706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"148'243684","reported_seq":483423,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:09:28.129462+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:09:28.129462+0000","last_peered":"2023-10-14T01:09:28.129462+0000","last_clean":"2023-10-14T01:09:28.129462+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:09:28.129462+0000","last_undegraded":"2023-10-14T01:09:28.129462+0000","last_fullsized":"2023-10-14T01:09:28.129462+0000","mapping_epoch":13,"log_start":"144'233617","ondisk_log_start":"144'233617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3431985834,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":241746,"num_read_kb":942112,"num_write":238019,"num_write_kb":951825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"148'247753","reported_seq":494682,"reported_epoch":148,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:09:27.680758+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:09:27.680758+0000","last_peered":"2023-10-14T01:09:27.680758+0000","last_clean":"2023-10-14T01:09:27.680758+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:09:27.680758+0000","last_undegraded":"2023-10-14T01:09:27.680758+0000","last_fullsized":"2023-10-14T01:09:27.680758+0000","mapping_epoch":13,"log_start":"145'237722","ondisk_log_start":"145'237722","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":965,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 213s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3498705417,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":249607,"num_read_kb":960958,"num_write":242864,"num_write_kb":970977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"148'249309","reported_seq":494160,"reported_epoch":148,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:09:24.476319+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:09:24.476319+0000","last_peered":"2023-10-14T01:09:24.476319+0000","last_clean":"2023-10-14T01:09:24.476319+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:09:24.476319+0000","last_undegraded":"2023-10-14T01:09:24.476319+0000","last_fullsized":"2023-10-14T01:09:24.476319+0000","mapping_epoch":13,"log_start":"145'239211","ondisk_log_start":"145'239211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":938,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 209s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3540697406,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":246708,"num_read_kb":964730,"num_write":245241,"num_write_kb":980803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"148'250556","reported_seq":497708,"reported_epoch":148,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:09:24.492320+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:09:24.492320+0000","last_peered":"2023-10-14T01:09:24.492320+0000","last_clean":"2023-10-14T01:09:24.492320+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:09:24.492320+0000","last_undegraded":"2023-10-14T01:09:24.492320+0000","last_fullsized":"2023-10-14T01:09:24.492320+0000","mapping_epoch":13,"log_start":"145'240516","ondisk_log_start":"145'240516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1128,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 209s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3570721319,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":248797,"num_read_kb":974276,"num_write":246327,"num_write_kb":985171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"148'284642","reported_seq":550777,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:09:28.105391+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:09:28.105391+0000","last_peered":"2023-10-14T01:09:28.105391+0000","last_clean":"2023-10-14T01:09:28.105391+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:09:28.105391+0000","last_undegraded":"2023-10-14T01:09:28.105391+0000","last_fullsized":"2023-10-14T01:09:28.105391+0000","mapping_epoch":13,"log_start":"145'274616","ondisk_log_start":"145'274616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3728495081,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":269819,"num_read_kb":1028978,"num_write":259790,"num_write_kb":1038505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":309,"reported_epoch":147,"state":"active+clean","last_fresh":"2023-10-14T01:08:19.858213+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:08:19.858213+0000","last_peered":"2023-10-14T01:08:19.858213+0000","last_clean":"2023-10-14T01:08:19.858213+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:08:19.858213+0000","last_undegraded":"2023-10-14T01:08:19.858213+0000","last_fullsized":"2023-10-14T01:08:19.858213+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28259037107,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2001634,"num_read_kb":7747181,"num_write":1956676,"num_write_kb":7823893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16023695360,"data_stored":28596186982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80360,"ondisk_log_size":80360,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739199,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4371848,"kb_used_data":3004604,"kb_used_omap":494,"kb_used_meta":1366737,"kb_avail":89999992,"statfs":{"total":96636764160,"available":92159991808,"internally_reserved":0,"allocated":3076714496,"data_stored":5466675738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1399539459},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,0,6,6,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:08:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.133,"15min":0.94599999999999995},"min":{"1min":0.192,"5min":0.192,"15min":0.17899999999999999},"max":{"1min":6.4359999999999999,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1950000000000001,"15min":0.999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.23300000000000001},"max":{"1min":6.4720000000000004,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":0.33800000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:08:28 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.68400000000000005,"15min":0.79700000000000004},"min":{"1min":0.20699999999999999,"5min":0.19800000000000001,"15min":0.183},"max":{"1min":0.53200000000000003,"5min":5.9649999999999999,"15min":11.999000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.1779999999999999,"15min":1.04},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.222},"max":{"1min":6.2960000000000003,"5min":7.8470000000000004,"15min":16.649000000000001},"last":0.374}]}]},{"osd":1,"up_from":8,"seq":34359739187,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9357764,"kb_used_data":7825212,"kb_used_omap":1392,"kb_used_meta":1531151,"kb_avail":85014076,"statfs":{"total":96636764160,"available":87054413824,"internally_reserved":0,"allocated":8013017088,"data_stored":14299006623,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1425814,"internal_metadata":1567899242},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,3,1,5,5,7,10,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:09:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":0.90200000000000002,"15min":1.196},"min":{"1min":0.19600000000000001,"5min":0.154,"15min":0.154},"max":{"1min":12.933,"5min":12.933,"15min":22.082999999999998},"last":3.2250000000000001},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.431,"15min":1.5600000000000001},"min":{"1min":0.27500000000000002,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":14.656000000000001,"5min":14.656000000000001,"15min":39.978999999999999},"last":0.24299999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:09:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1240000000000001,"15min":1.161},"min":{"1min":0.28199999999999997,"5min":0.183,"15min":0.183},"max":{"1min":4.7800000000000002,"5min":7.9279999999999999,"15min":11.945},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48999999999999999,"15min":0.70999999999999996},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":1.367,"5min":4.1040000000000001,"15min":8.3170000000000002},"last":3.266}]}]},{"osd":0,"up_from":8,"seq":34359739199,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6065060,"kb_used_data":4819740,"kb_used_omap":866,"kb_used_meta":1244445,"kb_avail":88306780,"statfs":{"total":96636764160,"available":90426142720,"internally_reserved":0,"allocated":4935413760,"data_stored":8830652753,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":886870,"internal_metadata":1274312618},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:09:19 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":0.96399999999999997,"15min":0.86699999999999999},"min":{"1min":0.26700000000000002,"5min":0.193,"15min":0.153},"max":{"1min":5.9390000000000001,"5min":7.1180000000000003,"15min":8.3379999999999992},"last":25.927},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.248,"15min":1.036},"min":{"1min":0.246,"5min":0.19500000000000001,"15min":0.187},"max":{"1min":5.984,"5min":10.791,"15min":11.304},"last":26.632999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:09:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68999999999999995,"15min":0.77700000000000002},"min":{"1min":0.23499999999999999,"5min":0.214,"15min":0.191},"max":{"1min":4.734,"5min":6.7519999999999998,"15min":10.106},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.94999999999999996,"15min":1.0760000000000001},"min":{"1min":0.23999999999999999,"5min":0.214,"15min":0.187},"max":{"1min":4.4900000000000002,"5min":8.7379999999999995,"15min":16.913},"last":0.375}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4934733824,"data_stored":8830229093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8013168640,"data_stored":14299414451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3075792896,"data_stored":5466543438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:09:31.362 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:31.362 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:31.362 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:31.363 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:31.363 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:31.364 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:31.364 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:31.364 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:31.365 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:31.365 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:09:34.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:09:34.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:34.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:34.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:34.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:34.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:34.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:34.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:34.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:34.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.661+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:34.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:34.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:34.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:34.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:34.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:34.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:34.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.753+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:34.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:34.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:34.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:36.016 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:09:36.013+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:09:36.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:36.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:36.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:36.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:36.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:36.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:36.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:36.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:36.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:36.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:36.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:36.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:36.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:36.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:36.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:36.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:36.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:36.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:36.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:36.725+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:36.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:36.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:36.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:36.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:37.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:37.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:37.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:37.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:37.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:37.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:37.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:37.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:37.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:37.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:37.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:37.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:37.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:37.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:37.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:37.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:37.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:37.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:37.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:37.149+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:37.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:37.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:37.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:37.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:41.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:41.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:41.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:41.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:41.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:41.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:41.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:41.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:41.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:41.633+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:41.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:41.653+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:43.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:43.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:43.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:43.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:43.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:43.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:43.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:43.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.069+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:43.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:43.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:43.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:09:43.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:09:43.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:43.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:43.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:43.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:43.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:43.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:43.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:43.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:43.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:43.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.305+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:43.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:43.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:43.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:09:43.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:09:43.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:43.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:43.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:43.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:43.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:43.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:43.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:43.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:45.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:45.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:45.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:45.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:45.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:45.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:45.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:45.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:45.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:45.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:45.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:45.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:45.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:45.469+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:45.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:45.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:45.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:45.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:48.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:09:48.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:48.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:48.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:48.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:48.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:48.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:48.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:48.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:48.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:48.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.529+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:48.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:48.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:48.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:50.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:09:50.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:09:50.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:50.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:50.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:50.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:50.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:50.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:50.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:50.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:50.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:50.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.201+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:50.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:50.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.201+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:50.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:09:50.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:09:50.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:09:50.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:50.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:50.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:50.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:50.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:50.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:50.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:50.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:50.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:50.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.341+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:50.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:50.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:50.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:50.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:50.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:50.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:50.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:50.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:50.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:50.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:50.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:50.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.957+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:50.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:50.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:50.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:51.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:09:51.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:51.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:51.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:51.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:51.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:51.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:51.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:51.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:51.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.293+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:51.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.297+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:51.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:51.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:51.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:51.366 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:09:52.190 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:09:52.191 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:09:52.309 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2240,"stamp":"2023-10-14T01:09:51.360754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28292567507,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2009916,"num_read_kb":7779884,"num_write":1965294,"num_write_kb":7859711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80655,"ondisk_log_size":80655,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20081512,"kb_used_data":15717072,"kb_used_omap":2752,"kb_used_meta":4361663,"kb_avail":263034008,"statfs":{"total":289910292480,"available":269346824192,"internally_reserved":0,"allocated":16094281728,"data_stored":28665447771,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2818793,"internal_metadata":4466343191},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,4,13,13,8,20],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15388672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3804,"num_read_kb":15172,"num_write":3968,"num_write_kb":15872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002126"},"pg_stats":[{"pgid":"2.7","version":"149'251975","reported_seq":493988,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:09:48.769866+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:09:48.769866+0000","last_peered":"2023-10-14T01:09:48.769866+0000","last_clean":"2023-10-14T01:09:48.769866+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:09:48.769866+0000","last_undegraded":"2023-10-14T01:09:48.769866+0000","last_fullsized":"2023-10-14T01:09:48.769866+0000","mapping_epoch":13,"log_start":"145'241917","ondisk_log_start":"145'241917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3441799704,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":244625,"num_read_kb":946244,"num_write":238440,"num_write_kb":953413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"149'265299","reported_seq":522864,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:09:48.784094+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:09:48.784094+0000","last_peered":"2023-10-14T01:09:48.784094+0000","last_clean":"2023-10-14T01:09:48.784094+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:09:48.784094+0000","last_undegraded":"2023-10-14T01:09:48.784094+0000","last_fullsized":"2023-10-14T01:09:48.784094+0000","mapping_epoch":13,"log_start":"145'255216","ondisk_log_start":"145'255216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3639894234,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":261675,"num_read_kb":1003380,"num_write":251766,"num_write_kb":1006593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"149'246886","reported_seq":486061,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:09:48.760282+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:09:48.760282+0000","last_peered":"2023-10-14T01:09:48.760282+0000","last_clean":"2023-10-14T01:09:48.760282+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:09:48.760282+0000","last_undegraded":"2023-10-14T01:09:48.760282+0000","last_fullsized":"2023-10-14T01:09:48.760282+0000","mapping_epoch":13,"log_start":"145'236823","ondisk_log_start":"145'236823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3418464960,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":241533,"num_read_kb":937991,"num_write":237231,"num_write_kb":948614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"149'244670","reported_seq":485367,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:09:48.761124+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:09:48.761124+0000","last_peered":"2023-10-14T01:09:48.761124+0000","last_clean":"2023-10-14T01:09:48.761124+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:09:48.761124+0000","last_undegraded":"2023-10-14T01:09:48.761124+0000","last_fullsized":"2023-10-14T01:09:48.761124+0000","mapping_epoch":13,"log_start":"145'234617","ondisk_log_start":"145'234617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3435758250,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":242703,"num_read_kb":945932,"num_write":238992,"num_write_kb":955717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"149'248818","reported_seq":496662,"reported_epoch":149,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:09:47.781848+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:09:47.781848+0000","last_peered":"2023-10-14T01:09:47.781848+0000","last_clean":"2023-10-14T01:09:47.781848+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:09:47.781848+0000","last_undegraded":"2023-10-14T01:09:47.781848+0000","last_fullsized":"2023-10-14T01:09:47.781848+0000","mapping_epoch":13,"log_start":"145'238722","ondisk_log_start":"145'238722","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1088,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 233s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3502449161,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":250500,"num_read_kb":964502,"num_write":243823,"num_write_kb":974813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"149'250663","reported_seq":496772,"reported_epoch":149,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:09:49.862796+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:09:49.862796+0000","last_peered":"2023-10-14T01:09:49.862796+0000","last_clean":"2023-10-14T01:09:49.862796+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:09:49.862796+0000","last_undegraded":"2023-10-14T01:09:49.862796+0000","last_fullsized":"2023-10-14T01:09:49.862796+0000","mapping_epoch":13,"log_start":"145'240611","ondisk_log_start":"145'240611","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1054,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 234s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3545575742,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":247948,"num_read_kb":969682,"num_write":246501,"num_write_kb":985843,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"149'251896","reported_seq":500229,"reported_epoch":149,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:09:49.866721+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:09:49.866721+0000","last_peered":"2023-10-14T01:09:49.866721+0000","last_clean":"2023-10-14T01:09:49.866721+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:09:49.866721+0000","last_undegraded":"2023-10-14T01:09:49.866721+0000","last_fullsized":"2023-10-14T01:09:49.866721+0000","mapping_epoch":13,"log_start":"145'241816","ondisk_log_start":"145'241816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1290,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 235s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3575460391,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":249960,"num_read_kb":978908,"num_write":247539,"num_write_kb":990019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"149'285789","reported_seq":553003,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:09:48.763306+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:09:48.763306+0000","last_peered":"2023-10-14T01:09:48.763306+0000","last_clean":"2023-10-14T01:09:48.763306+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:09:48.763306+0000","last_undegraded":"2023-10-14T01:09:48.763306+0000","last_fullsized":"2023-10-14T01:09:48.763306+0000","mapping_epoch":13,"log_start":"145'275716","ondisk_log_start":"145'275716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3732574697,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":270866,"num_read_kb":1033154,"num_write":260865,"num_write_kb":1042805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":311,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-10-14T01:09:38.451803+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:09:38.451803+0000","last_peered":"2023-10-14T01:09:38.451803+0000","last_clean":"2023-10-14T01:09:38.451803+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:09:38.451803+0000","last_undegraded":"2023-10-14T01:09:38.451803+0000","last_fullsized":"2023-10-14T01:09:38.451803+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28291977139,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2009810,"num_read_kb":7779793,"num_write":1965157,"num_write_kb":7857817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16092016640,"data_stored":28664508262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80558,"ondisk_log_size":80558,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739204,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4423028,"kb_used_data":3019692,"kb_used_omap":494,"kb_used_meta":1402833,"kb_avail":89948812,"statfs":{"total":96636764160,"available":92107583488,"internally_reserved":0,"allocated":3092164608,"data_stored":5482117941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1436501763},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3,1,5,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:09:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.1659999999999999,"15min":0.98099999999999998},"min":{"1min":0.28399999999999997,"5min":0.192,"15min":0.17899999999999999},"max":{"1min":5.7130000000000001,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":1.395,"5min":1.2270000000000001,"15min":1.0349999999999999},"min":{"1min":0.31,"5min":0.26200000000000001,"15min":0.23300000000000001},"max":{"1min":5.7489999999999997,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":0.60099999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.50600000000000001,"15min":0.79900000000000004},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.183},"max":{"1min":4.0860000000000003,"5min":4.0860000000000003,"15min":11.999000000000001},"last":4.4809999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.161,"15min":1.083},"min":{"1min":0.24299999999999999,"5min":0.23400000000000001,"15min":0.222},"max":{"1min":11.082000000000001,"5min":11.082000000000001,"15min":16.649000000000001},"last":0.313}]}]},{"osd":1,"up_from":8,"seq":34359739191,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9507492,"kb_used_data":7858332,"kb_used_omap":1392,"kb_used_meta":1647759,"kb_avail":84864348,"statfs":{"total":96636764160,"available":86901092352,"internally_reserved":0,"allocated":8046931968,"data_stored":14332913594,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1425814,"internal_metadata":1687305834},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,3,8,8,3,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:09:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":0.90200000000000002,"15min":1.196},"min":{"1min":0.19600000000000001,"5min":0.154,"15min":0.154},"max":{"1min":12.933,"5min":12.933,"15min":22.082999999999998},"last":0.254},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.431,"15min":1.5600000000000001},"min":{"1min":0.27500000000000002,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":14.656000000000001,"5min":14.656000000000001,"15min":39.978999999999999},"last":0.48599999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:09:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1240000000000001,"15min":1.161},"min":{"1min":0.28199999999999997,"5min":0.183,"15min":0.183},"max":{"1min":4.7800000000000002,"5min":7.9279999999999999,"15min":11.945},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48999999999999999,"15min":0.70999999999999996},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":1.367,"5min":4.1040000000000001,"15min":8.3170000000000002},"last":0.28499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739203,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6150992,"kb_used_data":4839048,"kb_used_omap":866,"kb_used_meta":1311069,"kb_avail":88220848,"statfs":{"total":96636764160,"available":90338148352,"internally_reserved":0,"allocated":4955185152,"data_stored":8850416236,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":886870,"internal_metadata":1342535594},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,2,4,0,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:09:19 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":0.96399999999999997,"15min":0.86699999999999999},"min":{"1min":0.26700000000000002,"5min":0.193,"15min":0.153},"max":{"1min":5.9390000000000001,"5min":7.1180000000000003,"15min":8.3379999999999992},"last":0.36499999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.248,"15min":1.036},"min":{"1min":0.246,"5min":0.19500000000000001,"15min":0.187},"max":{"1min":5.984,"5min":10.791,"15min":11.304},"last":0.52000000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:09:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68999999999999995,"15min":0.77700000000000002},"min":{"1min":0.23499999999999999,"5min":0.214,"15min":0.191},"max":{"1min":4.734,"5min":6.7519999999999998,"15min":10.106},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.94999999999999996,"15min":1.0760000000000001},"min":{"1min":0.23999999999999999,"5min":0.214,"15min":0.187},"max":{"1min":4.4900000000000002,"5min":8.7379999999999995,"15min":16.913},"last":0.55500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4954476544,"data_stored":8849971813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8046206976,"data_stored":14332452787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3091333120,"data_stored":5482083662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:09:52.311 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:52.312 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:52.312 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:52.312 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:52.313 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:52.313 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:52.314 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:52.314 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:52.314 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:09:52.315 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T01:09:52.865 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:09:52.861+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:09:53.088 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T01:09:53.119 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:09:53.560 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:09:53.557+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:09:53.964 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:09:54.032 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T01:09:54.910 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T01:09:54.955 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T01:09:55.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:55.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:09:55.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:55.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:55.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:55.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:55.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:55.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:55.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:55.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:55.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:55.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:55.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:55.369+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:55.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:55.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:55.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:55.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:55.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:55.381+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:55.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:55.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:55.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:55.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:55.871 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T01:09:55.923 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-10-14T01:09:56.620 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-10-14T01:09:56.698 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-10-14T01:09:56.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:56.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:56.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:56.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:56.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:56.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:56.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:56.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:56.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.973+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:56.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:56.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:56.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:09:57.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:56.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:09:57.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:57.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:57.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:57.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:57.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:57.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:57.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:57.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:57.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:57.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:57.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:57.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:57.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:57.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:57.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:57.053+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:57.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:57.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:57.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:57.053+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:57.533 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-10-14T01:09:57.600 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.0 2023-10-14T01:09:58.503 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.0 on osd.2 to deep-scrub 2023-10-14T01:09:58.547 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T01:09:58.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:58.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:09:58.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:58.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:09:58.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:58.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:09:58.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:58.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:09:58.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:58.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:09:58.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:58.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:09:59.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:59.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:09:59.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:59.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:09:59.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:59.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:09:59.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:59.025+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:09:59.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:59.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:09:59.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:09:59.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:09:59.581 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T01:09:59.629 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-10-14T01:10:00.312 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-10-14T01:10:00.388 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:10:01.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:01.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:10:01.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:01.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:10:01.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:01.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:01.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:01.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:01.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:01.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:02.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:02.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:02.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:02.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:02.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:02.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:02.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:02.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:02.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:02.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:02.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:02.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:02.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:02.141+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:02.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:02.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:02.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:02.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:03.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:03.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:03.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:03.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:03.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:03.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:03.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:03.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:03.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:03.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:03.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:03.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:03.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:03.745+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:03.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:03.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:03.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:03.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:03.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:03.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:10:03.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:03.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:10:04.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:04.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:04.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:04.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:04.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:04.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:04.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:04.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:04.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.029+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:04.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.057+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:04.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:04.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.061+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:04.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:04.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:04.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:04.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:04.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:04.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:04.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:04.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:05.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:05.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:05.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:05.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:05.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:05.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:05.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:05.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:05.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:05.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:05.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:05.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:05.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:05.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:05.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:05.517+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:05.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:05.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:05.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:05.549+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:05.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:05.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:05.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:05.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:07.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:07.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:07.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:07.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:07.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:07.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:07.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:07.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:07.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:07.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:07.115 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:10:07.113+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:10:07.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:07.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:07.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:07.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:07.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:07.145+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:07.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:07.149+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:07.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:07.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:07.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:07.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:10.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:10.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:10.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:10.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:10.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:10.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:10.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:10.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:10.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:10.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:10.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:10.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:10.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:10.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:10.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:10.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:10.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:10.625+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:11.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:10:11.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:10:11.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:11.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:11.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:11.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:11.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:11.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:11.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:11.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:11.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.421+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:11.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:11.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:11.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:18.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:18.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:18.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:18.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:18.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:18.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:18.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:18.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:18.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:18.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:18.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:18.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:18.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:18.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:18.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:18.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:18.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:18.869+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:18.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:18.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:18.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:18.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:19.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:19.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:19.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:19.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:19.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:19.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:19.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:19.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:19.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:19.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:19.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:19.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:19.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:19.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:19.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:19.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:19.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:19.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:19.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:19.425+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:20.389 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:10:20.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:20.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:20.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:20.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:20.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:20.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:20.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:20.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.565+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:20.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:20.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:10:20.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:20.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:20.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:20.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:20.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:20.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:20.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:20.741 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:10:20.737+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:10:21.140 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:10:21.141 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:10:21.205 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2254,"stamp":"2023-10-14T01:10:19.369716+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28331934163,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2019662,"num_read_kb":7818752,"num_write":1975431,"num_write_kb":7900259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80486,"ondisk_log_size":80486,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20521604,"kb_used_data":15801260,"kb_used_omap":2752,"kb_used_meta":4717567,"kb_avail":262593916,"statfs":{"total":289910292480,"available":268896169984,"internally_reserved":0,"allocated":16180490240,"data_stored":28751656283,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2818793,"internal_metadata":4830788887},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,4,9,9,22,12,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16584704,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4040,"num_read_kb":16116,"num_write":4289,"num_write_kb":17156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002003"},"pg_stats":[{"pgid":"2.7","version":"149'253189","reported_seq":496391,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:10:14.645501+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:10:14.645501+0000","last_peered":"2023-10-14T01:10:14.645501+0000","last_clean":"2023-10-14T01:10:14.645501+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:10:14.645501+0000","last_undegraded":"2023-10-14T01:10:14.645501+0000","last_fullsized":"2023-10-14T01:10:14.645501+0000","mapping_epoch":13,"log_start":"145'243117","ondisk_log_start":"145'243117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3446387224,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":245800,"num_read_kb":950924,"num_write":239606,"num_write_kb":958077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"149'266586","reported_seq":525397,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:10:14.642982+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:10:14.642982+0000","last_peered":"2023-10-14T01:10:14.642982+0000","last_clean":"2023-10-14T01:10:14.642982+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:10:14.642982+0000","last_undegraded":"2023-10-14T01:10:14.642982+0000","last_fullsized":"2023-10-14T01:10:14.642982+0000","mapping_epoch":13,"log_start":"145'256516","ondisk_log_start":"145'256516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3644739802,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":262906,"num_read_kb":1008280,"num_write":253005,"num_write_kb":1011549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"149'248171","reported_seq":488445,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:10:14.637550+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:10:14.637550+0000","last_peered":"2023-10-14T01:10:14.637550+0000","last_clean":"2023-10-14T01:10:14.637550+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:10:14.637550+0000","last_undegraded":"2023-10-14T01:10:14.637550+0000","last_fullsized":"2023-10-14T01:10:14.637550+0000","mapping_epoch":13,"log_start":"145'238123","ondisk_log_start":"145'238123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3423380160,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":242616,"num_read_kb":942323,"num_write":238484,"num_write_kb":953626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"149'245919","reported_seq":487797,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:10:14.639311+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:10:14.639311+0000","last_peered":"2023-10-14T01:10:14.639311+0000","last_clean":"2023-10-14T01:10:14.639311+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:10:14.639311+0000","last_undegraded":"2023-10-14T01:10:14.639311+0000","last_fullsized":"2023-10-14T01:10:14.639311+0000","mapping_epoch":13,"log_start":"145'235917","ondisk_log_start":"145'235917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3440448170,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":243874,"num_read_kb":950612,"num_write":240225,"num_write_kb":960649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"149'250352","reported_seq":499636,"reported_epoch":149,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:10:18.114231+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:10:18.114231+0000","last_peered":"2023-10-14T01:10:18.114231+0000","last_clean":"2023-10-14T01:10:18.114231+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:10:18.114231+0000","last_undegraded":"2023-10-14T01:10:18.114231+0000","last_fullsized":"2023-10-14T01:10:18.114231+0000","mapping_epoch":13,"log_start":"145'240322","ondisk_log_start":"145'240322","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1168,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 263s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3508138505,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":251903,"num_read_kb":970102,"num_write":245284,"num_write_kb":980657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"149'251941","reported_seq":499279,"reported_epoch":149,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:10:15.162752+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:10:15.162752+0000","last_peered":"2023-10-14T01:10:15.162752+0000","last_clean":"2023-10-14T01:10:15.162752+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:10:15.162752+0000","last_undegraded":"2023-10-14T01:10:15.162752+0000","last_fullsized":"2023-10-14T01:10:15.162752+0000","mapping_epoch":13,"log_start":"146'241911","ondisk_log_start":"146'241911","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1196,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 259s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3550097726,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":249153,"num_read_kb":974482,"num_write":247661,"num_write_kb":990483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"149'253291","reported_seq":502848,"reported_epoch":149,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:10:15.158449+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:10:15.158449+0000","last_peered":"2023-10-14T01:10:15.158449+0000","last_clean":"2023-10-14T01:10:15.158449+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:10:15.158449+0000","last_undegraded":"2023-10-14T01:10:15.158449+0000","last_fullsized":"2023-10-14T01:10:15.158449+0000","mapping_epoch":13,"log_start":"146'243216","ondisk_log_start":"146'243216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1358,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 260s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3580662311,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":251170,"num_read_kb":983732,"num_write":248871,"num_write_kb":995347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"149'287178","reported_seq":555687,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:10:14.619941+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:10:14.619941+0000","last_peered":"2023-10-14T01:10:14.619941+0000","last_clean":"2023-10-14T01:10:14.619941+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:10:14.619941+0000","last_undegraded":"2023-10-14T01:10:14.619941+0000","last_fullsized":"2023-10-14T01:10:14.619941+0000","mapping_epoch":13,"log_start":"146'277116","ondisk_log_start":"146'277116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3737489897,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":272134,"num_read_kb":1038206,"num_write":262158,"num_write_kb":1047977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":312,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:09:44.892414+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:09:44.892414+0000","last_peered":"2023-10-14T01:09:44.892414+0000","last_clean":"2023-10-14T01:09:44.892414+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:09:44.892414+0000","last_undegraded":"2023-10-14T01:09:44.892414+0000","last_fullsized":"2023-10-14T01:09:44.892414+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28331343795,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2019556,"num_read_kb":7818661,"num_write":1975294,"num_write_kb":7898365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16177823744,"data_stored":28750315366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80389,"ondisk_log_size":80389,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739209,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4492168,"kb_used_data":3034688,"kb_used_omap":494,"kb_used_meta":1456977,"kb_avail":89879672,"statfs":{"total":96636764160,"available":92036784128,"internally_reserved":0,"allocated":3107520512,"data_stored":5497473845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1491945219},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,2,3,10,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:09:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.1659999999999999,"15min":0.98099999999999998},"min":{"1min":0.28399999999999997,"5min":0.192,"15min":0.17899999999999999},"max":{"1min":5.7130000000000001,"5min":8.5800000000000001,"15min":8.5800000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":1.395,"5min":1.2270000000000001,"15min":1.0349999999999999},"min":{"1min":0.31,"5min":0.26200000000000001,"15min":0.23300000000000001},"max":{"1min":5.7489999999999997,"5min":8.6140000000000008,"15min":8.6140000000000008},"last":0.45500000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:09:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.50600000000000001,"15min":0.79900000000000004},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.183},"max":{"1min":4.0860000000000003,"5min":4.0860000000000003,"15min":11.999000000000001},"last":0.24099999999999999},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.161,"15min":1.083},"min":{"1min":0.24299999999999999,"5min":0.23400000000000001,"15min":0.222},"max":{"1min":11.082000000000001,"5min":11.082000000000001,"15min":16.649000000000001},"last":3.0569999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739196,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9722980,"kb_used_data":7898652,"kb_used_omap":1392,"kb_used_meta":1822927,"kb_avail":84648860,"statfs":{"total":96636764160,"available":86680432640,"internally_reserved":0,"allocated":8088219648,"data_stored":14374201274,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1425814,"internal_metadata":1866677866},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1,6,6,9,9,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:09:16 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":0.90200000000000002,"15min":1.196},"min":{"1min":0.19600000000000001,"5min":0.154,"15min":0.154},"max":{"1min":12.933,"5min":12.933,"15min":22.082999999999998},"last":0.29299999999999998},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.431,"15min":1.5600000000000001},"min":{"1min":0.27500000000000002,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":14.656000000000001,"5min":14.656000000000001,"15min":39.978999999999999},"last":0.187}]},{"osd":2,"last update":"Sat Oct 14 01:09:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1240000000000001,"15min":1.161},"min":{"1min":0.28199999999999997,"5min":0.183,"15min":0.183},"max":{"1min":4.7800000000000002,"5min":7.9279999999999999,"15min":11.945},"last":1.653},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.48999999999999999,"15min":0.70999999999999996},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":1.367,"5min":4.1040000000000001,"15min":8.3170000000000002},"last":0.26200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739209,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6306456,"kb_used_data":4867920,"kb_used_omap":866,"kb_used_meta":1437661,"kb_avail":88065384,"statfs":{"total":96636764160,"available":90178953216,"internally_reserved":0,"allocated":4984750080,"data_stored":8879981164,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":886870,"internal_metadata":1472165802},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,0,3,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:09:19 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":0.96399999999999997,"15min":0.86699999999999999},"min":{"1min":0.26700000000000002,"5min":0.193,"15min":0.153},"max":{"1min":5.9390000000000001,"5min":7.1180000000000003,"15min":8.3379999999999992},"last":0.51000000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.248,"15min":1.036},"min":{"1min":0.246,"5min":0.19500000000000001,"15min":0.187},"max":{"1min":5.984,"5min":10.791,"15min":11.304},"last":0.59599999999999997}]},{"osd":2,"last update":"Sat Oct 14 01:09:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68999999999999995,"15min":0.77700000000000002},"min":{"1min":0.23499999999999999,"5min":0.214,"15min":0.191},"max":{"1min":4.734,"5min":6.7519999999999998,"15min":10.106},"last":1.4990000000000001},{"interface":"front","average":{"1min":0.98599999999999999,"5min":0.94999999999999996,"15min":1.0760000000000001},"min":{"1min":0.23999999999999999,"5min":0.214,"15min":0.187},"max":{"1min":4.4900000000000002,"5min":8.7379999999999995,"15min":16.913},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4984143872,"data_stored":8879639141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8086949888,"data_stored":14373195699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3106729984,"data_stored":5497480526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:10:21.207 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:21.207 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:21.207 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:21.208 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:21.208 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:21.209 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:21.209 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:21.209 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:21.210 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:21.210 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:10:21.294 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:10:21.289+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:10:23.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:23.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:23.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:23.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:23.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:23.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:23.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:23.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:23.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:23.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:24.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:24.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:24.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:24.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:24.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:24.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:24.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:24.069+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:24.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:24.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:24.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:24.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:24.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:24.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:24.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:24.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:24.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:24.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:24.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:24.876+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:24.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:24.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:24.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:24.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:25.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:25.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:25.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:25.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:25.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:25.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:25.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:25.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:25.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:25.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:25.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:25.984+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:25.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:25.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:25.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:25.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:26.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:26.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:26.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:26.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:26.105 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:10:26.100+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:10:26.118 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:10:26.112+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:10:26.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:26.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:26.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:26.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.168+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:26.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:26.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:26.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:10:26.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:26.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:26.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:26.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:26.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:26.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:26.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:26.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.256+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:26.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:26.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:26.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:26.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:26.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:26.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:26.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:26.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.560+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:26.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.560+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:26.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.560+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:26.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.560+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:26.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.560+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:26.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:26.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:26.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:26.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:26.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:26.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.972+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:26.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:27.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.996+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:27.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:27.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:26.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:27.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:27.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:27.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:27.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:27.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:27.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:27.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:27.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:27.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:27.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:27.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:27.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:27.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:27.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:28.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:27.968+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:28.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:27.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:28.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:27.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:28.066 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:10:27.996+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:10:28.066 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:10:28.028+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:10:29.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:29.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:29.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:29.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:29.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:29.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:29.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:29.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:29.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:29.240+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:29.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:29.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:29.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:29.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:30.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:30.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:30.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:30.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:30.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:30.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:30.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:30.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:30.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:30.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:30.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:30.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:30.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:30.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:30.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:30.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:30.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:30.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:30.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:30.264+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:30.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:30.264+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:32.492 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:10:32.488+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:10:34.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:10:34.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:10:34.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:34.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:34.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:34.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:34.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:34.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:34.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:34.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.464+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:34.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:34.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.512+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:34.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:34.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:34.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:35.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:35.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:35.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:35.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:35.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:35.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:35.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:35.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:35.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:35.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:35.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:35.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:35.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:35.664+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:35.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:35.664+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:35.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:35.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:10:35.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:35.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:35.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:35.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:36.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:36.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:36.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:36.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:36.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:36.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:36.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:36.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:36.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:36.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.180+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:36.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:36.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:36.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:36.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:36.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:36.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:36.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:36.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.436+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:36.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:36.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:36.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:37.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:37.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:37.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:37.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:37.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:37.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:37.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:37.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:37.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:37.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:37.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:37.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:37.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:37.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:37.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:37.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:37.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:37.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:37.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:37.432+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:38.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:38.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:38.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:38.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:38.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:38.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:38.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:38.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:10:38.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:38.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:38.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:38.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:38.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:38.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:38.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:38.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:38.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:38.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.688+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:38.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:38.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:38.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:39.030 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:10:39.028+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:10:40.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:40.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:40.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:40.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:40.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:40.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:40.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:40.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:40.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:40.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:40.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:40.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:40.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:40.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:40.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:40.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:40.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:40.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:40.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:41.212 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:10:42.121 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:10:42.123 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:10:42.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:42.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:42.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:42.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:42.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:42.232 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2265,"stamp":"2023-10-14T01:10:41.380213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28369805779,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2029183,"num_read_kb":7856716,"num_write":1985130,"num_write_kb":7939055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80400,"ondisk_log_size":80400,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20891412,"kb_used_data":15875772,"kb_used_omap":2752,"kb_used_meta":5012863,"kb_avail":262224108,"statfs":{"total":289910292480,"available":268517486592,"internally_reserved":0,"allocated":16256790528,"data_stored":28827956571,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2818793,"internal_metadata":5133171991},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,8,3,7,13,21,14],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22310912,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5634,"num_read_kb":22464,"num_write":5720,"num_write_kb":22880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003037"},"pg_stats":[{"pgid":"2.7","version":"149'254444","reported_seq":498845,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:10:40.343052+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:10:40.343052+0000","last_peered":"2023-10-14T01:10:40.343052+0000","last_clean":"2023-10-14T01:10:40.343052+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:10:40.343052+0000","last_undegraded":"2023-10-14T01:10:40.343052+0000","last_fullsized":"2023-10-14T01:10:40.343052+0000","mapping_epoch":13,"log_start":"146'244417","ondisk_log_start":"146'244417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3451060760,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":246981,"num_read_kb":955636,"num_write":240793,"num_write_kb":962825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"149'267943","reported_seq":527993,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:10:40.329300+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:10:40.329300+0000","last_peered":"2023-10-14T01:10:40.329300+0000","last_clean":"2023-10-14T01:10:40.329300+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:10:40.329300+0000","last_undegraded":"2023-10-14T01:10:40.329300+0000","last_fullsized":"2023-10-14T01:10:40.329300+0000","mapping_epoch":13,"log_start":"146'257916","ondisk_log_start":"146'257916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3649769690,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":264129,"num_read_kb":1013164,"num_write":254299,"num_write_kb":1016725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"149'249461","reported_seq":490949,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:10:40.329732+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:10:40.329732+0000","last_peered":"2023-10-14T01:10:40.329732+0000","last_clean":"2023-10-14T01:10:40.329732+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:10:40.329732+0000","last_undegraded":"2023-10-14T01:10:40.329732+0000","last_fullsized":"2023-10-14T01:10:40.329732+0000","mapping_epoch":13,"log_start":"146'239423","ondisk_log_start":"146'239423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3428209344,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":243819,"num_read_kb":947115,"num_write":239730,"num_write_kb":958610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"149'247145","reported_seq":490257,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:10:40.345416+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:10:40.345416+0000","last_peered":"2023-10-14T01:10:40.345416+0000","last_clean":"2023-10-14T01:10:40.345416+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:10:40.345416+0000","last_undegraded":"2023-10-14T01:10:40.345416+0000","last_fullsized":"2023-10-14T01:10:40.345416+0000","mapping_epoch":13,"log_start":"146'237117","ondisk_log_start":"146'237117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3445154474,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":245101,"num_read_kb":955504,"num_write":241428,"num_write_kb":965461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"149'251442","reported_seq":501709,"reported_epoch":149,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:10:38.499688+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:10:38.499688+0000","last_peered":"2023-10-14T01:10:38.499688+0000","last_clean":"2023-10-14T01:10:38.499688+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:10:38.499688+0000","last_undegraded":"2023-10-14T01:10:38.499688+0000","last_fullsized":"2023-10-14T01:10:38.499688+0000","mapping_epoch":13,"log_start":"146'241422","ondisk_log_start":"146'241422","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1258,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 283s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3512074761,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":252865,"num_read_kb":973942,"num_write":246296,"num_write_kb":984705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"149'253278","reported_seq":501863,"reported_epoch":149,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:10:40.543657+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:10:40.543657+0000","last_peered":"2023-10-14T01:10:40.543657+0000","last_clean":"2023-10-14T01:10:40.543657+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:10:40.543657+0000","last_undegraded":"2023-10-14T01:10:40.543657+0000","last_fullsized":"2023-10-14T01:10:40.543657+0000","mapping_epoch":13,"log_start":"146'243211","ondisk_log_start":"146'243211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1331,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 285s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3554976062,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":250382,"num_read_kb":979382,"num_write":248887,"num_write_kb":995387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"149'254635","reported_seq":505393,"reported_epoch":149,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:10:40.538435+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:10:40.538435+0000","last_peered":"2023-10-14T01:10:40.538435+0000","last_clean":"2023-10-14T01:10:40.538435+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:10:40.538435+0000","last_undegraded":"2023-10-14T01:10:40.538435+0000","last_fullsized":"2023-10-14T01:10:40.538435+0000","mapping_epoch":13,"log_start":"146'244616","ondisk_log_start":"146'244616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1472,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 285s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3585565223,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":252355,"num_read_kb":988464,"num_write":250119,"num_write_kb":1000339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"149'288593","reported_seq":558442,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:10:40.311890+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:10:40.311890+0000","last_peered":"2023-10-14T01:10:40.311890+0000","last_clean":"2023-10-14T01:10:40.311890+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:10:40.311890+0000","last_undegraded":"2023-10-14T01:10:40.311890+0000","last_fullsized":"2023-10-14T01:10:40.311890+0000","mapping_epoch":13,"log_start":"146'278516","ondisk_log_start":"146'278516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3742405097,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":273445,"num_read_kb":1043418,"num_write":263441,"num_write_kb":1053109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":312,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:09:44.892414+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:09:44.892414+0000","last_peered":"2023-10-14T01:09:44.892414+0000","last_clean":"2023-10-14T01:09:44.892414+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:09:44.892414+0000","last_undegraded":"2023-10-14T01:09:44.892414+0000","last_fullsized":"2023-10-14T01:09:44.892414+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28369215411,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2029077,"num_read_kb":7856625,"num_write":1984993,"num_write_kb":7937161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16254189568,"data_stored":28826681190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80303,"ondisk_log_size":80303,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739214,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4568304,"kb_used_data":3050152,"kb_used_omap":494,"kb_used_meta":1517649,"kb_avail":89803536,"statfs":{"total":96636764160,"available":91958820864,"internally_reserved":0,"allocated":3123355648,"data_stored":5513308981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1554073347},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,2,4,1,6,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.97599999999999998,"15min":0.97099999999999997},"min":{"1min":0.246,"5min":0.192,"15min":0.183},"max":{"1min":1.0009999999999999,"5min":6.4359999999999999,"15min":8.5800000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":1.038,"15min":1.024},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.25},"max":{"1min":1.04,"5min":6.4720000000000004,"15min":8.6140000000000008},"last":0.39400000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.54400000000000004,"15min":0.78100000000000003},"min":{"1min":0.23999999999999999,"5min":0.20100000000000001,"15min":0.183},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":11.999000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":1.1299999999999999,"15min":1.0980000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":4.4660000000000002,"5min":11.082000000000001,"15min":16.649000000000001},"last":0.35199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739201,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9901876,"kb_used_data":7937324,"kb_used_omap":1392,"kb_used_meta":1963151,"kb_avail":84469964,"statfs":{"total":96636764160,"available":86497243136,"internally_reserved":0,"allocated":8127819776,"data_stored":14413801402,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1425814,"internal_metadata":2010267242},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,8,1,2,9,12,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.88600000000000001,"15min":1.111},"min":{"1min":0.186,"5min":0.154,"15min":0.154},"max":{"1min":3.2250000000000001,"5min":12.933,"15min":22.082999999999998},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.79500000000000004,"5min":1.3080000000000001,"15min":1.5029999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":6.7140000000000004,"5min":14.656000000000001,"15min":39.978999999999999},"last":0.315}]},{"osd":2,"last update":"Sat Oct 14 01:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1000000000000001,"15min":1.1619999999999999},"min":{"1min":0.20999999999999999,"5min":0.183,"15min":0.183},"max":{"1min":6.9340000000000002,"5min":7.9279999999999999,"15min":11.945},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52900000000000003,"15min":0.71299999999999997},"min":{"1min":0.26200000000000001,"5min":0.186,"15min":0.186},"max":{"1min":3.266,"5min":4.1040000000000001,"15min":8.3170000000000002},"last":0.49199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739213,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6421232,"kb_used_data":4888296,"kb_used_omap":866,"kb_used_meta":1532061,"kb_avail":87950608,"statfs":{"total":96636764160,"available":90061422592,"internally_reserved":0,"allocated":5005615104,"data_stored":8900846188,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":886870,"internal_metadata":1568831402},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1,3,3,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:10:19 2023","interfaces":[{"interface":"back","average":{"1min":3.0209999999999999,"5min":1.335,"15min":1.0129999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.16400000000000001},"max":{"1min":25.927,"5min":25.927,"15min":25.927},"last":0.36799999999999999},{"interface":"front","average":{"1min":3.0470000000000002,"5min":1.623,"15min":1.1739999999999999},"min":{"1min":0.22500000000000001,"5min":0.19500000000000001,"15min":0.187},"max":{"1min":26.632999999999999,"5min":26.632999999999999,"15min":26.632999999999999},"last":2.9300000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:10:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":0.79100000000000004,"15min":0.79700000000000004},"min":{"1min":0.214,"5min":0.214,"15min":0.191},"max":{"1min":7.734,"5min":7.734,"15min":10.106},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.91700000000000004,"15min":1.0740000000000001},"min":{"1min":0.24199999999999999,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":4.423,"5min":8.7379999999999995,"15min":16.913},"last":1.2629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5004222464,"data_stored":8899717733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8127905792,"data_stored":14414151603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3122061312,"data_stored":5512811854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:10:42.233 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:42.233 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:42.234 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:42.234 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:42.235 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:42.235 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:42.235 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:42.236 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:42.236 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:10:42.236 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:10:42.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:42.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:42.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:42.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:42.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.240+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:42.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:42.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:42.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:10:42.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:42.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:42.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:42.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:42.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:42.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:42.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:42.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:42.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:42.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.604+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:42.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:42.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:42.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:43.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:43.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:43.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:43.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:43.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:43.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:43.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:43.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:43.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:43.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:43.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:43.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:43.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:43.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:43.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:43.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:45.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:45.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:10:45.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:45.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:45.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:45.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:45.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:45.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:45.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:45.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:45.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:45.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:45.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:45.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:45.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:45.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:45.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:45.340+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:45.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:45.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:45.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:45.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:46.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:46.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:46.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:46.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:46.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:46.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:46.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:46.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:46.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:46.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:46.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:46.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:46.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:46.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:46.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:46.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:46.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:46.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:46.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:46.344+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:46.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:46.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:46.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:46.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:48.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:48.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:10:48.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:48.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:48.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:48.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:48.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:48.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:48.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:48.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:48.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:48.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:48.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:48.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:48.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:48.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:48.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:48.984+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:48.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:48.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:48.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:48.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:49.444 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:10:49.440+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:10:50.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:50.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:50.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:50.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:50.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:50.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:50.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:50.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:50.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:50.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.824+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:50.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:50.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:50.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:10:50.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:10:50.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:50.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:50.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:50.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:50.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:50.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:50.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:50.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:50.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.904+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:50.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:50.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:50.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:51.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:51.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:51.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:51.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:51.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:51.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:51.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:51.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:51.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:51.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:51.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:51.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:51.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:51.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:51.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:51.744+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:51.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:51.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:51.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:51.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:10:53.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:53.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:53.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:53.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:10:53.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:53.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:10:53.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:53.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:53.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:53.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:53.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:53.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:53.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:53.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:56.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:56.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:10:56.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:56.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:10:56.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:56.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:10:56.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:56.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:10:56.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:56.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:10:56.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:56.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:10:56.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:56.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:10:56.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:56.600+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:10:56.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:56.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:10:56.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:10:56.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:00.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:00.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:00.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:00.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:00.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:00.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:00.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:00.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:00.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:00.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:00.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:00.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:00.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:00.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:00.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:00.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:00.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:00.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:00.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:00.740+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:00.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:00.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:00.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:00.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:02.237 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:11:02.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:11:02.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:11:02.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:02.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:02.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:02.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:02.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:02.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:02.982 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:11:02.983 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:11:02.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:02.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:02.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:02.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.988+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:02.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:02.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:02.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:03.032 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2276,"stamp":"2023-10-14T01:11:01.384104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28400824787,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2037159,"num_read_kb":7888544,"num_write":1993073,"num_write_kb":7970827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80414,"ondisk_log_size":80414,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20809396,"kb_used_data":15939408,"kb_used_omap":2886,"kb_used_meta":4867065,"kb_avail":262306124,"statfs":{"total":289910292480,"available":268601470976,"internally_reserved":0,"allocated":16321953792,"data_stored":28893112123,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2955895,"internal_metadata":4983874953},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,4,9,11,10,11,12,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15736832,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4130,"num_read_kb":16480,"num_write":4010,"num_write_kb":16040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001786"},"pg_stats":[{"pgid":"2.7","version":"150'255457","reported_seq":500825,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:00.877633+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:11:00.877633+0000","last_peered":"2023-10-14T01:11:00.877633+0000","last_clean":"2023-10-14T01:11:00.877633+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:11:00.877633+0000","last_undegraded":"2023-10-14T01:11:00.877633+0000","last_fullsized":"2023-10-14T01:11:00.877633+0000","mapping_epoch":13,"log_start":"146'245417","ondisk_log_start":"146'245417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3454878232,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":247935,"num_read_kb":959448,"num_write":241770,"num_write_kb":966733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"150'268982","reported_seq":530113,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:00.878066+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:11:00.878066+0000","last_peered":"2023-10-14T01:11:00.878066+0000","last_clean":"2023-10-14T01:11:00.878066+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:11:00.878066+0000","last_undegraded":"2023-10-14T01:11:00.878066+0000","last_fullsized":"2023-10-14T01:11:00.878066+0000","mapping_epoch":13,"log_start":"146'258916","ondisk_log_start":"146'258916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3653718234,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":265196,"num_read_kb":1017420,"num_write":255302,"num_write_kb":1020737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"150'250449","reported_seq":492948,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:00.865577+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:11:00.865577+0000","last_peered":"2023-10-14T01:11:00.865577+0000","last_clean":"2023-10-14T01:11:00.865577+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:11:00.865577+0000","last_undegraded":"2023-10-14T01:11:00.865577+0000","last_fullsized":"2023-10-14T01:11:00.865577+0000","mapping_epoch":13,"log_start":"146'240423","ondisk_log_start":"146'240423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3432026816,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":244823,"num_read_kb":951127,"num_write":240694,"num_write_kb":962466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"150'248144","reported_seq":492249,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:00.856501+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:11:00.856501+0000","last_peered":"2023-10-14T01:11:00.856501+0000","last_clean":"2023-10-14T01:11:00.856501+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:11:00.856501+0000","last_undegraded":"2023-10-14T01:11:00.856501+0000","last_fullsized":"2023-10-14T01:11:00.856501+0000","mapping_epoch":13,"log_start":"146'238117","ondisk_log_start":"146'238117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3449029290,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":246091,"num_read_kb":959464,"num_write":242415,"num_write_kb":969409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"149'252475","reported_seq":503713,"reported_epoch":149,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:10:58.636086+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:10:58.636086+0000","last_peered":"2023-10-14T01:10:58.636086+0000","last_clean":"2023-10-14T01:10:58.636086+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:10:58.636086+0000","last_undegraded":"2023-10-14T01:10:58.636086+0000","last_fullsized":"2023-10-14T01:10:58.636086+0000","mapping_epoch":13,"log_start":"146'242423","ondisk_log_start":"146'242423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1328,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 304s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3515888137,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":253820,"num_read_kb":977750,"num_write":247271,"num_write_kb":988605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"150'254296","reported_seq":503946,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:11:00.972726+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:11:00.972726+0000","last_peered":"2023-10-14T01:11:00.972726+0000","last_clean":"2023-10-14T01:11:00.972726+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:11:00.972726+0000","last_undegraded":"2023-10-14T01:11:00.972726+0000","last_fullsized":"2023-10-14T01:11:00.972726+0000","mapping_epoch":13,"log_start":"146'244211","ondisk_log_start":"146'244211","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1424,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 305s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3558617406,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":251434,"num_read_kb":983570,"num_write":249827,"num_write_kb":999147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"150'255725","reported_seq":507410,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:11:00.968217+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:11:00.968217+0000","last_peered":"2023-10-14T01:11:00.968217+0000","last_clean":"2023-10-14T01:11:00.968217+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:11:00.968217+0000","last_undegraded":"2023-10-14T01:11:00.968217+0000","last_fullsized":"2023-10-14T01:11:00.968217+0000","mapping_epoch":13,"log_start":"146'245716","ondisk_log_start":"146'245716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1538,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 306s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3589628455,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":253267,"num_read_kb":992100,"num_write":251153,"num_write_kb":1004475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"150'289728","reported_seq":560645,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:00.843889+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:11:00.843889+0000","last_peered":"2023-10-14T01:11:00.843889+0000","last_clean":"2023-10-14T01:11:00.843889+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:11:00.843889+0000","last_undegraded":"2023-10-14T01:11:00.843889+0000","last_fullsized":"2023-10-14T01:11:00.843889+0000","mapping_epoch":13,"log_start":"146'279716","ondisk_log_start":"146'279716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3746447849,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":274487,"num_read_kb":1047574,"num_write":264504,"num_write_kb":1057361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":313,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:10:00.320244+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:10:00.320244+0000","last_peered":"2023-10-14T01:10:00.320244+0000","last_clean":"2023-10-14T01:10:00.320244+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:10:00.320244+0000","last_undegraded":"2023-10-14T01:10:00.320244+0000","last_fullsized":"2023-10-14T01:10:00.320244+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28400234419,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2037053,"num_read_kb":7888453,"num_write":1992936,"num_write_kb":7968933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16318955520,"data_stored":28891447142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80317,"ondisk_log_size":80317,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739218,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4612180,"kb_used_data":3062088,"kb_used_omap":494,"kb_used_meta":1549585,"kb_avail":89759660,"statfs":{"total":96636764160,"available":91913891840,"internally_reserved":0,"allocated":3135578112,"data_stored":5525527589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1586775811},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,4,2,5,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.97599999999999998,"15min":0.97099999999999997},"min":{"1min":0.246,"5min":0.192,"15min":0.183},"max":{"1min":1.0009999999999999,"5min":6.4359999999999999,"15min":8.5800000000000001},"last":3.714},{"interface":"front","average":{"1min":0.42099999999999999,"5min":1.038,"15min":1.024},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.25},"max":{"1min":1.04,"5min":6.4720000000000004,"15min":8.6140000000000008},"last":3.7450000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.54400000000000004,"15min":0.78100000000000003},"min":{"1min":0.23999999999999999,"5min":0.20100000000000001,"15min":0.183},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":11.999000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":1.1299999999999999,"15min":1.0980000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":4.4660000000000002,"5min":11.082000000000001,"15min":16.649000000000001},"last":3.4700000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739205,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9671972,"kb_used_data":7969940,"kb_used_omap":1526,"kb_used_meta":1700489,"kb_avail":84699868,"statfs":{"total":96636764160,"available":86732664832,"internally_reserved":0,"allocated":8161218560,"data_stored":14447196330,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1562916,"internal_metadata":1741301468},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,5,6,7,4,9,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.88600000000000001,"15min":1.111},"min":{"1min":0.186,"5min":0.154,"15min":0.154},"max":{"1min":3.2250000000000001,"5min":12.933,"15min":22.082999999999998},"last":0.25},{"interface":"front","average":{"1min":0.79500000000000004,"5min":1.3080000000000001,"15min":1.5029999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":6.7140000000000004,"5min":14.656000000000001,"15min":39.978999999999999},"last":0.318}]},{"osd":2,"last update":"Sat Oct 14 01:10:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1000000000000001,"15min":1.1619999999999999},"min":{"1min":0.20999999999999999,"5min":0.183,"15min":0.183},"max":{"1min":6.9340000000000002,"5min":7.9279999999999999,"15min":11.945},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52900000000000003,"15min":0.71299999999999997},"min":{"1min":0.26200000000000001,"5min":0.186,"15min":0.186},"max":{"1min":3.266,"5min":4.1040000000000001,"15min":8.3170000000000002},"last":0.49399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739217,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6525244,"kb_used_data":4907380,"kb_used_omap":866,"kb_used_meta":1616989,"kb_avail":87846596,"statfs":{"total":96636764160,"available":89954914304,"internally_reserved":0,"allocated":5025157120,"data_stored":8920388204,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":886870,"internal_metadata":1655797674},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2,0,1,1,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:10:19 2023","interfaces":[{"interface":"back","average":{"1min":3.0209999999999999,"5min":1.335,"15min":1.0129999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.16400000000000001},"max":{"1min":25.927,"5min":25.927,"15min":25.927},"last":0.49299999999999999},{"interface":"front","average":{"1min":3.0470000000000002,"5min":1.623,"15min":1.1739999999999999},"min":{"1min":0.22500000000000001,"5min":0.19500000000000001,"15min":0.187},"max":{"1min":26.632999999999999,"5min":26.632999999999999,"15min":26.632999999999999},"last":0.38700000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:10:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":0.79100000000000004,"15min":0.79700000000000004},"min":{"1min":0.214,"5min":0.214,"15min":0.191},"max":{"1min":7.734,"5min":7.734,"15min":10.106},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.91700000000000004,"15min":1.0740000000000001},"min":{"1min":0.24199999999999999,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":4.423,"5min":8.7379999999999995,"15min":16.913},"last":0.35399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5023907840,"data_stored":8919403109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8160583680,"data_stored":14446829491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3134464000,"data_stored":5525214542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:11:03.033 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:03.034 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:03.034 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:03.035 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:03.035 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:03.035 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:03.036 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:03.036 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:03.036 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:03.037 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:11:03.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:03.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:03.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:03.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:03.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:03.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:03.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:03.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:03.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:03.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:03.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:03.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:03.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:03.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:03.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:03.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:03.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:03.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:03.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:03.580+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:03.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:03.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:03.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:03.580+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:05.225 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:11:05.224+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:11:05.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:05.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:05.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:05.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:05.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:05.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:05.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:05.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:05.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:05.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:05.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:05.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:05.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:05.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:05.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:05.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:05.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:05.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:05.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:05.436+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:05.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:05.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:05.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:05.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:06.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:11:06.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:06.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:06.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:06.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:06.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:06.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:06.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:06.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:06.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:06.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:06.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:06.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:06.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:07.337 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:11:07.336+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:11:09.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:09.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:09.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:09.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:09.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:09.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:09.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:09.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:09.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:09.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:09.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:09.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:09.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:09.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:09.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:09.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:09.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:09.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:09.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:09.732+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:09.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:09.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:09.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:09.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:12.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:11:12.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:12.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:12.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:12.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:12.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:12.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:12.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:12.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:12.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:12.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.160+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:12.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:12.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:12.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:12.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:12.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:12.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:12.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:12.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:12.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:12.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.404+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:12.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:12.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:12.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:13.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:13.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:13.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:13.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:13.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:13.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:13.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:13.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:13.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:13.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:13.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:13.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:13.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:13.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:13.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:13.540+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:13.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:13.540+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:13.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:13.540+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:13.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:13.540+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:13.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:13.540+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:15.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:15.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:15.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:15.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:15.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:15.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:15.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:15.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.540+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:15.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:15.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:15.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:15.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:15.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:15.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:15.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:15.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:15.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.904+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:15.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:15.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:15.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:16.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:11:16.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:16.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:16.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:16.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:16.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:16.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:16.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:16.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:16.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:16.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.584+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:16.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.584+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:16.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:16.584+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:17.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:17.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:17.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:17.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:17.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:17.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:17.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:17.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:17.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:17.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:17.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:17.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:17.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:17.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:17.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:17.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:17.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:17.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:17.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:17.488+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:17.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:17.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:17.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:17.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:19.680 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:11:19.676+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:11:20.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:20.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:20.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:20.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:20.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:20.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:20.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:20.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:20.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:20.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:20.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:20.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:20.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:20.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:20.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:20.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:20.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:20.808+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:20.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:20.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:20.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:20.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:21.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:21.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:21.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:21.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:21.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:21.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:21.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:21.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:21.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:21.536+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:21.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:21.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:21.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:21.544+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:22.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:22.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:11:22.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:22.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:22.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:22.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:22.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:22.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:22.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:22.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:22.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:22.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:22.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:22.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:22.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:22.348+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:22.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:22.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:22.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:22.388+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:22.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:22.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:22.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:22.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:22.999 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:11:22.996+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:11:23.037 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:11:23.905 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:11:23.906 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:11:23.965 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2287,"stamp":"2023-10-14T01:11:23.391502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28432282067,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2045431,"num_read_kb":7921536,"num_write":2001123,"num_write_kb":8003027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80440,"ondisk_log_size":80440,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21141044,"kb_used_data":16003804,"kb_used_omap":2886,"kb_used_meta":5134329,"kb_avail":261974476,"statfs":{"total":289910292480,"available":268261863424,"internally_reserved":0,"allocated":16387895296,"data_stored":28959049771,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2955895,"internal_metadata":5257553289},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,9,6,10,11,20,20,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15683584,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4115,"num_read_kb":16404,"num_write":3993,"num_write_kb":15972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002424"},"pg_stats":[{"pgid":"2.7","version":"150'256426","reported_seq":502801,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:21.322102+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:11:21.322102+0000","last_peered":"2023-10-14T01:11:21.322102+0000","last_clean":"2023-10-14T01:11:21.322102+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:11:21.322102+0000","last_undegraded":"2023-10-14T01:11:21.322102+0000","last_fullsized":"2023-10-14T01:11:21.322102+0000","mapping_epoch":13,"log_start":"146'246417","ondisk_log_start":"146'246417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3458585112,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":248930,"num_read_kb":963420,"num_write":242700,"num_write_kb":970453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"150'270036","reported_seq":532262,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:21.341883+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:11:21.341883+0000","last_peered":"2023-10-14T01:11:21.341883+0000","last_clean":"2023-10-14T01:11:21.341883+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:11:21.341883+0000","last_undegraded":"2023-10-14T01:11:21.341883+0000","last_fullsized":"2023-10-14T01:11:21.341883+0000","mapping_epoch":13,"log_start":"146'260016","ondisk_log_start":"146'260016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3657765082,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":266288,"num_read_kb":1021776,"num_write":256317,"num_write_kb":1024797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"150'251471","reported_seq":495035,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:21.321986+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:11:21.321986+0000","last_peered":"2023-10-14T01:11:21.321986+0000","last_clean":"2023-10-14T01:11:21.321986+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:11:21.321986+0000","last_undegraded":"2023-10-14T01:11:21.321986+0000","last_fullsized":"2023-10-14T01:11:21.321986+0000","mapping_epoch":13,"log_start":"146'241423","ondisk_log_start":"146'241423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3435860672,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":245879,"num_read_kb":955335,"num_write":241690,"num_write_kb":966450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"150'249102","reported_seq":494230,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:21.294190+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:11:21.294190+0000","last_peered":"2023-10-14T01:11:21.294190+0000","last_clean":"2023-10-14T01:11:21.294190+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:11:21.294190+0000","last_undegraded":"2023-10-14T01:11:21.294190+0000","last_fullsized":"2023-10-14T01:11:21.294190+0000","mapping_epoch":13,"log_start":"146'239017","ondisk_log_start":"146'239017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3452707498,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":247109,"num_read_kb":963524,"num_write":243360,"num_write_kb":973189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"150'253587","reported_seq":505893,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:11:18.855619+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:11:18.855619+0000","last_peered":"2023-10-14T01:11:18.855619+0000","last_clean":"2023-10-14T01:11:18.855619+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:11:18.855619+0000","last_undegraded":"2023-10-14T01:11:18.855619+0000","last_fullsized":"2023-10-14T01:11:18.855619+0000","mapping_epoch":13,"log_start":"146'243523","ondisk_log_start":"146'243523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1387,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 324s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3520098825,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":254860,"num_read_kb":981902,"num_write":248338,"num_write_kb":992873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"150'255413","reported_seq":506053,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:11:21.187466+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:11:21.187466+0000","last_peered":"2023-10-14T01:11:21.187466+0000","last_clean":"2023-10-14T01:11:21.187466+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:11:21.187466+0000","last_undegraded":"2023-10-14T01:11:21.187466+0000","last_fullsized":"2023-10-14T01:11:21.187466+0000","mapping_epoch":13,"log_start":"146'245411","ondisk_log_start":"146'245411","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1508,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 325s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3562664254,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":252409,"num_read_kb":987462,"num_write":250873,"num_write_kb":1003331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"150'256763","reported_seq":509473,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:11:21.145746+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:11:21.145746+0000","last_peered":"2023-10-14T01:11:21.145746+0000","last_clean":"2023-10-14T01:11:21.145746+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:11:21.145746+0000","last_undegraded":"2023-10-14T01:11:21.145746+0000","last_fullsized":"2023-10-14T01:11:21.145746+0000","mapping_epoch":13,"log_start":"146'246716","ondisk_log_start":"146'246716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1616,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 326s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3593470503,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":254280,"num_read_kb":996136,"num_write":252126,"num_write_kb":1008367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"150'290884","reported_seq":562900,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:21.295499+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:11:21.295499+0000","last_peered":"2023-10-14T01:11:21.295499+0000","last_clean":"2023-10-14T01:11:21.295499+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:11:21.295499+0000","last_undegraded":"2023-10-14T01:11:21.295499+0000","last_fullsized":"2023-10-14T01:11:21.295499+0000","mapping_epoch":13,"log_start":"146'280816","ondisk_log_start":"146'280816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3750539753,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":275570,"num_read_kb":1051890,"num_write":265582,"num_write_kb":1061673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":313,"reported_epoch":149,"state":"active+clean","last_fresh":"2023-10-14T01:10:00.320244+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:10:00.320244+0000","last_peered":"2023-10-14T01:10:00.320244+0000","last_clean":"2023-10-14T01:10:00.320244+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:10:00.320244+0000","last_undegraded":"2023-10-14T01:10:00.320244+0000","last_fullsized":"2023-10-14T01:10:00.320244+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28431691699,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2045325,"num_read_kb":7921445,"num_write":2000986,"num_write_kb":8001133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384847872,"data_stored":28957339494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80343,"ondisk_log_size":80343,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739222,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4691080,"kb_used_data":3074368,"kb_used_omap":494,"kb_used_meta":1616209,"kb_avail":89680760,"statfs":{"total":96636764160,"available":91833098240,"internally_reserved":0,"allocated":3148152832,"data_stored":5538102309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1654998787},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,3,2,8,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.97599999999999998,"15min":0.97099999999999997},"min":{"1min":0.246,"5min":0.192,"15min":0.183},"max":{"1min":1.0009999999999999,"5min":6.4359999999999999,"15min":8.5800000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":1.038,"15min":1.024},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.25},"max":{"1min":1.04,"5min":6.4720000000000004,"15min":8.6140000000000008},"last":0.42099999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:10:31 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.54400000000000004,"15min":0.78100000000000003},"min":{"1min":0.23999999999999999,"5min":0.20100000000000001,"15min":0.183},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":11.999000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":1.1299999999999999,"15min":1.0980000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":4.4660000000000002,"5min":11.082000000000001,"15min":16.649000000000001},"last":0.29099999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739209,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9833112,"kb_used_data":8002640,"kb_used_omap":1526,"kb_used_meta":1828937,"kb_avail":84538728,"statfs":{"total":96636764160,"available":86567657472,"internally_reserved":0,"allocated":8194703360,"data_stored":14480681130,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1562916,"internal_metadata":1872832220},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,9,5,3,3,11,14,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":1.0620000000000001},"min":{"1min":0.248,"5min":0.154,"15min":0.154},"max":{"1min":6.851,"5min":12.933,"15min":22.082999999999998},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.41399999999999998,"5min":1.109,"15min":1.387},"min":{"1min":0.249,"5min":0.187,"15min":0.187},"max":{"1min":1.333,"5min":14.656000000000001,"15min":39.978999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:11:18 2023","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":1.1399999999999999,"15min":1.206},"min":{"1min":0.28899999999999998,"5min":0.183,"15min":0.183},"max":{"1min":9.8510000000000009,"5min":9.8510000000000009,"15min":11.945},"last":0.42399999999999999},{"interface":"front","average":{"1min":1.0900000000000001,"5min":0.57999999999999996,"15min":0.73499999999999999},"min":{"1min":0.221,"5min":0.186,"15min":0.186},"max":{"1min":6.9119999999999999,"5min":6.9119999999999999,"15min":8.3170000000000002},"last":0.44400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739221,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6616852,"kb_used_data":4926796,"kb_used_omap":866,"kb_used_meta":1689181,"kb_avail":87754988,"statfs":{"total":96636764160,"available":89861107712,"internally_reserved":0,"allocated":5045039104,"data_stored":8940266332,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":886870,"internal_metadata":1729722282},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,4,6,1,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:10:19 2023","interfaces":[{"interface":"back","average":{"1min":3.0209999999999999,"5min":1.335,"15min":1.0129999999999999},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.16400000000000001},"max":{"1min":25.927,"5min":25.927,"15min":25.927},"last":0.42099999999999999},{"interface":"front","average":{"1min":3.0470000000000002,"5min":1.623,"15min":1.1739999999999999},"min":{"1min":0.22500000000000001,"5min":0.19500000000000001,"15min":0.187},"max":{"1min":26.632999999999999,"5min":26.632999999999999,"15min":26.632999999999999},"last":0.46200000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:10:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":0.79100000000000004,"15min":0.79700000000000004},"min":{"1min":0.214,"5min":0.214,"15min":0.191},"max":{"1min":7.734,"5min":7.734,"15min":10.106},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.91700000000000004,"15min":1.0740000000000001},"min":{"1min":0.24199999999999999,"5min":0.214,"15min":0.21299999999999999},"max":{"1min":4.423,"5min":8.7379999999999995,"15min":16.913},"last":0.33200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5043974144,"data_stored":8939469413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8193761280,"data_stored":14480007091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3147112448,"data_stored":5537862990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:11:23.966 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:23.967 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:23.967 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:23.968 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:23.968 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:23.968 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:23.969 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:23.969 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:23.970 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:23.970 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:11:25.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:25.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:25.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:25.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:25.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:25.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:25.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.160+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:25.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.160+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:25.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:11:25.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:25.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:25.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:25.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:25.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:25.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:25.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:25.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:27.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:27.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:27.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:27.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:27.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:27.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:27.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:27.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:27.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.268+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:27.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.280+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:27.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:27.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:27.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:27.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:27.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:27.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:27.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:27.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:27.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.852+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:27.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.852+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:27.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.852+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:27.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:27.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:27.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:28.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:28.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:28.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:28.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:28.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:28.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:28.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:28.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:28.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:28.984+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:29.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:29.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:29.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:29.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:29.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:29.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:29.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:29.032+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:29.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:29.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:29.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:29.032+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:31.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:31.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:31.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:31.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:31.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:31.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:31.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:31.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:31.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:31.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.099+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:31.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:31.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:31.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:31.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:31.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:31.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:31.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.523+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:31.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.571+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:31.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:31.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:31.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:32.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:11:32.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:32.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:32.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:32.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:32.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:32.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:32.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:32.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:32.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:32.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.623+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:32.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:32.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:32.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:33.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:11:33.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:33.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:33.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:33.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:33.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:33.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:33.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:33.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.335+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:33.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.367+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:33.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:33.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:33.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:11:33.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:33.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:33.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:33.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:33.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:33.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:33.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:33.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:33.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:33.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.739+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:33.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:33.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:33.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:33.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:11:33.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:11:33.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:33.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:33.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:33.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:33.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:33.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:33.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:33.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:33.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.883+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:33.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.883+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:33.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.887+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:33.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:11:33.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:11:33.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:33.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:33.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:33.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:33.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:33.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:33.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:33.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:33.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:33.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:33.979+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:38.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:38.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:38.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:38.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:38.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:38.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:38.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:38.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:38.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:38.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:38.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:38.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:38.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:38.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:38.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:38.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:38.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:38.415+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:38.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:38.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:38.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:38.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:38.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:38.439+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:39.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:39.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:39.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:39.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:39.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:39.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:39.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:39.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:39.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:39.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:39.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:39.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:39.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:39.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:39.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:39.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:39.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:39.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:39.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:39.619+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:39.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:39.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:39.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:39.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:43.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:43.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:43.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:43.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:43.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:43.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:43.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:43.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:43.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:43.639+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:43.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:43.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:43.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:43.687+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:43.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:43.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:43.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:43.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:43.971 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:11:44.062 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:11:44.059+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:11:44.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:44.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:44.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:44.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:44.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:44.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:44.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:44.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:44.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:44.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:44.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:44.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:44.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:44.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:44.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:44.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:44.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:44.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:44.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:44.471+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:44.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:44.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:44.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:44.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:44.877 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:11:44.878 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:11:44.956 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2297,"stamp":"2023-10-14T01:11:43.398180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28463309267,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2053449,"num_read_kb":7953516,"num_write":2009064,"num_write_kb":8034791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80489,"ondisk_log_size":80489,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21471572,"kb_used_data":16066288,"kb_used_omap":2886,"kb_used_meta":5402361,"kb_avail":261643948,"statfs":{"total":289910292480,"available":267923402752,"internally_reserved":0,"allocated":16451878912,"data_stored":29023033387,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2955895,"internal_metadata":5532018057},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,3,2,7,8,10,12,6,8,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20385792,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5262,"num_read_kb":20980,"num_write":5223,"num_write_kb":20892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005367"},"pg_stats":[{"pgid":"2.7","version":"150'257463","reported_seq":504796,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:41.993610+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:11:41.993610+0000","last_peered":"2023-10-14T01:11:41.993610+0000","last_clean":"2023-10-14T01:11:41.993610+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:11:41.993610+0000","last_undegraded":"2023-10-14T01:11:41.993610+0000","last_fullsized":"2023-10-14T01:11:41.993610+0000","mapping_epoch":13,"log_start":"146'247417","ondisk_log_start":"146'247417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3462488600,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":249879,"num_read_kb":967212,"num_write":243683,"num_write_kb":974385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"150'271159","reported_seq":534423,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:41.966067+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:11:41.966067+0000","last_peered":"2023-10-14T01:11:41.966067+0000","last_clean":"2023-10-14T01:11:41.966067+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:11:41.966067+0000","last_undegraded":"2023-10-14T01:11:41.966067+0000","last_fullsized":"2023-10-14T01:11:41.966067+0000","mapping_epoch":13,"log_start":"147'261116","ondisk_log_start":"147'261116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3661889754,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":267311,"num_read_kb":1025844,"num_write":257387,"num_write_kb":1029077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"150'252451","reported_seq":497022,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:41.942479+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:11:41.942479+0000","last_peered":"2023-10-14T01:11:41.942479+0000","last_clean":"2023-10-14T01:11:41.942479+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:11:41.942479+0000","last_undegraded":"2023-10-14T01:11:41.942479+0000","last_fullsized":"2023-10-14T01:11:41.942479+0000","mapping_epoch":13,"log_start":"146'242423","ondisk_log_start":"146'242423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3439514304,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":246879,"num_read_kb":959319,"num_write":242632,"num_write_kb":970218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"150'250052","reported_seq":496200,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:41.966324+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:11:41.966324+0000","last_peered":"2023-10-14T01:11:41.966324+0000","last_clean":"2023-10-14T01:11:41.966324+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:11:41.966324+0000","last_undegraded":"2023-10-14T01:11:41.966324+0000","last_fullsized":"2023-10-14T01:11:41.966324+0000","mapping_epoch":13,"log_start":"146'240017","ondisk_log_start":"146'240017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3456365226,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":248126,"num_read_kb":967580,"num_write":244294,"num_write_kb":976925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"150'254671","reported_seq":507988,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:11:38.982116+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:11:38.982116+0000","last_peered":"2023-10-14T01:11:38.982116+0000","last_clean":"2023-10-14T01:11:38.982116+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:11:38.982116+0000","last_undegraded":"2023-10-14T01:11:38.982116+0000","last_fullsized":"2023-10-14T01:11:38.982116+0000","mapping_epoch":13,"log_start":"147'244623","ondisk_log_start":"147'244623","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1457,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 344s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3524129289,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":255854,"num_read_kb":985870,"num_write":249362,"num_write_kb":996969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"150'256484","reported_seq":508100,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:11:41.471083+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:11:41.471083+0000","last_peered":"2023-10-14T01:11:41.471083+0000","last_clean":"2023-10-14T01:11:41.471083+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:11:41.471083+0000","last_undegraded":"2023-10-14T01:11:41.471083+0000","last_fullsized":"2023-10-14T01:11:41.471083+0000","mapping_epoch":13,"log_start":"147'246411","ondisk_log_start":"147'246411","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1645,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 345s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3566424382,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":253376,"num_read_kb":991314,"num_write":251835,"num_write_kb":1007179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"150'257844","reported_seq":511591,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:11:41.467878+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:11:41.467878+0000","last_peered":"2023-10-14T01:11:41.467878+0000","last_clean":"2023-10-14T01:11:41.467878+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:11:41.467878+0000","last_undegraded":"2023-10-14T01:11:41.467878+0000","last_fullsized":"2023-10-14T01:11:41.467878+0000","mapping_epoch":13,"log_start":"147'247816","ondisk_log_start":"147'247816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1708,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 346s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3597406759,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":255308,"num_read_kb":1000240,"num_write":253129,"num_write_kb":1012379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"150'292007","reported_seq":565088,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:11:41.957412+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:11:41.957412+0000","last_peered":"2023-10-14T01:11:41.957412+0000","last_clean":"2023-10-14T01:11:41.957412+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:11:41.957412+0000","last_undegraded":"2023-10-14T01:11:41.957412+0000","last_fullsized":"2023-10-14T01:11:41.957412+0000","mapping_epoch":13,"log_start":"148'281916","ondisk_log_start":"148'281916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3754500585,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":276610,"num_read_kb":1056046,"num_write":266605,"num_write_kb":1065765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:10:59.965516+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:10:59.965516+0000","last_peered":"2023-10-14T01:10:59.965516+0000","last_clean":"2023-10-14T01:10:59.965516+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:10:59.965516+0000","last_undegraded":"2023-10-14T01:10:59.965516+0000","last_fullsized":"2023-10-14T01:10:59.965516+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28462718899,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2053343,"num_read_kb":7953425,"num_write":2008927,"num_write_kb":8032897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16449613824,"data_stored":29022105446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":63254,"internal_metadata":0},"log_size":80392,"ondisk_log_size":80392,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739226,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4757236,"kb_used_data":3086380,"kb_used_omap":494,"kb_used_meta":1670353,"kb_avail":89614604,"statfs":{"total":96636764160,"available":91765354496,"internally_reserved":0,"allocated":3160453120,"data_stored":5550402597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1710442243},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,0,4,3,2,3,1,8,1],"upper_bound":1024},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.998,"15min":0.98599999999999999},"min":{"1min":0.29199999999999998,"5min":0.192,"15min":0.183},"max":{"1min":3.714,"5min":6.4359999999999999,"15min":8.5800000000000001},"last":2.1960000000000002},{"interface":"front","average":{"1min":0.871,"5min":1.0609999999999999,"15min":1.038},"min":{"1min":0.33200000000000002,"5min":0.26200000000000001,"15min":0.25},"max":{"1min":3.7450000000000001,"5min":6.4720000000000004,"15min":8.6140000000000008},"last":2.2309999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.77100000000000002},"min":{"1min":0.23400000000000001,"5min":0.20100000000000001,"15min":0.183},"max":{"1min":2.206,"5min":4.6390000000000002,"15min":11.999000000000001},"last":0.247},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.1020000000000001,"15min":1.107},"min":{"1min":0.29099999999999998,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":3.4700000000000002,"5min":11.082000000000001,"15min":16.649000000000001},"last":0.28699999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739213,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10001612,"kb_used_data":8033596,"kb_used_omap":1526,"kb_used_meta":1966473,"kb_avail":84370228,"statfs":{"total":96636764160,"available":86395113472,"internally_reserved":0,"allocated":8226402304,"data_stored":14512380074,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1562916,"internal_metadata":2013669084},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,2,1,5,7,7,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":1.0620000000000001},"min":{"1min":0.248,"5min":0.154,"15min":0.154},"max":{"1min":6.851,"5min":12.933,"15min":22.082999999999998},"last":3.488},{"interface":"front","average":{"1min":0.41399999999999998,"5min":1.109,"15min":1.387},"min":{"1min":0.249,"5min":0.187,"15min":0.187},"max":{"1min":1.333,"5min":14.656000000000001,"15min":39.978999999999999},"last":3.8959999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:11:18 2023","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":1.1399999999999999,"15min":1.206},"min":{"1min":0.28899999999999998,"5min":0.183,"15min":0.183},"max":{"1min":9.8510000000000009,"5min":9.8510000000000009,"15min":11.945},"last":0.35699999999999998},{"interface":"front","average":{"1min":1.0900000000000001,"5min":0.57999999999999996,"15min":0.73499999999999999},"min":{"1min":0.221,"5min":0.186,"15min":0.186},"max":{"1min":6.9119999999999999,"5min":6.9119999999999999,"15min":8.3170000000000002},"last":0.315}]}]},{"osd":0,"up_from":8,"seq":34359739225,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6712724,"kb_used_data":4946312,"kb_used_omap":866,"kb_used_meta":1765533,"kb_avail":87659116,"statfs":{"total":96636764160,"available":89762934784,"internally_reserved":0,"allocated":5065023488,"data_stored":8960250716,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":886870,"internal_metadata":1807906730},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,0,1,2,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.286,"15min":1.042},"min":{"1min":0.28199999999999997,"5min":0.17899999999999999,"15min":0.16400000000000001},"max":{"1min":5.3540000000000001,"5min":25.927,"15min":25.927},"last":0.33700000000000002},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.526,"15min":1.1899999999999999},"min":{"1min":0.26500000000000001,"5min":0.20300000000000001,"15min":0.187},"max":{"1min":5.3559999999999999,"5min":26.632999999999999,"15min":26.632999999999999},"last":0.36299999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.78000000000000003,"15min":0.82899999999999996},"min":{"1min":0.22,"5min":0.214,"15min":0.191},"max":{"1min":8.5559999999999992,"5min":8.5559999999999992,"15min":10.106},"last":0.26800000000000002},{"interface":"front","average":{"1min":1.0569999999999999,"5min":0.89800000000000002,"15min":1.093},"min":{"1min":0.254,"5min":0.221,"15min":0.21299999999999999},"max":{"1min":5.4020000000000001,"5min":5.4020000000000001,"15min":16.913},"last":1.776}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5063987200,"data_stored":8959482469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8226361344,"data_stored":14512607155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31656,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3159265280,"data_stored":5550015822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:11:44.957 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:44.958 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:44.958 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:44.959 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:44.959 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:44.959 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:44.960 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:44.960 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:44.960 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:11:44.961 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:11:45.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:11:45.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:45.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:45.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:45.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:45.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:45.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:45.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:45.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:45.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.159+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:45.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.167+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:45.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:45.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:45.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:45.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:45.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:45.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:45.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:45.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:45.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:45.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:45.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:47.540 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:11:47.539+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:11:47.958 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:11:47.955+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:11:47.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:47.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:11:48.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:48.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:48.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:48.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:48.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:48.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:48.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:48.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:48.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:48.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:48.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:48.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:48.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:48.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:48.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:48.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:48.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:48.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:48.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:48.087+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:48.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:48.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:48.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:48.091+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:49.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:49.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:49.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:49.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:49.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:49.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:49.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:49.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:49.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:49.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:49.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:49.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:51.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:51.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:51.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:51.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:51.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:51.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:51.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:51.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:51.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:51.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:51.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:51.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:51.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:51.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:51.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:51.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:51.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:51.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:51.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:51.459+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:51.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:51.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:51.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:51.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:53.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:53.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:53.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:53.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:53.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:53.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:53.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:53.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:53.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:53.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:53.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:53.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:53.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:53.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:53.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:53.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:53.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:53.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:53.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:53.599+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:53.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:53.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:53.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:53.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:54.142 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:11:54.139+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:11:55.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:55.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:55.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:55.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:55.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:55.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.483+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:55.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:55.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:11:55.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:55.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:55.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:55.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:55.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:55.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:55.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:55.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:55.583+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:56.390 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:11:56.387+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:11:58.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:58.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:11:58.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:58.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:58.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:58.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:58.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:58.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:58.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:58.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:58.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:58.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:58.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:58.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:58.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:58.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:58.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:58.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:59.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:59.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.063+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:59.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:59.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:59.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:11:59.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:59.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:59.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:59.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:59.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:59.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:59.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:59.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:11:59.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:59.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:11:59.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:11:59.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:11:59.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:11:59.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.959+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:11:59.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.971+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:11:59.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:11:59.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:11:59.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:11:59.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:11:59.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:11:59.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:11:59.983+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:01.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:01.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:01.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:01.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:01.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:01.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:01.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:01.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:01.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:01.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:01.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:01.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:01.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:01.291+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:01.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:01.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:01.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:01.315+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:02.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:02.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:02.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:02.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:02.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:02.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:02.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:02.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.287+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:02.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:02.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:02.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:02.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:02.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:02.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:02.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:02.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:02.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:02.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:02.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:02.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:02.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:02.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:02.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:02.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.723+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:02.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:02.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:02.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:02.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:02.875+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:04.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:04.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:04.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:04.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:04.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:04.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:04.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:04.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:04.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:04.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:04.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:04.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:04.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:04.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:04.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:04.962 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:12:05.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:05.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:05.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:05.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:05.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:05.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:05.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:05.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:05.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:05.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:05.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:05.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:05.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:05.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:05.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:05.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:05.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:05.739+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:05.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:05.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:05.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:05.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:05.767 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:12:05.768 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:12:05.829 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2308,"stamp":"2023-10-14T01:12:05.401888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28494606803,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2061648,"num_read_kb":7986176,"num_write":2017095,"num_write_kb":8066915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80461,"ondisk_log_size":80461,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20582552,"kb_used_data":16134016,"kb_used_omap":2876,"kb_used_meta":4445635,"kb_avail":262532968,"statfs":{"total":289910292480,"available":268833759232,"internally_reserved":0,"allocated":16521232384,"data_stored":29092386859,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2945032,"internal_metadata":4552331256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,4,9,8,15,23,7],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16175104,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4245,"num_read_kb":16896,"num_write":4142,"num_write_kb":16568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002066"},"pg_stats":[{"pgid":"2.7","version":"150'258465","reported_seq":506787,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:12:02.556035+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:12:02.556035+0000","last_peered":"2023-10-14T01:12:02.556035+0000","last_clean":"2023-10-14T01:12:02.556035+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:12:02.556035+0000","last_undegraded":"2023-10-14T01:12:02.556035+0000","last_fullsized":"2023-10-14T01:12:02.556035+0000","mapping_epoch":13,"log_start":"148'248417","ondisk_log_start":"148'248417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3466244632,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":250855,"num_read_kb":971096,"num_write":244631,"num_write_kb":978177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"150'272219","reported_seq":536543,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:12:02.517538+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:12:02.517538+0000","last_peered":"2023-10-14T01:12:02.517538+0000","last_clean":"2023-10-14T01:12:02.517538+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:12:02.517538+0000","last_undegraded":"2023-10-14T01:12:02.517538+0000","last_fullsized":"2023-10-14T01:12:02.517538+0000","mapping_epoch":13,"log_start":"148'262216","ondisk_log_start":"148'262216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3665842394,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":268356,"num_read_kb":1030000,"num_write":258399,"num_write_kb":1033125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"150'253408","reported_seq":498972,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:12:02.497421+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:12:02.497421+0000","last_peered":"2023-10-14T01:12:02.497421+0000","last_clean":"2023-10-14T01:12:02.497421+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:12:02.497421+0000","last_undegraded":"2023-10-14T01:12:02.497421+0000","last_fullsized":"2023-10-14T01:12:02.497421+0000","mapping_epoch":13,"log_start":"148'243323","ondisk_log_start":"148'243323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3443040960,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":247863,"num_read_kb":963251,"num_write":243555,"num_write_kb":973910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"150'251031","reported_seq":498135,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:12:02.464882+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:12:02.464882+0000","last_peered":"2023-10-14T01:12:02.464882+0000","last_clean":"2023-10-14T01:12:02.464882+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:12:02.464882+0000","last_undegraded":"2023-10-14T01:12:02.464882+0000","last_fullsized":"2023-10-14T01:12:02.464882+0000","mapping_epoch":13,"log_start":"147'241017","ondisk_log_start":"147'241017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3460113066,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":249078,"num_read_kb":971372,"num_write":245257,"num_write_kb":980777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"150'255977","reported_seq":510543,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:12:04.218272+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:12:04.218272+0000","last_peered":"2023-10-14T01:12:04.218272+0000","last_clean":"2023-10-14T01:12:04.218272+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:12:04.218272+0000","last_undegraded":"2023-10-14T01:12:04.218272+0000","last_fullsized":"2023-10-14T01:12:04.218272+0000","mapping_epoch":13,"log_start":"148'245923","ondisk_log_start":"148'245923","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1620,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 369s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3528823305,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":257070,"num_read_kb":990718,"num_write":250547,"num_write_kb":1001709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"150'257552","reported_seq":510213,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:12:01.689472+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:12:01.689472+0000","last_peered":"2023-10-14T01:12:01.689472+0000","last_clean":"2023-10-14T01:12:01.689472+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:12:01.689472+0000","last_undegraded":"2023-10-14T01:12:01.689472+0000","last_fullsized":"2023-10-14T01:12:01.689472+0000","mapping_epoch":13,"log_start":"148'247512","ondisk_log_start":"148'247512","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1740,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 366s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3570282814,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":254405,"num_read_kb":995398,"num_write":252821,"num_write_kb":1011123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"150'258897","reported_seq":513634,"reported_epoch":150,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:12:01.687712+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:12:01.687712+0000","last_peered":"2023-10-14T01:12:01.687712+0000","last_clean":"2023-10-14T01:12:01.687712+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:12:01.687712+0000","last_undegraded":"2023-10-14T01:12:01.687712+0000","last_fullsized":"2023-10-14T01:12:01.687712+0000","mapping_epoch":13,"log_start":"148'248816","ondisk_log_start":"148'248816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1825,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 367s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3601142311,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":256280,"num_read_kb":1004116,"num_write":254087,"num_write_kb":1016211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"150'293155","reported_seq":567284,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:12:02.482553+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:12:02.482553+0000","last_peered":"2023-10-14T01:12:02.482553+0000","last_clean":"2023-10-14T01:12:02.482553+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:12:02.482553+0000","last_undegraded":"2023-10-14T01:12:02.482553+0000","last_fullsized":"2023-10-14T01:12:02.482553+0000","mapping_epoch":13,"log_start":"148'283116","ondisk_log_start":"148'283116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3758526953,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":277635,"num_read_kb":1060134,"num_write":267661,"num_write_kb":1069989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-14T01:10:59.965516+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:10:59.965516+0000","last_peered":"2023-10-14T01:10:59.965516+0000","last_clean":"2023-10-14T01:10:59.965516+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:10:59.965516+0000","last_undegraded":"2023-10-14T01:10:59.965516+0000","last_fullsized":"2023-10-14T01:10:59.965516+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28494016435,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2061542,"num_read_kb":7986085,"num_write":2016958,"num_write_kb":8065021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16518213632,"data_stored":29090705254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80364,"ondisk_log_size":80364,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739230,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4801148,"kb_used_data":3098356,"kb_used_omap":494,"kb_used_meta":1702289,"kb_avail":89570692,"statfs":{"total":96636764160,"available":91720388608,"internally_reserved":0,"allocated":3172716544,"data_stored":5562666021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1743144707},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,1,5,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.998,"15min":0.98599999999999999},"min":{"1min":0.29199999999999998,"5min":0.192,"15min":0.183},"max":{"1min":3.714,"5min":6.4359999999999999,"15min":8.5800000000000001},"last":0.186},{"interface":"front","average":{"1min":0.871,"5min":1.0609999999999999,"15min":1.038},"min":{"1min":0.33200000000000002,"5min":0.26200000000000001,"15min":0.25},"max":{"1min":3.7450000000000001,"5min":6.4720000000000004,"15min":8.6140000000000008},"last":0.34799999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.77100000000000002},"min":{"1min":0.23400000000000001,"5min":0.20100000000000001,"15min":0.183},"max":{"1min":2.206,"5min":4.6390000000000002,"15min":11.999000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.1020000000000001,"15min":1.107},"min":{"1min":0.29099999999999998,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":3.4700000000000002,"5min":11.082000000000001,"15min":16.649000000000001},"last":0.38100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739217,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8976964,"kb_used_data":8065852,"kb_used_omap":1515,"kb_used_meta":909588,"kb_avail":85394876,"statfs":{"total":96636764160,"available":87444353024,"internally_reserved":0,"allocated":8259432448,"data_stored":14545410218,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1552053,"internal_metadata":931418443},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,6,6,8,12,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:11:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78300000000000003,"15min":1.0620000000000001},"min":{"1min":0.248,"5min":0.154,"15min":0.154},"max":{"1min":6.851,"5min":12.933,"15min":22.082999999999998},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":1.109,"15min":1.387},"min":{"1min":0.249,"5min":0.187,"15min":0.187},"max":{"1min":1.333,"5min":14.656000000000001,"15min":39.978999999999999},"last":0.432}]},{"osd":2,"last update":"Sat Oct 14 01:11:18 2023","interfaces":[{"interface":"back","average":{"1min":1.7589999999999999,"5min":1.1399999999999999,"15min":1.206},"min":{"1min":0.28899999999999998,"5min":0.183,"15min":0.183},"max":{"1min":9.8510000000000009,"5min":9.8510000000000009,"15min":11.945},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":0.57999999999999996,"15min":0.73499999999999999},"min":{"1min":0.221,"5min":0.186,"15min":0.186},"max":{"1min":6.9119999999999999,"5min":6.9119999999999999,"15min":8.3170000000000002},"last":0.23899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739230,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6804440,"kb_used_data":4969808,"kb_used_omap":866,"kb_used_meta":1833757,"kb_avail":87567400,"statfs":{"total":96636764160,"available":89669017600,"internally_reserved":0,"allocated":5089083392,"data_stored":8984310620,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":886870,"internal_metadata":1877768106},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,1,2,8,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:11:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.286,"15min":1.042},"min":{"1min":0.28199999999999997,"5min":0.17899999999999999,"15min":0.16400000000000001},"max":{"1min":5.3540000000000001,"5min":25.927,"15min":25.927},"last":0.26800000000000002},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.526,"15min":1.1899999999999999},"min":{"1min":0.26500000000000001,"5min":0.20300000000000001,"15min":0.187},"max":{"1min":5.3559999999999999,"5min":26.632999999999999,"15min":26.632999999999999},"last":0.33700000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:11:23 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.78000000000000003,"15min":0.82899999999999996},"min":{"1min":0.22,"5min":0.214,"15min":0.191},"max":{"1min":8.5559999999999992,"5min":8.5559999999999992,"15min":10.106},"last":0.379},{"interface":"front","average":{"1min":1.0569999999999999,"5min":0.89800000000000002,"15min":1.093},"min":{"1min":0.254,"5min":0.221,"15min":0.21299999999999999},"max":{"1min":5.4020000000000001,"5min":5.4020000000000001,"15min":16.913},"last":0.36599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5088104448,"data_stored":8983599717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8258551808,"data_stored":14544797619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3171557376,"data_stored":5562307918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:12:05.830 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:05.831 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:05.831 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:05.831 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:05.832 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:05.832 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:05.833 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:05.833 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:05.833 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:05.834 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T01:12:06.546 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T01:12:06.649 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:12:07.562 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:12:07.627 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T01:12:08.454 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T01:12:08.501 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T01:12:08.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:08.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:08.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:08.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:08.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:08.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:08.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:08.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:08.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:08.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:08.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:08.675+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:08.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:08.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:08.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:08.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:09.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:09.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:09.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:09.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:09.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:09.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:09.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:09.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:09.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:09.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:09.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:09.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:09.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:09.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:09.360 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T01:12:09.421 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-10-14T01:12:10.222 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-10-14T01:12:10.297 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.1 2023-10-14T01:12:10.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:10.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:10.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:10.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:10.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:10.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:10.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:10.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:10.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:10.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.467+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:10.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:10.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:10.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:10.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:10.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:10.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:10.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:10.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:10.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:10.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:10.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:10.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:11.334 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.1 on osd.2 to deep-scrub 2023-10-14T01:12:11.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:11.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:11.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:11.404 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.0 2023-10-14T01:12:11.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:11.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:11.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:11.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:11.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.427+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:11.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:11.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:11.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:11.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:12:11.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:12:11.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:11.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:11.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:11.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:11.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:11.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:11.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:11.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:11.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:11.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.979+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:11.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:11.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:11.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:12.298 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.0 on osd.2 to deep-scrub 2023-10-14T01:12:12.398 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T01:12:12.582 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:12:12.579+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:12:13.202 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T01:12:13.277 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-10-14T01:12:14.217 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-10-14T01:12:14.285 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:12:14.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:12:14.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:14.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:14.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:14.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:14.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:14.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:14.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:14.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:14.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:14.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.867+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:14.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:14.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:14.867+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:15.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:15.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:15.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:15.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:15.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.067+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:15.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:15.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:15.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:15.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:15.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.083+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:15.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:15.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:15.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:15.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:15.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:15.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:15.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:15.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:15.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:15.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:15.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.443+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:15.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:15.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:15.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:15.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:15.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:15.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:15.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:15.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:15.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:15.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.671+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:15.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:15.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:15.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:17.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:12:17.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:17.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:17.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:17.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:17.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:17.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:17.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:17.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:17.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:17.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.943+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:17.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:17.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:17.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:18.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:18.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:18.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:18.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:18.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:18.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:18.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:18.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:18.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:18.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.699+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:18.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:18.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:18.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:18.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:18.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:18.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:18.831+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:21.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:21.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:21.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:21.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:21.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:21.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:21.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:21.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:21.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:21.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:21.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:21.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:21.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:21.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:21.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:21.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:21.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:21.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:21.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:21.431+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:21.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:21.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:21.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:21.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:23.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:23.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:23.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:23.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:23.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:23.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:23.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:23.171+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:23.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:23.171+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:23.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:23.171+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:23.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:23.171+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:23.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:23.171+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:24.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:24.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:24.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:24.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:24.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:24.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:24.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:24.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:24.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:24.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.459+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:24.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:24.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:24.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:24.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:24.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.499+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:24.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:24.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:24.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:24.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:24.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:24.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.571+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:24.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:24.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:24.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:25.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:12:25.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:25.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:25.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:25.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:25.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:25.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:25.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:25.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:25.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:25.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.223+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:25.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:25.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:25.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:25.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:25.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:25.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:25.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:25.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:25.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:25.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:25.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.383+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:25.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.391+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:25.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.391+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:25.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:25.391+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:26.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:26.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:26.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:26.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:26.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:26.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:26.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:26.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:26.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:26.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:26.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:26.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:26.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:26.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:26.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:26.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:26.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:26.199+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:26.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:26.219+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:26.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:26.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:26.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:26.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:27.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:27.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:12:28.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:12:28.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:28.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:28.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:28.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:28.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:28.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:28.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:28.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:28.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:28.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.139+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:28.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.139+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:28.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:28.139+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:29.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:29.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:29.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:29.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:29.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:29.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:29.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:29.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:29.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:29.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:29.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:29.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:29.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:29.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:29.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:29.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:29.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:29.763+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:29.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:29.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:29.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:29.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:32.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:32.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:12:32.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:32.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:12:32.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:32.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:32.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:32.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:32.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:32.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:32.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:32.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:32.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:32.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:33.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:33.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:33.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:33.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:33.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:33.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:33.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:33.011+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:33.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:33.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:33.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:33.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:33.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:33.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:34.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:33.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:34.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:33.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:34.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:33.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:34.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:33.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:34.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:34.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:34.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.023+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:34.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.023+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:34.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:34.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:34.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:34.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:34.286 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:12:34.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:34.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:34.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:34.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:34.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:34.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:34.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.359+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:34.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:34.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:34.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:34.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:34.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:34.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:34.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:34.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.435+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:34.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:34.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.483+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:34.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:34.483+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:35.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:35.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:12:35.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:35.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:35.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:35.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:35.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:35.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:35.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:35.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:35.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.151+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:35.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:35.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:35.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:35.232 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:12:35.233 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:12:35.286 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2323,"stamp":"2023-10-14T01:12:33.417068+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28538868179,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2073235,"num_read_kb":8032320,"num_write":2028487,"num_write_kb":8112483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80492,"ondisk_log_size":80492,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21041140,"kb_used_data":16222168,"kb_used_omap":2876,"kb_used_meta":4816067,"kb_avail":262074380,"statfs":{"total":289910292480,"available":268364165120,"internally_reserved":0,"allocated":16611500032,"data_stored":29182642810,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2945032,"internal_metadata":4931653624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,2,10,11,8,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22245376,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5843,"num_read_kb":23256,"num_write":5729,"num_write_kb":22916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004705"},"pg_stats":[{"pgid":"2.7","version":"151'259989","reported_seq":509780,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:33.304583+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:12:33.304583+0000","last_peered":"2023-10-14T01:12:33.304583+0000","last_clean":"2023-10-14T01:12:33.304583+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:12:33.304583+0000","last_undegraded":"2023-10-14T01:12:33.304583+0000","last_fullsized":"2023-10-14T01:12:33.304583+0000","mapping_epoch":13,"log_start":"148'249917","ondisk_log_start":"148'249917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3471860248,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":252302,"num_read_kb":976848,"num_write":246071,"num_write_kb":983937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"151'273854","reported_seq":539708,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:33.336889+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:12:33.336889+0000","last_peered":"2023-10-14T01:12:33.336889+0000","last_clean":"2023-10-14T01:12:33.336889+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:12:33.336889+0000","last_undegraded":"2023-10-14T01:12:33.336889+0000","last_fullsized":"2023-10-14T01:12:33.336889+0000","mapping_epoch":13,"log_start":"148'263816","ondisk_log_start":"148'263816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3671929050,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":269867,"num_read_kb":1036012,"num_write":259949,"num_write_kb":1039325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"151'254881","reported_seq":501942,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:33.281184+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:12:33.281184+0000","last_peered":"2023-10-14T01:12:33.281184+0000","last_clean":"2023-10-14T01:12:33.281184+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:12:33.281184+0000","last_undegraded":"2023-10-14T01:12:33.281184+0000","last_fullsized":"2023-10-14T01:12:33.281184+0000","mapping_epoch":13,"log_start":"148'244823","ondisk_log_start":"148'244823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3448488640,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":249345,"num_read_kb":969143,"num_write":244970,"num_write_kb":979570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"151'252461","reported_seq":500960,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:33.312502+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:12:33.312502+0000","last_peered":"2023-10-14T01:12:33.312502+0000","last_clean":"2023-10-14T01:12:33.312502+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:12:33.312502+0000","last_undegraded":"2023-10-14T01:12:33.312502+0000","last_fullsized":"2023-10-14T01:12:33.312502+0000","mapping_epoch":13,"log_start":"148'242417","ondisk_log_start":"148'242417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3465454250,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":250464,"num_read_kb":976904,"num_write":246658,"num_write_kb":986381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"151'257251","reported_seq":513084,"reported_epoch":151,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:12:29.406882+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:12:29.406882+0000","last_peered":"2023-10-14T01:12:29.406882+0000","last_clean":"2023-10-14T01:12:29.406882+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:12:29.406882+0000","last_undegraded":"2023-10-14T01:12:29.406882+0000","last_fullsized":"2023-10-14T01:12:29.406882+0000","mapping_epoch":13,"log_start":"148'247223","ondisk_log_start":"148'247223","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1708,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 394s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3533537801,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":258314,"num_read_kb":995670,"num_write":251746,"num_write_kb":1006505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"151'259163","reported_seq":513295,"reported_epoch":151,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:12:32.141825+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:12:32.141825+0000","last_peered":"2023-10-14T01:12:32.141825+0000","last_clean":"2023-10-14T01:12:32.141825+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:12:32.141825+0000","last_undegraded":"2023-10-14T01:12:32.141825+0000","last_fullsized":"2023-10-14T01:12:32.141825+0000","mapping_epoch":13,"log_start":"148'249112","ondisk_log_start":"148'249112","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1917,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 396s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3576045886,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":255855,"num_read_kb":1001162,"num_write":254291,"num_write_kb":1017003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"151'260396","reported_seq":516636,"reported_epoch":151,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:12:32.075503+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:12:32.075503+0000","last_peered":"2023-10-14T01:12:32.075503+0000","last_clean":"2023-10-14T01:12:32.075503+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:12:32.075503+0000","last_undegraded":"2023-10-14T01:12:32.075503+0000","last_fullsized":"2023-10-14T01:12:32.075503+0000","mapping_epoch":13,"log_start":"148'250316","ondisk_log_start":"148'250316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1943,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 397s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3606688295,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":257758,"num_read_kb":1010008,"num_write":255489,"num_write_kb":1021819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"151'294840","reported_seq":570596,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:33.311456+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:12:33.311456+0000","last_peered":"2023-10-14T01:12:33.311456+0000","last_clean":"2023-10-14T01:12:33.311456+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:12:33.311456+0000","last_undegraded":"2023-10-14T01:12:33.311456+0000","last_fullsized":"2023-10-14T01:12:33.311456+0000","mapping_epoch":13,"log_start":"148'284816","ondisk_log_start":"148'284816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3764273641,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":279224,"num_read_kb":1066482,"num_write":269176,"num_write_kb":1076049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":316,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:09.931530+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:12:09.931530+0000","last_peered":"2023-10-14T01:12:09.931530+0000","last_clean":"2023-10-14T01:12:09.931530+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:12:09.931530+0000","last_undegraded":"2023-10-14T01:12:09.931530+0000","last_fullsized":"2023-10-14T01:12:09.931530+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28538277811,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2073129,"num_read_kb":8032229,"num_write":2028350,"num_write_kb":8110589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16608317440,"data_stored":29180809062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80395,"ondisk_log_size":80395,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739236,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4896828,"kb_used_data":3115636,"kb_used_omap":494,"kb_used_meta":1780689,"kb_avail":89475012,"statfs":{"total":96636764160,"available":91622412288,"internally_reserved":0,"allocated":3190411264,"data_stored":5580356842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1823426307},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,2,2,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.998,"15min":0.98599999999999999},"min":{"1min":0.29199999999999998,"5min":0.192,"15min":0.183},"max":{"1min":3.714,"5min":6.4359999999999999,"15min":8.5800000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.871,"5min":1.0609999999999999,"15min":1.038},"min":{"1min":0.33200000000000002,"5min":0.26200000000000001,"15min":0.25},"max":{"1min":3.7450000000000001,"5min":6.4720000000000004,"15min":8.6140000000000008},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:11:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.59299999999999997,"15min":0.77100000000000002},"min":{"1min":0.23400000000000001,"5min":0.20100000000000001,"15min":0.183},"max":{"1min":2.206,"5min":4.6390000000000002,"15min":11.999000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.1020000000000001,"15min":1.107},"min":{"1min":0.29099999999999998,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":3.4700000000000002,"5min":11.082000000000001,"15min":16.649000000000001},"last":0.48999999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739223,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9208712,"kb_used_data":8112956,"kb_used_omap":1515,"kb_used_meta":1094228,"kb_avail":85163128,"statfs":{"total":96636764160,"available":87207043072,"internally_reserved":0,"allocated":8307666944,"data_stored":14593640815,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1552053,"internal_metadata":1120489803},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,8,6,6,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:12:19 2023","interfaces":[{"interface":"back","average":{"1min":1.671,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.26700000000000002,"5min":0.186,"15min":0.154},"max":{"1min":11.667,"5min":12.933,"15min":22.082999999999998},"last":0.25},{"interface":"front","average":{"1min":2.3180000000000001,"5min":1.3440000000000001,"15min":1.45},"min":{"1min":0.26300000000000001,"5min":0.187,"15min":0.187},"max":{"1min":9.0600000000000005,"5min":14.656000000000001,"15min":39.978999999999999},"last":0.38500000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:12:19 2023","interfaces":[{"interface":"back","average":{"1min":2.2370000000000001,"5min":1.4850000000000001,"15min":1.296},"min":{"1min":0.27000000000000002,"5min":0.183,"15min":0.183},"max":{"1min":9.6229999999999993,"5min":9.8510000000000009,"15min":11.945},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.67400000000000004,"15min":0.73799999999999999},"min":{"1min":0.23899999999999999,"5min":0.186,"15min":0.186},"max":{"1min":8.1430000000000007,"5min":8.1430000000000007,"15min":8.3170000000000002},"last":0.28699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739235,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6935600,"kb_used_data":4993576,"kb_used_omap":866,"kb_used_meta":1941149,"kb_avail":87436240,"statfs":{"total":96636764160,"available":89534709760,"internally_reserved":0,"allocated":5113421824,"data_stored":9008645153,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":886870,"internal_metadata":1987737514},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:12:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":1.349,"15min":1.0469999999999999},"min":{"1min":0.20300000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":4.6849999999999996,"5min":25.927,"15min":25.927},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.538,"15min":1.194},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.187},"max":{"1min":4.7249999999999996,"5min":26.632999999999999,"15min":26.632999999999999},"last":0.83099999999999996}]},{"osd":2,"last update":"Sat Oct 14 01:12:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.83199999999999996,"15min":0.85199999999999998},"min":{"1min":0.23300000000000001,"5min":0.214,"15min":0.191},"max":{"1min":3.6760000000000002,"5min":8.5559999999999992,"15min":10.106},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.89900000000000002,"15min":1.081},"min":{"1min":0.22,"5min":0.22,"15min":0.21299999999999999},"max":{"1min":3.3740000000000001,"5min":5.4020000000000001,"15min":16.913},"last":0.65100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5112455168,"data_stored":9007950437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8306458624,"data_stored":14592704435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3189403648,"data_stored":5580154190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:12:35.287 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:35.288 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:35.288 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:35.289 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:35.289 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:35.290 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:35.290 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:35.291 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:35.291 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:35.291 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:12:36.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:36.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:36.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:36.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:36.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:36.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:36.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:36.207+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:36.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:36.207+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:36.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:36.207+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:36.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:36.207+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:36.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:36.207+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:37.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:12:37.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:12:37.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:37.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:37.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:37.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:37.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:37.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:37.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:37.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:37.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:37.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.550+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:37.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:37.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:37.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:38.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:38.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:38.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:38.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:12:38.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:38.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:38.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:38.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:38.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:38.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:38.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:38.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:38.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:38.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:38.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:38.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:38.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:38.114+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:38.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:38.118+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:38.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:38.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:38.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:38.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:39.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:39.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:39.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:39.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:39.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:39.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:39.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:39.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:39.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:39.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:39.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:39.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:39.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:39.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:39.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:39.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:39.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:39.550+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:39.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:39.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:39.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:39.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:40.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:40.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:40.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:40.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:40.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:40.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:40.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:40.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:40.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:40.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:40.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:40.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:40.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:40.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:40.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:40.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:40.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:40.490+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:40.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:40.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:40.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:40.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:42.413 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:12:42.410+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:12:42.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:42.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:42.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:42.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:42.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:42.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:42.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:42.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:42.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:42.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:42.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:42.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:42.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:42.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:42.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:42.950+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:43.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:42.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:43.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.058+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:43.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:43.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:12:43.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:43.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:43.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:43.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:43.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:43.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:43.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:43.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.134+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:43.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.134+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:43.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.134+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:43.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:43.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:43.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:43.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:43.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:43.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:43.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:43.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:43.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:44.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:44.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:44.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:44.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:44.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:44.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:44.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:44.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:44.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:44.014+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:44.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:44.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:44.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:44.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:45.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:45.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:45.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:45.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:45.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:45.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:45.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:45.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:45.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:45.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:45.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:45.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:45.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:45.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:45.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:45.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:45.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:45.670+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:45.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:45.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:45.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:45.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:46.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:46.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:12:46.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:46.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:46.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:46.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:46.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:46.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:46.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:46.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:46.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.154+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:46.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:46.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:46.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:47.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:47.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:47.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:47.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:47.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:47.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:47.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:47.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.134+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:47.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:47.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.206+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:47.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:47.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:47.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:47.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:12:47.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:47.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:47.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:47.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:47.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:47.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:47.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:47.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:47.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.290+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:47.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:47.290+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:48.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:48.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:48.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:48.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:48.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:48.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:48.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:48.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:48.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:48.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.250+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:48.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:48.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:48.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:48.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:48.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:48.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:48.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:48.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:48.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:48.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:50.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:50.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:50.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:50.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:50.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:50.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:50.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:50.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:50.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:50.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:50.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:50.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:51.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:51.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:51.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:51.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:51.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:51.030+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:52.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:52.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:52.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:52.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:52.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:52.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:52.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:52.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:52.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:52.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:52.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:52.526+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:52.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:52.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:52.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:52.538+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:52.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:52.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:52.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:52.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:53.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:53.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:53.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:53.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:53.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:53.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:53.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:53.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:53.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:53.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.722+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:53.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:53.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:53.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:53.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:53.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:53.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:53.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:53.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:53.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:55.293 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:12:56.063 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:12:56.062+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:12:56.247 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:12:56.248 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:12:56.328 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2334,"stamp":"2023-10-14T01:12:55.426004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28570046931,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2081371,"num_read_kb":8064676,"num_write":2036490,"num_write_kb":8144495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80486,"ondisk_log_size":80486,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21336904,"kb_used_data":16288432,"kb_used_omap":2876,"kb_used_meta":5045571,"kb_avail":261778616,"statfs":{"total":289910292480,"available":268061302784,"internally_reserved":0,"allocated":16679354368,"data_stored":29250497146,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2945032,"internal_metadata":5166665720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,7,11,14,12,12,13],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20979712,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5520,"num_read_kb":21932,"num_write":5377,"num_write_kb":21508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003821"},"pg_stats":[{"pgid":"2.7","version":"151'260974","reported_seq":511731,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:53.705158+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:12:53.705158+0000","last_peered":"2023-10-14T01:12:53.705158+0000","last_clean":"2023-10-14T01:12:53.705158+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:12:53.705158+0000","last_undegraded":"2023-10-14T01:12:53.705158+0000","last_fullsized":"2023-10-14T01:12:53.705158+0000","mapping_epoch":13,"log_start":"148'250917","ondisk_log_start":"148'250917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3475464728,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":253257,"num_read_kb":980652,"num_write":246990,"num_write_kb":987613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"151'274956","reported_seq":541892,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:53.721619+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:12:53.721619+0000","last_peered":"2023-10-14T01:12:53.721619+0000","last_clean":"2023-10-14T01:12:53.721619+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:12:53.721619+0000","last_undegraded":"2023-10-14T01:12:53.721619+0000","last_fullsized":"2023-10-14T01:12:53.721619+0000","mapping_epoch":13,"log_start":"148'264916","ondisk_log_start":"148'264916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3676000474,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":270935,"num_read_kb":1040268,"num_write":260985,"num_write_kb":1043469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"151'255871","reported_seq":503898,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:53.715590+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:12:53.715590+0000","last_peered":"2023-10-14T01:12:53.715590+0000","last_clean":"2023-10-14T01:12:53.715590+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:12:53.715590+0000","last_undegraded":"2023-10-14T01:12:53.715590+0000","last_fullsized":"2023-10-14T01:12:53.715590+0000","mapping_epoch":13,"log_start":"148'245823","ondisk_log_start":"148'245823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3452158656,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":250302,"num_read_kb":972927,"num_write":245916,"num_write_kb":983354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"151'253400","reported_seq":502787,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:53.712112+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:12:53.712112+0000","last_peered":"2023-10-14T01:12:53.712112+0000","last_clean":"2023-10-14T01:12:53.712112+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:12:53.712112+0000","last_undegraded":"2023-10-14T01:12:53.712112+0000","last_fullsized":"2023-10-14T01:12:53.712112+0000","mapping_epoch":13,"log_start":"148'243317","ondisk_log_start":"148'243317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3468956330,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":251347,"num_read_kb":980420,"num_write":247575,"num_write_kb":990049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"151'258533","reported_seq":515576,"reported_epoch":151,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:12:54.701515+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:12:54.701515+0000","last_peered":"2023-10-14T01:12:54.701515+0000","last_clean":"2023-10-14T01:12:54.701515+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:12:54.701515+0000","last_undegraded":"2023-10-14T01:12:54.701515+0000","last_fullsized":"2023-10-14T01:12:54.701515+0000","mapping_epoch":13,"log_start":"148'248523","ondisk_log_start":"148'248523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1854,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 420s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3538104841,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":259492,"num_read_kb":1000358,"num_write":252906,"num_write_kb":1011145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"151'260240","reported_seq":515421,"reported_epoch":151,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:12:52.408066+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:12:52.408066+0000","last_peered":"2023-10-14T01:12:52.408066+0000","last_clean":"2023-10-14T01:12:52.408066+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:12:52.408066+0000","last_undegraded":"2023-10-14T01:12:52.408066+0000","last_fullsized":"2023-10-14T01:12:52.408066+0000","mapping_epoch":13,"log_start":"148'250212","ondisk_log_start":"148'250212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1982,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 416s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3580068158,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":256888,"num_read_kb":1005258,"num_write":255316,"num_write_kb":1021103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"151'261485","reported_seq":518740,"reported_epoch":151,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:12:52.420294+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:12:52.420294+0000","last_peered":"2023-10-14T01:12:52.420294+0000","last_clean":"2023-10-14T01:12:52.420294+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:12:52.420294+0000","last_undegraded":"2023-10-14T01:12:52.420294+0000","last_fullsized":"2023-10-14T01:12:52.420294+0000","mapping_epoch":13,"log_start":"148'251416","ondisk_log_start":"148'251416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2056,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 417s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3610649127,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":258763,"num_read_kb":1014012,"num_write":256488,"num_write_kb":1025815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"151'295970","reported_seq":572799,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:53.681486+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:12:53.681486+0000","last_peered":"2023-10-14T01:12:53.681486+0000","last_clean":"2023-10-14T01:12:53.681486+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:12:53.681486+0000","last_undegraded":"2023-10-14T01:12:53.681486+0000","last_fullsized":"2023-10-14T01:12:53.681486+0000","mapping_epoch":13,"log_start":"149'285916","ondisk_log_start":"149'285916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3768054249,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":280281,"num_read_kb":1070690,"num_write":270177,"num_write_kb":1080053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":316,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:09.931530+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:12:09.931530+0000","last_peered":"2023-10-14T01:12:09.931530+0000","last_clean":"2023-10-14T01:12:09.931530+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:12:09.931530+0000","last_undegraded":"2023-10-14T01:12:09.931530+0000","last_fullsized":"2023-10-14T01:12:09.931530+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28569456563,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2081265,"num_read_kb":8064585,"num_write":2036353,"num_write_kb":8142601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16676720640,"data_stored":29249212262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80389,"ondisk_log_size":80389,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739240,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4940920,"kb_used_data":3127600,"kb_used_omap":494,"kb_used_meta":1812817,"kb_avail":89430920,"statfs":{"total":96636764160,"available":91577262080,"internally_reserved":0,"allocated":3202662400,"data_stored":5592607978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1856325379},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,3,2,0,3,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:12:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.94699999999999995,"15min":1.022},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.4829999999999997,"5min":6.4359999999999999,"15min":8.5800000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.997,"15min":1.0740000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":5.5220000000000002,"5min":6.4720000000000004,"15min":8.6140000000000008},"last":0.32800000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56599999999999995,"15min":0.76100000000000001},"min":{"1min":0.219,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":2.738,"5min":4.6390000000000002,"15min":11.999000000000001},"last":0.373},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.0489999999999999,"15min":1.1000000000000001},"min":{"1min":0.26000000000000001,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":6.9210000000000003,"5min":11.082000000000001,"15min":16.649000000000001},"last":1.637}]}]},{"osd":1,"up_from":8,"seq":34359739227,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9358948,"kb_used_data":8143580,"kb_used_omap":1515,"kb_used_meta":1213844,"kb_avail":85012892,"statfs":{"total":96636764160,"available":87053201408,"internally_reserved":0,"allocated":8339025920,"data_stored":14624999791,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1552053,"internal_metadata":1242976587},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,6,9,8,10,13],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:12:19 2023","interfaces":[{"interface":"back","average":{"1min":1.671,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.26700000000000002,"5min":0.186,"15min":0.154},"max":{"1min":11.667,"5min":12.933,"15min":22.082999999999998},"last":0.308},{"interface":"front","average":{"1min":2.3180000000000001,"5min":1.3440000000000001,"15min":1.45},"min":{"1min":0.26300000000000001,"5min":0.187,"15min":0.187},"max":{"1min":9.0600000000000005,"5min":14.656000000000001,"15min":39.978999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:12:19 2023","interfaces":[{"interface":"back","average":{"1min":2.2370000000000001,"5min":1.4850000000000001,"15min":1.296},"min":{"1min":0.27000000000000002,"5min":0.183,"15min":0.183},"max":{"1min":9.6229999999999993,"5min":9.8510000000000009,"15min":11.945},"last":1.8799999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.67400000000000004,"15min":0.73799999999999999},"min":{"1min":0.23899999999999999,"5min":0.186,"15min":0.186},"max":{"1min":8.1430000000000007,"5min":8.1430000000000007,"15min":8.3170000000000002},"last":0.27000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739240,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7037036,"kb_used_data":5017252,"kb_used_omap":866,"kb_used_meta":2018909,"kb_avail":87334804,"statfs":{"total":96636764160,"available":89430839296,"internally_reserved":0,"allocated":5137666048,"data_stored":9032889377,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":886870,"internal_metadata":2067363754},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,3,5,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:12:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":1.349,"15min":1.0469999999999999},"min":{"1min":0.20300000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":4.6849999999999996,"5min":25.927,"15min":25.927},"last":5.3040000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.538,"15min":1.194},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.187},"max":{"1min":4.7249999999999996,"5min":26.632999999999999,"15min":26.632999999999999},"last":0.27200000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:12:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.83199999999999996,"15min":0.85199999999999998},"min":{"1min":0.23300000000000001,"5min":0.214,"15min":0.191},"max":{"1min":3.6760000000000002,"5min":8.5559999999999992,"15min":10.106},"last":5.4500000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.89900000000000002,"15min":1.081},"min":{"1min":0.22,"5min":0.22,"15min":0.21299999999999999},"max":{"1min":3.3740000000000001,"5min":5.4020000000000001,"15min":16.913},"last":0.308}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5136719872,"data_stored":9032215141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8338198528,"data_stored":14624444339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3201802240,"data_stored":5592552782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:12:56.330 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:56.330 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:56.330 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:56.331 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:56.331 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:56.332 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:56.332 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:56.332 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:56.333 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:12:56.333 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:12:57.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:57.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:57.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:57.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:57.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:57.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:57.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:57.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:57.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:57.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:57.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:57.670+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:57.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:57.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:58.857 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:12:58.854+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:12:59.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:59.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:59.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:59.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:59.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:59.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:59.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:12:59.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:12:59.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:12:59.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.514+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:12:59.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:12:59.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.514+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:12:59.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:12:59.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:12:59.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:12:59.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:12:59.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:12:59.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:12:59.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:12:59.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:12:59.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:01.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:01.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:01.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:01.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:01.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:01.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:01.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:01.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:01.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:01.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:01.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:01.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:01.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:01.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:01.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:01.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:01.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:01.222+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:01.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:01.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:01.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:01.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:05.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:05.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:13:05.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:05.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:05.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:05.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:05.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:05.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:05.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:05.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:05.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:05.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:05.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:05.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:05.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:05.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:05.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:05.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:05.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:05.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:05.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:05.942+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:06.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:06.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:06.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:06.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:06.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:06.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:06.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:06.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:06.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:06.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:06.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:06.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:06.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:06.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:06.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:06.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:06.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:06.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:06.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:06.558+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:06.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:06.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:06.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:06.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:07.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:07.546+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:07.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:07.554+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:07.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:07.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:13:07.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:07.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:08.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:08.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:08.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:08.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:08.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:08.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:08.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:08.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:08.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.690+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:08.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:08.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:08.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:08.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:08.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:08.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:08.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:08.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:08.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.990+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:08.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:08.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:09.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:08.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:09.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:09.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:09.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:09.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:09.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:09.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:09.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:09.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:09.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:09.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:09.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:09.014+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:09.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:09.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:09.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:09.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:09.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:09.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:09.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:09.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:09.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:09.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:10.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:09.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:10.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:10.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:10.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:10.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:10.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.078+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:10.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:10.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:10.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:10.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:10.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:10.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:10.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:10.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:10.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:10.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:11.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:11.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:11.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:11.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:11.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:11.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:11.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:11.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:11.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:11.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:11.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:11.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:11.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:11.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:11.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:11.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:11.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:11.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:11.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:11.986+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:11.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:11.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:11.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:11.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:13.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:13.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:13.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:13.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:13.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:13.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:13.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:13.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:14.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:14.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:14.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:14.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:14.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:14.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:14.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:14.030+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:15.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:15.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:15.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:15.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:15.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:15.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:15.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:15.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:15.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:15.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:15.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:15.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:15.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:15.722+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:15.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:15.786+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:15.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:15.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:15.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:15.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:16.335 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:13:16.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:16.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:16.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:16.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:16.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:16.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:16.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:16.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:16.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:16.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:16.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.534+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:16.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:16.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:16.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:17.250 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:13:17.250 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:13:17.299 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2344,"stamp":"2023-10-14T01:13:15.432819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28600738259,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2089160,"num_read_kb":8095688,"num_write":2044338,"num_write_kb":8175887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80397,"ondisk_log_size":80397,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21692344,"kb_used_data":16351904,"kb_used_omap":2876,"kb_used_meta":5337539,"kb_avail":261423176,"statfs":{"total":289910292480,"available":267697332224,"internally_reserved":0,"allocated":16744349696,"data_stored":29315492474,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2945032,"internal_metadata":5465640952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,3,12,4,9,10,7,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21213184,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5460,"num_read_kb":21724,"num_write":5421,"num_write_kb":21684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001950"},"pg_stats":[{"pgid":"2.7","version":"151'262011","reported_seq":513744,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:13:14.265779+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:13:14.265779+0000","last_peered":"2023-10-14T01:13:14.265779+0000","last_clean":"2023-10-14T01:13:14.265779+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:13:14.265779+0000","last_undegraded":"2023-10-14T01:13:14.265779+0000","last_fullsized":"2023-10-14T01:13:14.265779+0000","mapping_epoch":13,"log_start":"149'251917","ondisk_log_start":"149'251917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3479425560,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":254220,"num_read_kb":984488,"num_write":247981,"num_write_kb":991577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"151'276023","reported_seq":543984,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:13:14.245293+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:13:14.245293+0000","last_peered":"2023-10-14T01:13:14.245293+0000","last_clean":"2023-10-14T01:13:14.245293+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:13:14.245293+0000","last_undegraded":"2023-10-14T01:13:14.245293+0000","last_fullsized":"2023-10-14T01:13:14.245293+0000","mapping_epoch":13,"log_start":"149'266016","ondisk_log_start":"149'266016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3680051418,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":271949,"num_read_kb":1044304,"num_write":262010,"num_write_kb":1047569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"151'256838","reported_seq":505787,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:13:14.194731+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:13:14.194731+0000","last_peered":"2023-10-14T01:13:14.194731+0000","last_clean":"2023-10-14T01:13:14.194731+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:13:14.194731+0000","last_undegraded":"2023-10-14T01:13:14.194731+0000","last_fullsized":"2023-10-14T01:13:14.194731+0000","mapping_epoch":13,"log_start":"149'246823","ondisk_log_start":"149'246823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3455861440,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":251216,"num_read_kb":976571,"num_write":246853,"num_write_kb":987102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"151'254384","reported_seq":504760,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:13:14.254381+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:13:14.254381+0000","last_peered":"2023-10-14T01:13:14.254381+0000","last_clean":"2023-10-14T01:13:14.254381+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:13:14.254381+0000","last_undegraded":"2023-10-14T01:13:14.254381+0000","last_fullsized":"2023-10-14T01:13:14.254381+0000","mapping_epoch":13,"log_start":"148'244317","ondisk_log_start":"148'244317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10067,"log_dups_size":0,"ondisk_log_size":10067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3472679594,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":252332,"num_read_kb":984348,"num_write":248543,"num_write_kb":993921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"151'259561","reported_seq":517575,"reported_epoch":151,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:13:14.888348+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:13:14.888348+0000","last_peered":"2023-10-14T01:13:14.888348+0000","last_clean":"2023-10-14T01:13:14.888348+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:13:14.888348+0000","last_undegraded":"2023-10-14T01:13:14.888348+0000","last_fullsized":"2023-10-14T01:13:14.888348+0000","mapping_epoch":13,"log_start":"149'249523","ondisk_log_start":"149'249523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1926,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 440s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3541811721,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":260444,"num_read_kb":1004122,"num_write":253867,"num_write_kb":1014989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"151'261280","reported_seq":517400,"reported_epoch":151,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:13:12.636475+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:13:12.636475+0000","last_peered":"2023-10-14T01:13:12.636475+0000","last_clean":"2023-10-14T01:13:12.636475+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:13:12.636475+0000","last_undegraded":"2023-10-14T01:13:12.636475+0000","last_fullsized":"2023-10-14T01:13:12.636475+0000","mapping_epoch":13,"log_start":"149'251212","ondisk_log_start":"149'251212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2101,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 437s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3583725886,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":257810,"num_read_kb":1008934,"num_write":256260,"num_write_kb":1024879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"151'262517","reported_seq":520755,"reported_epoch":151,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:13:12.622635+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:13:12.622635+0000","last_peered":"2023-10-14T01:13:12.622635+0000","last_clean":"2023-10-14T01:13:12.622635+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:13:12.622635+0000","last_undegraded":"2023-10-14T01:13:12.622635+0000","last_fullsized":"2023-10-14T01:13:12.622635+0000","mapping_epoch":13,"log_start":"149'252516","ondisk_log_start":"149'252516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2151,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 437s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3614380583,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":259728,"num_read_kb":1017856,"num_write":257438,"num_write_kb":1029615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"151'297126","reported_seq":575059,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:13:14.217615+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:13:14.217615+0000","last_peered":"2023-10-14T01:13:14.217615+0000","last_clean":"2023-10-14T01:13:14.217615+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:13:14.217615+0000","last_undegraded":"2023-10-14T01:13:14.217615+0000","last_fullsized":"2023-10-14T01:13:14.217615+0000","mapping_epoch":13,"log_start":"149'287116","ondisk_log_start":"149'287116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3772211689,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":281355,"num_read_kb":1074974,"num_write":271249,"num_write_kb":1084341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":316,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:09.931530+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:12:09.931530+0000","last_peered":"2023-10-14T01:12:09.931530+0000","last_clean":"2023-10-14T01:12:09.931530+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:12:09.931530+0000","last_undegraded":"2023-10-14T01:12:09.931530+0000","last_fullsized":"2023-10-14T01:12:09.931530+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28600147891,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2089054,"num_read_kb":8095597,"num_write":2044201,"num_write_kb":8173993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16741142528,"data_stored":29313634150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80300,"ondisk_log_size":80300,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739244,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4995076,"kb_used_data":3139388,"kb_used_omap":494,"kb_used_meta":1855185,"kb_avail":89376764,"statfs":{"total":96636764160,"available":91521806336,"internally_reserved":0,"allocated":3214733312,"data_stored":5604678890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1899710211},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,3,0,2,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:12:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.94699999999999995,"15min":1.022},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.4829999999999997,"5min":6.4359999999999999,"15min":8.5800000000000001},"last":3.8029999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.997,"15min":1.0740000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":5.5220000000000002,"5min":6.4720000000000004,"15min":8.6140000000000008},"last":3.8359999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56599999999999995,"15min":0.76100000000000001},"min":{"1min":0.219,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":2.738,"5min":4.6390000000000002,"15min":11.999000000000001},"last":0.252},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.0489999999999999,"15min":1.1000000000000001},"min":{"1min":0.26000000000000001,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":6.9210000000000003,"5min":11.082000000000001,"15min":16.649000000000001},"last":0.45400000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739231,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9555892,"kb_used_data":8175916,"kb_used_omap":1515,"kb_used_meta":1378452,"kb_avail":84815948,"statfs":{"total":96636764160,"available":86851530752,"internally_reserved":0,"allocated":8372137984,"data_stored":14658111855,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1552053,"internal_metadata":1411535179},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,6,2,6,9,4,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:12:19 2023","interfaces":[{"interface":"back","average":{"1min":1.671,"5min":1.0489999999999999,"15min":1.085},"min":{"1min":0.26700000000000002,"5min":0.186,"15min":0.154},"max":{"1min":11.667,"5min":12.933,"15min":22.082999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":2.3180000000000001,"5min":1.3440000000000001,"15min":1.45},"min":{"1min":0.26300000000000001,"5min":0.187,"15min":0.187},"max":{"1min":9.0600000000000005,"5min":14.656000000000001,"15min":39.978999999999999},"last":0.35999999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:12:19 2023","interfaces":[{"interface":"back","average":{"1min":2.2370000000000001,"5min":1.4850000000000001,"15min":1.296},"min":{"1min":0.27000000000000002,"5min":0.183,"15min":0.183},"max":{"1min":9.6229999999999993,"5min":9.8510000000000009,"15min":11.945},"last":0.377},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.67400000000000004,"15min":0.73799999999999999},"min":{"1min":0.23899999999999999,"5min":0.186,"15min":0.186},"max":{"1min":8.1430000000000007,"5min":8.1430000000000007,"15min":8.3170000000000002},"last":0.437}]}]},{"osd":0,"up_from":8,"seq":34359739244,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7141376,"kb_used_data":5036600,"kb_used_omap":866,"kb_used_meta":2103901,"kb_avail":87230464,"statfs":{"total":96636764160,"available":89323995136,"internally_reserved":0,"allocated":5157478400,"data_stored":9052701729,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":886870,"internal_metadata":2154395562},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,3,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:12:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":1.349,"15min":1.0469999999999999},"min":{"1min":0.20300000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":4.6849999999999996,"5min":25.927,"15min":25.927},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":1.538,"15min":1.194},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.187},"max":{"1min":4.7249999999999996,"5min":26.632999999999999,"15min":26.632999999999999},"last":0.40699999999999997}]},{"osd":2,"last update":"Sat Oct 14 01:12:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.83199999999999996,"15min":0.85199999999999998},"min":{"1min":0.23300000000000001,"5min":0.214,"15min":0.191},"max":{"1min":3.6760000000000002,"5min":8.5559999999999992,"15min":10.106},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.89900000000000002,"15min":1.081},"min":{"1min":0.22,"5min":0.22,"15min":0.21299999999999999},"max":{"1min":3.3740000000000001,"5min":5.4020000000000001,"15min":16.913},"last":0.252}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5156478976,"data_stored":9051974245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8370819072,"data_stored":14657064883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3213844480,"data_stored":5604595022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:13:17.301 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:17.301 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:17.302 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:17.302 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:17.302 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:17.303 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:17.303 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:17.303 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:17.304 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:17.304 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:13:18.063 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:13:18.058+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:13:18.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:18.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:13:18.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:18.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:18.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:18.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:18.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:18.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:18.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:18.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:18.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:18.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:18.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:18.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:18.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:18.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:18.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:18.274+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:18.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:18.306+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:18.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:18.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:18.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:18.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:19.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:19.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:19.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:19.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:19.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:19.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:19.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:19.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:19.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:19.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:19.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:19.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:19.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:19.630+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:19.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:19.630+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:19.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:19.630+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:19.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:19.630+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:19.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:19.630+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:21.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:21.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:21.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:21.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:21.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:21.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:21.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:21.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:21.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:21.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:21.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:21.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:21.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:21.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:21.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:21.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:21.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:21.618+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:21.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:21.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:21.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:21.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:22.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:22.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:22.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:22.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:22.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:22.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:22.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:22.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:22.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:22.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:22.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:22.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:22.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:22.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:22.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:22.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:22.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:22.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:22.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:22.614+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:22.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:22.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:22.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:22.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:23.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:23.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:23.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:23.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:23.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:23.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:23.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:23.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:23.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:23.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:23.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:23.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:23.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:23.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:23.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:23.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:24.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:24.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.062+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:24.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.062+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:24.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.062+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:24.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:13:24.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:13:24.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:24.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:24.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:24.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:24.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:24.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:24.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:24.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:24.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:24.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:24.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.198+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:24.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:24.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:24.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:27.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:13:27.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:27.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:27.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:27.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:27.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:27.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:27.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:27.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.086+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:27.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:13:27.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:27.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:27.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:27.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:27.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:27.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:27.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:27.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:27.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:27.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.638+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:27.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:27.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:27.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:29.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:29.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:29.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:29.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:29.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:29.518+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:30.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:30.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:30.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:30.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:30.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:30.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:30.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:30.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:30.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:30.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:30.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:30.542+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:31.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:13:31.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:31.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:31.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:31.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:31.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:31.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:31.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:31.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:31.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:31.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.186+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:31.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:31.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:31.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:31.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:31.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:31.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:31.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:31.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:31.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:31.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:32.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:32.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:32.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:32.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:32.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:32.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:32.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:32.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:32.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:32.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:32.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:32.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:32.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:32.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:32.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:32.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:32.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:32.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:32.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:32.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.682+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:32.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:32.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:32.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:32.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:32.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:32.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:32.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:32.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:32.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:32.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:32.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:32.814+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:34.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:34.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:34.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:34.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:34.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:34.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:34.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:34.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:34.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:34.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:34.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:34.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:34.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:34.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:34.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:34.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:34.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:34.642+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:34.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:34.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:34.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:34.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:35.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:35.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:35.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:35.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:35.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:35.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:35.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:35.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:35.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:35.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.218+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:35.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:35.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:35.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:35.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:35.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:35.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:35.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:35.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:35.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:35.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:35.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:35.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.526+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:35.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.526+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:35.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.526+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:35.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:35.526+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:37.306 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:13:38.163 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:13:38.164 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:13:38.298 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2356,"stamp":"2023-10-14T01:13:37.436928+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28631638483,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2097138,"num_read_kb":8127396,"num_write":2052282,"num_write_kb":8207663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80611,"ondisk_log_size":80611,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21953212,"kb_used_data":16414292,"kb_used_omap":2876,"kb_used_meta":5536003,"kb_avail":261162308,"statfs":{"total":289910292480,"available":267430203392,"internally_reserved":0,"allocated":16808235008,"data_stored":29379365960,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2945032,"internal_metadata":5668868088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,6,4,6,12,15,30,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15163392,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3823,"num_read_kb":15164,"num_write":3903,"num_write_kb":15612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002300"},"pg_stats":[{"pgid":"2.7","version":"152'263077","reported_seq":515773,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:13:34.767837+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:13:34.767837+0000","last_peered":"2023-10-14T01:13:34.767837+0000","last_clean":"2023-10-14T01:13:34.767837+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:13:34.767837+0000","last_undegraded":"2023-10-14T01:13:34.767837+0000","last_fullsized":"2023-10-14T01:13:34.767837+0000","mapping_epoch":13,"log_start":"149'253017","ondisk_log_start":"149'253017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3483390488,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":255170,"num_read_kb":988268,"num_write":248993,"num_write_kb":995625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"152'277055","reported_seq":546063,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:13:34.731696+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:13:34.731696+0000","last_peered":"2023-10-14T01:13:34.731696+0000","last_clean":"2023-10-14T01:13:34.731696+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:13:34.731696+0000","last_undegraded":"2023-10-14T01:13:34.731696+0000","last_fullsized":"2023-10-14T01:13:34.731696+0000","mapping_epoch":13,"log_start":"149'267016","ondisk_log_start":"149'267016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3683922138,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":272983,"num_read_kb":1048420,"num_write":262988,"num_write_kb":1051481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"152'257818","reported_seq":507686,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:13:34.761957+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:13:34.761957+0000","last_peered":"2023-10-14T01:13:34.761957+0000","last_clean":"2023-10-14T01:13:34.761957+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:13:34.761957+0000","last_undegraded":"2023-10-14T01:13:34.761957+0000","last_fullsized":"2023-10-14T01:13:34.761957+0000","mapping_epoch":13,"log_start":"149'247723","ondisk_log_start":"149'247723","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3459498688,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":252126,"num_read_kb":980195,"num_write":247797,"num_write_kb":990878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"152'255355","reported_seq":506675,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:13:34.729717+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:13:34.729717+0000","last_peered":"2023-10-14T01:13:34.729717+0000","last_clean":"2023-10-14T01:13:34.729717+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:13:34.729717+0000","last_undegraded":"2023-10-14T01:13:34.729717+0000","last_fullsized":"2023-10-14T01:13:34.729717+0000","mapping_epoch":13,"log_start":"149'245317","ondisk_log_start":"149'245317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3476357802,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":253276,"num_read_kb":988104,"num_write":249496,"num_write_kb":997733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"152'260614","reported_seq":519639,"reported_epoch":152,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:13:35.245105+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:13:35.245105+0000","last_peered":"2023-10-14T01:13:35.245105+0000","last_clean":"2023-10-14T01:13:35.245105+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:13:35.245105+0000","last_undegraded":"2023-10-14T01:13:35.245105+0000","last_fullsized":"2023-10-14T01:13:35.245105+0000","mapping_epoch":13,"log_start":"149'250523","ondisk_log_start":"149'250523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2003,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 460s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3545653769,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":261435,"num_read_kb":1008038,"num_write":254849,"num_write_kb":1018917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"152'262337","reported_seq":519497,"reported_epoch":152,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:13:32.814175+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:13:32.814175+0000","last_peered":"2023-10-14T01:13:32.814175+0000","last_clean":"2023-10-14T01:13:32.814175+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:13:32.814175+0000","last_undegraded":"2023-10-14T01:13:32.814175+0000","last_fullsized":"2023-10-14T01:13:32.814175+0000","mapping_epoch":13,"log_start":"149'252312","ondisk_log_start":"149'252312","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2170,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 457s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3587584318,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":258837,"num_read_kb":1013018,"num_write":257257,"num_write_kb":1028867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"152'263596","reported_seq":522865,"reported_epoch":152,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:13:32.821874+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:13:32.821874+0000","last_peered":"2023-10-14T01:13:32.821874+0000","last_clean":"2023-10-14T01:13:32.821874+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:13:32.821874+0000","last_undegraded":"2023-10-14T01:13:32.821874+0000","last_fullsized":"2023-10-14T01:13:32.821874+0000","mapping_epoch":13,"log_start":"149'253516","ondisk_log_start":"149'253516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2230,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 458s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3618361895,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":260747,"num_read_kb":1021916,"num_write":258448,"num_write_kb":1033655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"152'298302","reported_seq":577361,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:13:34.761707+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:13:34.761707+0000","last_peered":"2023-10-14T01:13:34.761707+0000","last_clean":"2023-10-14T01:13:34.761707+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:13:34.761707+0000","last_undegraded":"2023-10-14T01:13:34.761707+0000","last_fullsized":"2023-10-14T01:13:34.761707+0000","mapping_epoch":13,"log_start":"149'288216","ondisk_log_start":"149'288216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3776279017,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":282458,"num_read_kb":1079346,"num_write":272317,"num_write_kb":1088613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":317,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-14T01:12:14.228571+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:12:14.228571+0000","last_peered":"2023-10-14T01:12:14.228571+0000","last_clean":"2023-10-14T01:12:14.228571+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:12:14.228571+0000","last_undegraded":"2023-10-14T01:12:14.228571+0000","last_fullsized":"2023-10-14T01:12:14.228571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28631048115,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2097032,"num_read_kb":8127305,"num_write":2052145,"num_write_kb":8205769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16805871616,"data_stored":29378363238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80514,"ondisk_log_size":80514,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739248,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5055856,"kb_used_data":3151592,"kb_used_omap":494,"kb_used_meta":1903761,"kb_avail":89315984,"statfs":{"total":96636764160,"available":91459567616,"internally_reserved":0,"allocated":3227230208,"data_stored":5617171844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506109,"internal_metadata":1949452035},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3,0,1,1,4,3,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:12:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":0.94699999999999995,"15min":1.022},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":5.4829999999999997,"5min":6.4359999999999999,"15min":8.5800000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.997,"15min":1.0740000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":5.5220000000000002,"5min":6.4720000000000004,"15min":8.6140000000000008},"last":0.65500000000000003}]},{"osd":1,"last update":"Sat Oct 14 01:12:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56599999999999995,"15min":0.76100000000000001},"min":{"1min":0.219,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":2.738,"5min":4.6390000000000002,"15min":11.999000000000001},"last":4.7859999999999996},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.0489999999999999,"15min":1.1000000000000001},"min":{"1min":0.26000000000000001,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":6.9210000000000003,"5min":11.082000000000001,"15min":16.649000000000001},"last":0.63}]}]},{"osd":1,"up_from":8,"seq":34359739235,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9664848,"kb_used_data":8207104,"kb_used_omap":1515,"kb_used_meta":1456212,"kb_avail":84706992,"statfs":{"total":96636764160,"available":86739959808,"internally_reserved":0,"allocated":8404074496,"data_stored":14690044425,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1552053,"internal_metadata":1491161419},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,4,4,10,9,8,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:13:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.173,"15min":1.1140000000000001},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.154},"max":{"1min":12.076000000000001,"5min":12.933,"15min":22.082999999999998},"last":2.6099999999999999},{"interface":"front","average":{"1min":1.9610000000000001,"5min":1.4350000000000001,"15min":1.4730000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":17.196999999999999,"5min":17.196999999999999,"15min":39.978999999999999},"last":2.7029999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:13:22 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.5349999999999999,"15min":1.3120000000000001},"min":{"1min":0.23400000000000001,"5min":0.20999999999999999,"15min":0.183},"max":{"1min":5.9770000000000003,"5min":9.8510000000000009,"15min":11.945},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.27000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":5.931,"5min":8.1430000000000007,"15min":8.3170000000000002},"last":2.6509999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739248,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7232508,"kb_used_data":5055596,"kb_used_omap":866,"kb_used_meta":2176029,"kb_avail":87139332,"statfs":{"total":96636764160,"available":89230675968,"internally_reserved":0,"allocated":5176930304,"data_stored":9072149691,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":886870,"internal_metadata":2228254634},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3,0,1,1,2,19],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.8029999999999999,"5min":1.587,"15min":1.133},"min":{"1min":0.30299999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":7.2190000000000003,"5min":25.927,"15min":25.927},"last":0.313},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.5960000000000001,"15min":1.2689999999999999},"min":{"1min":0.251,"5min":0.19700000000000001,"15min":0.187},"max":{"1min":11.949,"5min":26.632999999999999,"15min":26.632999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.9590000000000001,"5min":1.097,"15min":0.93000000000000005},"min":{"1min":0.28299999999999997,"5min":0.214,"15min":0.191},"max":{"1min":7.2640000000000002,"5min":8.5559999999999992,"15min":10.106},"last":2.4500000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":1.0249999999999999},"min":{"1min":0.252,"5min":0.22,"15min":0.21299999999999999},"max":{"1min":3.972,"5min":5.4020000000000001,"15min":10.250999999999999},"last":0.28199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5176217600,"data_stored":9071712869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8403283968,"data_stored":14689529779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3226370048,"data_stored":5617120590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:13:38.300 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:38.300 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:38.300 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:38.301 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:38.301 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:38.302 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:38.302 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:38.302 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:38.303 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:38.303 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:13:38.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:38.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:38.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:38.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:38.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:38.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:38.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:38.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:38.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:38.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.670+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:38.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:38.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:13:38.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:38.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:38.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:38.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:38.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:38.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:38.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:38.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:38.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.794+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:38.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:38.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:38.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:38.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:38.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:38.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:38.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:38.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:38.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:38.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:38.902+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:40.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:40.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:40.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:40.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:40.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:40.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:40.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:40.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:40.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:40.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:40.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:40.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:40.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:40.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:40.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:40.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:40.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:40.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:40.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:40.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.922+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:40.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.922+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:40.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:40.922+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:42.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:42.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:42.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:42.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:42.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:42.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:42.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:42.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:42.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:42.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:42.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:42.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:42.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:42.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:42.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:42.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:42.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:42.218+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:42.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:42.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:42.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:42.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:44.361 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:13:44.357+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:13:47.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:47.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:47.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:47.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:47.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:47.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:47.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.117+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:47.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:47.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.177+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:47.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:47.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:47.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:47.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:47.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:47.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:47.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:47.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:47.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:47.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:47.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:47.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.773+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:47.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:47.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:47.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:50.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:13:50.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:13:50.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:50.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:50.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:50.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:50.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:50.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:50.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:50.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:50.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:50.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:50.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.405+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:50.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.405+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:50.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:50.405+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:51.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:51.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:51.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:51.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:51.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:51.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:51.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:51.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:51.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:51.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.569+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:51.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:51.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:51.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:51.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:51.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:52.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:52.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:52.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:52.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.041+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:52.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:52.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:52.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:52.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:52.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:52.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:52.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:13:52.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:13:52.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:52.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:52.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:52.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:52.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:52.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:52.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:52.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:52.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:52.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:52.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:52.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:52.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:52.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:52.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:52.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:52.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.909+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:52.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:52.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:52.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:53.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:13:53.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:53.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:53.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:53.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:53.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:53.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:53.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:53.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:53.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:53.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.925+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:53.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:53.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:53.925+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:54.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:54.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:54.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:54.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:54.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:54.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:54.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:54.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:54.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:54.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:54.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.657+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:54.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:54.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:54.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:55.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:13:55.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:13:55.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:55.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:55.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:55.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:55.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:55.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:55.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:55.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:55.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:55.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:55.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.537+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:55.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:55.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:55.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:13:55.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:13:55.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:55.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:55.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:55.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:55.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:55.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:55.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:55.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:55.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:55.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.761+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:55.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:55.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:55.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:57.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:57.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:57.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:57.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:57.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:57.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:57.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:57.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:57.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:57.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:57.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:57.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:57.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:57.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:13:57.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:57.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:57.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:57.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:57.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:57.421+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:57.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:57.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:57.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:57.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:58.258 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:13:58.253+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:13:58.304 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:13:58.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:13:58.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:13:58.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:58.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:58.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:58.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:58.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:58.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:13:58.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:58.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.829+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:13:58.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:13:58.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:13:58.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:13:58.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:13:58.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:13:59.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:13:59.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:58.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:13:59.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:13:59.001+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:13:59.096 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:13:59.097 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:13:59.164 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2366,"stamp":"2023-10-14T01:13:57.443779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28662616531,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2105225,"num_read_kb":8159596,"num_write":2060230,"num_write_kb":8239455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80533,"ondisk_log_size":80533,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20291880,"kb_used_data":16477008,"kb_used_omap":2945,"kb_used_meta":3811902,"kb_avail":262823640,"statfs":{"total":289910292480,"available":269131407360,"internally_reserved":0,"allocated":16872456192,"data_stored":29443587144,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3016468,"internal_metadata":3903387884},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,4,2,7,8,10,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15699968,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4086,"num_read_kb":16268,"num_write":4028,"num_write_kb":16112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005422"},"pg_stats":[{"pgid":"2.7","version":"152'264077","reported_seq":517829,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:13:55.442490+0000","last_change":"2023-10-14T00:36:03.651016+0000","last_active":"2023-10-14T01:13:55.442490+0000","last_peered":"2023-10-14T01:13:55.442490+0000","last_clean":"2023-10-14T01:13:55.442490+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:13:55.442490+0000","last_undegraded":"2023-10-14T01:13:55.442490+0000","last_fullsized":"2023-10-14T01:13:55.442490+0000","mapping_epoch":13,"log_start":"149'254017","ondisk_log_start":"149'254017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3487068696,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":256217,"num_read_kb":992428,"num_write":249930,"num_write_kb":999373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"152'278162","reported_seq":548244,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:13:55.415617+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:13:55.415617+0000","last_peered":"2023-10-14T01:13:55.415617+0000","last_clean":"2023-10-14T01:13:55.415617+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:13:55.415617+0000","last_undegraded":"2023-10-14T01:13:55.415617+0000","last_fullsized":"2023-10-14T01:13:55.415617+0000","mapping_epoch":13,"log_start":"149'268116","ondisk_log_start":"149'268116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3687993562,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":274049,"num_read_kb":1052664,"num_write":264032,"num_write_kb":1055657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"152'258814","reported_seq":509669,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:13:55.377384+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:13:55.377384+0000","last_peered":"2023-10-14T01:13:55.377384+0000","last_clean":"2023-10-14T01:13:55.377384+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:13:55.377384+0000","last_undegraded":"2023-10-14T01:13:55.377384+0000","last_fullsized":"2023-10-14T01:13:55.377384+0000","mapping_epoch":13,"log_start":"149'248723","ondisk_log_start":"149'248723","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3463242432,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":253110,"num_read_kb":984131,"num_write":248751,"num_write_kb":994694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"152'256352","reported_seq":508690,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:13:55.387401+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:13:55.387401+0000","last_peered":"2023-10-14T01:13:55.387401+0000","last_clean":"2023-10-14T01:13:55.387401+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:13:55.387401+0000","last_undegraded":"2023-10-14T01:13:55.387401+0000","last_fullsized":"2023-10-14T01:13:55.387401+0000","mapping_epoch":13,"log_start":"149'246317","ondisk_log_start":"149'246317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3480154794,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":254285,"num_read_kb":992132,"num_write":250472,"num_write_kb":1001637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"152'261668","reported_seq":521693,"reported_epoch":152,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:13:55.363768+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:13:55.363768+0000","last_peered":"2023-10-14T01:13:55.363768+0000","last_clean":"2023-10-14T01:13:55.363768+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:13:55.363768+0000","last_undegraded":"2023-10-14T01:13:55.363768+0000","last_fullsized":"2023-10-14T01:13:55.363768+0000","mapping_epoch":13,"log_start":"149'251623","ondisk_log_start":"149'251623","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2064,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 480s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3549520393,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":262408,"num_read_kb":1011890,"num_write":255844,"num_write_kb":1022897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"152'263365","reported_seq":521493,"reported_epoch":152,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:13:53.086449+0000","last_change":"2023-10-14T01:05:55.482390+0000","last_active":"2023-10-14T01:13:53.086449+0000","last_peered":"2023-10-14T01:13:53.086449+0000","last_clean":"2023-10-14T01:13:53.086449+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:13:53.086449+0000","last_undegraded":"2023-10-14T01:13:53.086449+0000","last_fullsized":"2023-10-14T01:13:53.086449+0000","mapping_epoch":13,"log_start":"149'253312","ondisk_log_start":"149'253312","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2237,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 477s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3591328062,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":259790,"num_read_kb":1016810,"num_write":258229,"num_write_kb":1032755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"152'264630","reported_seq":524900,"reported_epoch":152,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:13:52.961612+0000","last_change":"2023-10-14T01:05:54.437699+0000","last_active":"2023-10-14T01:13:52.961612+0000","last_peered":"2023-10-14T01:13:52.961612+0000","last_clean":"2023-10-14T01:13:52.961612+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:13:52.961612+0000","last_undegraded":"2023-10-14T01:13:52.961612+0000","last_fullsized":"2023-10-14T01:13:52.961612+0000","mapping_epoch":13,"log_start":"149'254616","ondisk_log_start":"149'254616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2302,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 478s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3622220327,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":261732,"num_read_kb":1025828,"num_write":259424,"num_write_kb":1037559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"152'299508","reported_seq":579663,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:13:55.353572+0000","last_change":"2023-10-14T00:36:03.752981+0000","last_active":"2023-10-14T01:13:55.353572+0000","last_peered":"2023-10-14T01:13:55.353572+0000","last_clean":"2023-10-14T01:13:55.353572+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:13:55.353572+0000","last_undegraded":"2023-10-14T01:13:55.353572+0000","last_fullsized":"2023-10-14T01:13:55.353572+0000","mapping_epoch":13,"log_start":"149'289416","ondisk_log_start":"149'289416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3780497897,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":283528,"num_read_kb":1083622,"num_write":273411,"num_write_kb":1092989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":318,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:13:24.978096+0000","last_change":"2023-10-14T00:00:05.352532+0000","last_active":"2023-10-14T01:13:24.978096+0000","last_peered":"2023-10-14T01:13:24.978096+0000","last_clean":"2023-10-14T01:13:24.978096+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:13:24.978096+0000","last_undegraded":"2023-10-14T01:13:24.978096+0000","last_fullsized":"2023-10-14T01:13:24.978096+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:04.332620+0000","last_clean_scrub_stamp":"2023-10-14T00:00:04.332620+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28662026163,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2105119,"num_read_kb":8159505,"num_write":2060093,"num_write_kb":8237561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16870903808,"data_stored":29443395430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80436,"ondisk_log_size":80436,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739252,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4486336,"kb_used_data":3163704,"kb_used_omap":495,"kb_used_meta":1322128,"kb_avail":89885504,"statfs":{"total":96636764160,"available":92042756096,"internally_reserved":0,"allocated":3239632896,"data_stored":5629574532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507789,"internal_metadata":1353859187},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1,0,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":0.94099999999999995,"15min":1.0389999999999999},"min":{"1min":0.221,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.1239999999999997,"5min":6.1239999999999997,"15min":8.5800000000000001},"last":0.249},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.98899999999999999,"15min":1.0900000000000001},"min":{"1min":0.27600000000000002,"5min":0.215,"15min":0.215},"max":{"1min":6.1559999999999997,"5min":6.1559999999999997,"15min":8.6140000000000008},"last":0.33100000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64900000000000002,"15min":0.78400000000000003},"min":{"1min":0.193,"5min":0.193,"15min":0.183},"max":{"1min":4.7859999999999996,"5min":4.7859999999999996,"15min":11.999000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.98999999999999999,"15min":1.097},"min":{"1min":0.25700000000000001,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":6.0739999999999998,"5min":11.082000000000001,"15min":16.649000000000001},"last":0.49299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739239,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9830648,"kb_used_data":8238256,"kb_used_omap":1515,"kb_used_meta":1590868,"kb_avail":84541192,"statfs":{"total":96636764160,"available":86570180608,"internally_reserved":0,"allocated":8435974144,"data_stored":14721944073,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1552053,"internal_metadata":1629049163},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,2,5,6,7,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:13:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.173,"15min":1.1140000000000001},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.154},"max":{"1min":12.076000000000001,"5min":12.933,"15min":22.082999999999998},"last":1.175},{"interface":"front","average":{"1min":1.9610000000000001,"5min":1.4350000000000001,"15min":1.4730000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":17.196999999999999,"5min":17.196999999999999,"15min":39.978999999999999},"last":0.185}]},{"osd":2,"last update":"Sat Oct 14 01:13:22 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.5349999999999999,"15min":1.3120000000000001},"min":{"1min":0.23400000000000001,"5min":0.20999999999999999,"15min":0.183},"max":{"1min":5.9770000000000003,"5min":9.8510000000000009,"15min":11.945},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.27000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":5.931,"5min":8.1430000000000007,"15min":8.3170000000000002},"last":1.208}]}]},{"osd":0,"up_from":8,"seq":34359739252,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5974896,"kb_used_data":5075048,"kb_used_omap":934,"kb_used_meta":898905,"kb_avail":88396944,"statfs":{"total":96636764160,"available":90518470656,"internally_reserved":0,"allocated":5196849152,"data_stored":9092068539,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":920479534},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,2,1,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.8029999999999999,"5min":1.587,"15min":1.133},"min":{"1min":0.30299999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":7.2190000000000003,"5min":25.927,"15min":25.927},"last":0.307},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.5960000000000001,"15min":1.2689999999999999},"min":{"1min":0.251,"5min":0.19700000000000001,"15min":0.187},"max":{"1min":11.949,"5min":26.632999999999999,"15min":26.632999999999999},"last":0.19400000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.9590000000000001,"5min":1.097,"15min":0.93000000000000005},"min":{"1min":0.28299999999999997,"5min":0.214,"15min":0.191},"max":{"1min":7.2640000000000002,"5min":8.5559999999999992,"15min":10.106},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":1.0249999999999999},"min":{"1min":0.252,"5min":0.22,"15min":0.21299999999999999},"max":{"1min":3.972,"5min":5.4020000000000001,"15min":10.250999999999999},"last":0.42899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5195960320,"data_stored":9091455589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8436199424,"data_stored":14722445235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3238744064,"data_stored":5629494606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:13:59.166 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:59.166 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:59.167 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:59.167 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:59.167 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:59.168 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:59.168 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:59.169 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:59.169 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T00:00:04.332620+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=4, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:13:59.169 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:14:00.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:14:00.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:14:00.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:14:00.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:00.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:00.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:00.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:00.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:00.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:00.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:00.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:00.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:00.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.509+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:00.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:00.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:00.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:00.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:00.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:00.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:00.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:00.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:03.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:03.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:03.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:03.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:03.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:03.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:03.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.445+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:03.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:03.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:03.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:03.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:03.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:03.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:03.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:03.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:03.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:03.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.649+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:03.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:03.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:03.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:03.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:03.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:03.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:03.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:03.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:03.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:03.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:03.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.953+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:03.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:03.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:03.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:04.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:04.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:04.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:04.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:04.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:04.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:04.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:04.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:04.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:04.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.253+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:04.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:04.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:04.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:14:04.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:14:04.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:04.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:04.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:04.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:04.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:04.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:04.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:04.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:04.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:04.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.317+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:04.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:04.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:04.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:04.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:04.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:04.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:04.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:04.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:04.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.461+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:04.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:04.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.501+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:04.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:04.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:04.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:07.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:07.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:14:07.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:07.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:07.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:07.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:07.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:07.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:07.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:07.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:07.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:07.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:07.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:07.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:07.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:07.533+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:07.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:07.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:07.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:07.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:09.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:09.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:09.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:09.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:09.534 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:14:09.525+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:14:09.534 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:14:09.525+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:14:11.570 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:14:11.565+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:14:11.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:11.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:11.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:11.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:11.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:11.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:11.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:11.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.633+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:11.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.633+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:11.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.633+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:11.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.633+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:11.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.633+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:11.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:11.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:11.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:11.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:11.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:11.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:11.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:11.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.977+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:11.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.977+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:11.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.977+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:11.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.977+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:11.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:11.977+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:14.667 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:14:14.661+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:14:14.668 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:14:14.661+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:14:17.936 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:14:17.933+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:14:19.170 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:14:19.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:19.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:14:19.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:19.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:19.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:19.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:19.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:19.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:19.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:19.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:19.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:19.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:19.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:19.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:19.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:19.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:19.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:19.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:19.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:19.577+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:19.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:19.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:19.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:19.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:20.152 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:14:20.153 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:14:20.215 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2377,"stamp":"2023-10-14T01:14:19.447319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28694249939,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2113426,"num_read_kb":8192236,"num_write":2068394,"num_write_kb":8272111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80608,"ondisk_log_size":80608,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20602348,"kb_used_data":16542356,"kb_used_omap":2945,"kb_used_meta":4057022,"kb_avail":262513172,"statfs":{"total":289910292480,"available":268813488128,"internally_reserved":0,"allocated":16939372544,"data_stored":29510503496,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3016468,"internal_metadata":4154390764},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,7,1,8,10,15,7,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16814080,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4330,"num_read_kb":17220,"num_write":4341,"num_write_kb":17364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001969"},"pg_stats":[{"pgid":"2.7","version":"152'265105","reported_seq":519832,"reported_epoch":152,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:14:15.853115+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:14:15.853115+0000","last_peered":"2023-10-14T01:14:15.853115+0000","last_clean":"2023-10-14T01:14:15.853115+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:14:15.853115+0000","last_undegraded":"2023-10-14T01:14:15.853115+0000","last_fullsized":"2023-10-14T01:14:15.853115+0000","mapping_epoch":13,"log_start":"149'255017","ondisk_log_start":"149'255017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":21,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 9s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3490824728,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":257171,"num_read_kb":996216,"num_write":250894,"num_write_kb":1003229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"152'279199","reported_seq":550281,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:14:15.854733+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:14:15.854733+0000","last_peered":"2023-10-14T01:14:15.854733+0000","last_clean":"2023-10-14T01:14:15.854733+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:14:15.854733+0000","last_undegraded":"2023-10-14T01:14:15.854733+0000","last_fullsized":"2023-10-14T01:14:15.854733+0000","mapping_epoch":13,"log_start":"150'269116","ondisk_log_start":"150'269116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3691839706,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":275033,"num_read_kb":1056568,"num_write":265021,"num_write_kb":1059613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"152'259754","reported_seq":511596,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:14:15.853675+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:14:15.853675+0000","last_peered":"2023-10-14T01:14:15.853675+0000","last_clean":"2023-10-14T01:14:15.853675+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:14:15.853675+0000","last_undegraded":"2023-10-14T01:14:15.853675+0000","last_fullsized":"2023-10-14T01:14:15.853675+0000","mapping_epoch":13,"log_start":"149'249723","ondisk_log_start":"149'249723","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3466736320,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":254084,"num_read_kb":988019,"num_write":249659,"num_write_kb":998326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"152'257273","reported_seq":510570,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:14:15.810718+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:14:15.810718+0000","last_peered":"2023-10-14T01:14:15.810718+0000","last_clean":"2023-10-14T01:14:15.810718+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:14:15.810718+0000","last_undegraded":"2023-10-14T01:14:15.810718+0000","last_fullsized":"2023-10-14T01:14:15.810718+0000","mapping_epoch":13,"log_start":"149'247217","ondisk_log_start":"149'247217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3483624106,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":255243,"num_read_kb":995940,"num_write":251377,"num_write_kb":1005257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"152'262699","reported_seq":523676,"reported_epoch":152,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:14:15.562820+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:14:15.562820+0000","last_peered":"2023-10-14T01:14:15.562820+0000","last_clean":"2023-10-14T01:14:15.562820+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:14:15.562820+0000","last_undegraded":"2023-10-14T01:14:15.562820+0000","last_fullsized":"2023-10-14T01:14:15.562820+0000","mapping_epoch":13,"log_start":"150'252623","ondisk_log_start":"150'252623","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2186,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 500s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3553194505,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":263335,"num_read_kb":1015574,"num_write":256777,"num_write_kb":1026629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"152'264634","reported_seq":523937,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:14:18.363974+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:14:18.363974+0000","last_peered":"2023-10-14T01:14:18.363974+0000","last_clean":"2023-10-14T01:14:18.363974+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:14:18.363974+0000","last_undegraded":"2023-10-14T01:14:18.363974+0000","last_fullsized":"2023-10-14T01:14:18.363974+0000","mapping_epoch":13,"log_start":"150'254612","ondisk_log_start":"150'254612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3595837758,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":260948,"num_read_kb":1021418,"num_write":259414,"num_write_kb":1037495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"152'265906","reported_seq":527437,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:14:18.380862+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:14:18.380862+0000","last_peered":"2023-10-14T01:14:18.380862+0000","last_clean":"2023-10-14T01:14:18.380862+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:14:18.380862+0000","last_undegraded":"2023-10-14T01:14:18.380862+0000","last_fullsized":"2023-10-14T01:14:18.380862+0000","mapping_epoch":13,"log_start":"150'255816","ondisk_log_start":"150'255816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3626983975,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":262976,"num_read_kb":1030788,"num_write":260639,"num_write_kb":1042419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"152'300679","reported_seq":581862,"reported_epoch":152,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:14:15.850547+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:14:15.850547+0000","last_peered":"2023-10-14T01:14:15.850547+0000","last_clean":"2023-10-14T01:14:15.850547+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:14:15.850547+0000","last_undegraded":"2023-10-14T01:14:15.850547+0000","last_fullsized":"2023-10-14T01:14:15.850547+0000","mapping_epoch":13,"log_start":"150'290616","ondisk_log_start":"150'290616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":5,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3784618473,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":284530,"num_read_kb":1087622,"num_write":274476,"num_write_kb":1097249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":328,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:14:05.448873+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:14:05.448873+0000","last_peered":"2023-10-14T01:14:05.448873+0000","last_clean":"2023-10-14T01:14:05.448873+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:14:05.448873+0000","last_undegraded":"2023-10-14T01:14:05.448873+0000","last_fullsized":"2023-10-14T01:14:05.448873+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28693659571,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2113320,"num_read_kb":8192145,"num_write":2068257,"num_write_kb":8270217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16936706048,"data_stored":29509197670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80509,"ondisk_log_size":80509,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739257,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4543288,"kb_used_data":3178416,"kb_used_omap":495,"kb_used_meta":1364368,"kb_avail":89828552,"statfs":{"total":96636764160,"available":91984437248,"internally_reserved":0,"allocated":3254697984,"data_stored":5644639620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507789,"internal_metadata":1397112947},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":0.94099999999999995,"15min":1.0389999999999999},"min":{"1min":0.221,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.1239999999999997,"5min":6.1239999999999997,"15min":8.5800000000000001},"last":0.37},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.98899999999999999,"15min":1.0900000000000001},"min":{"1min":0.27600000000000002,"5min":0.215,"15min":0.215},"max":{"1min":6.1559999999999997,"5min":6.1559999999999997,"15min":8.6140000000000008},"last":0.40400000000000003}]},{"osd":1,"last update":"Sat Oct 14 01:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64900000000000002,"15min":0.78400000000000003},"min":{"1min":0.193,"5min":0.193,"15min":0.183},"max":{"1min":4.7859999999999996,"5min":4.7859999999999996,"15min":11.999000000000001},"last":0.253},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.98999999999999999,"15min":1.097},"min":{"1min":0.25700000000000001,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":6.0739999999999998,"5min":11.082000000000001,"15min":16.649000000000001},"last":0.27700000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739243,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10002812,"kb_used_data":8270132,"kb_used_omap":1515,"kb_used_meta":1731156,"kb_avail":84369028,"statfs":{"total":96636764160,"available":86393884672,"internally_reserved":0,"allocated":8468615168,"data_stored":14754585097,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1552053,"internal_metadata":1772704075},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,4,0,4,7,11,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:13:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.173,"15min":1.1140000000000001},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.154},"max":{"1min":12.076000000000001,"5min":12.933,"15min":22.082999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.9610000000000001,"5min":1.4350000000000001,"15min":1.4730000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":17.196999999999999,"5min":17.196999999999999,"15min":39.978999999999999},"last":0.99399999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:13:22 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.5349999999999999,"15min":1.3120000000000001},"min":{"1min":0.23400000000000001,"5min":0.20999999999999999,"15min":0.183},"max":{"1min":5.9770000000000003,"5min":9.8510000000000009,"15min":11.945},"last":2.7829999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.74299999999999999,"15min":0.72799999999999998},"min":{"1min":0.27000000000000002,"5min":0.186,"15min":0.186},"max":{"1min":5.931,"5min":8.1430000000000007,"15min":8.3170000000000002},"last":2.4289999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739256,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6056248,"kb_used_data":5093808,"kb_used_omap":934,"kb_used_meta":961497,"kb_avail":88315592,"statfs":{"total":96636764160,"available":90435166208,"internally_reserved":0,"allocated":5216059392,"data_stored":9111278779,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":984573742},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,3,2,4,3,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.8029999999999999,"5min":1.587,"15min":1.133},"min":{"1min":0.30299999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":7.2190000000000003,"5min":25.927,"15min":25.927},"last":2.194},{"interface":"front","average":{"1min":1.6279999999999999,"5min":1.5960000000000001,"15min":1.2689999999999999},"min":{"1min":0.251,"5min":0.19700000000000001,"15min":0.187},"max":{"1min":11.949,"5min":26.632999999999999,"15min":26.632999999999999},"last":2.2349999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:13:26 2023","interfaces":[{"interface":"back","average":{"1min":1.9590000000000001,"5min":1.097,"15min":0.93000000000000005},"min":{"1min":0.28299999999999997,"5min":0.214,"15min":0.191},"max":{"1min":7.2640000000000002,"5min":8.5559999999999992,"15min":10.106},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.86799999999999999,"15min":1.0249999999999999},"min":{"1min":0.252,"5min":0.22,"15min":0.21299999999999999},"max":{"1min":3.972,"5min":5.4020000000000001,"15min":10.250999999999999},"last":0.49099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5215019008,"data_stored":9110514277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8467759104,"data_stored":14754004915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3253927936,"data_stored":5644678478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:14:20.216 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:14:20.217 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:14:20.217 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:14:20.218 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:14:20.218 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:14:20.219 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:14:20.219 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:14:20.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:20.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:20.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:20.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:20.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:20.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:20.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:20.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:20.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:20.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:20.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:20.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:20.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:20.697+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:20.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:20.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:20.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:20.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:21.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:21.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:22.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:21.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:22.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:21.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:22.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:22.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:22.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:22.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:22.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:22.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:22.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:22.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:22.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:22.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:22.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:22.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:22.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:22.025+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:22.646 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:14:22.641+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:14:23.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:14:23.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:14:23.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:23.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:23.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:23.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:23.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:23.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:23.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:23.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:14:23.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:14:23.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:23.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:23.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:23.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:23.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:23.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:23.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:23.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:24.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:24.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:24.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:24.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:24.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:24.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:24.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:24.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:24.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:24.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:24.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:24.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:24.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:24.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:24.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:24.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:26.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:26.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:26.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:26.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:26.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:26.705+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:27.202 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:14:27.197+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:14:29.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:29.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:29.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:29.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:29.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:29.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:29.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:29.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:29.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:29.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:29.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:29.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:29.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:29.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:29.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:29.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:29.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:29.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:29.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:29.225+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:29.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:29.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:30.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:30.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:30.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:30.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:30.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:30.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:30.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:30.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:30.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:30.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:30.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:30.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:30.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:30.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:30.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:30.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:30.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:30.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:30.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:30.625+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:30.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:30.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:30.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:30.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:31.204 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:14:31.201+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:14:32.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:14:32.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:14:32.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:32.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:32.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:32.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:32.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:32.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:32.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:32.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:32.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:32.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.941+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:32.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:32.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:32.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:33.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:33.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:33.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:33.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:33.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:33.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:33.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:33.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:33.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.449+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:33.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.453+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:33.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:33.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:33.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:14:33.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:33.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:33.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:33.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:33.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:33.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:33.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.649+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:33.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:33.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:33.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:36.797 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:14:36.793+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:14:36.822 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:14:36.817+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:14:37.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:14:37.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:37.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:37.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:37.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:37.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:37.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:37.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:37.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.633+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:37.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.633+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:37.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.633+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:37.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.633+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:37.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:37.633+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:38.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:38.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:38.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:38.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:38.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:38.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:38.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:38.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:38.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:38.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:38.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:38.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:38.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:38.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:38.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:38.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:38.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:38.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:38.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:38.477+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:39.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:39.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:14:39.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:39.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:39.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:39.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:39.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:39.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:39.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:39.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:39.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:39.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:39.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:39.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:39.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:39.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:39.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:39.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:39.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:39.193+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:39.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:39.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:39.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:39.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:40.221 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:14:40.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:14:40.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:40.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:40.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:40.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:40.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:40.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:40.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:40.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:40.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:40.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.325+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:40.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:40.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:40.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:40.972 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:14:40.972 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:14:41.074 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2388,"stamp":"2023-10-14T01:14:39.460107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28725617107,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2121350,"num_read_kb":8223756,"num_write":2076444,"num_write_kb":8304311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80428,"ondisk_log_size":80428,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20680904,"kb_used_data":16606056,"kb_used_omap":2945,"kb_used_meta":4071870,"kb_avail":262434616,"statfs":{"total":289910292480,"available":268733046784,"internally_reserved":0,"allocated":17004601344,"data_stored":29575720341,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3016468,"internal_metadata":4169595116},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,1,11,13,16,40],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15732736,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4027,"num_read_kb":16032,"num_write":4035,"num_write_kb":16140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002528"},"pg_stats":[{"pgid":"2.7","version":"153'266175","reported_seq":521874,"reported_epoch":153,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:14:36.811100+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:14:36.811100+0000","last_peered":"2023-10-14T01:14:36.811100+0000","last_clean":"2023-10-14T01:14:36.811100+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:14:36.811100+0000","last_undegraded":"2023-10-14T01:14:36.811100+0000","last_fullsized":"2023-10-14T01:14:36.811100+0000","mapping_epoch":13,"log_start":"150'256117","ondisk_log_start":"150'256117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":77,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 30s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3494724120,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":258130,"num_read_kb":1000040,"num_write":251881,"num_write_kb":1007177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'280294","reported_seq":552395,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:14:36.529569+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:14:36.529569+0000","last_peered":"2023-10-14T01:14:36.529569+0000","last_clean":"2023-10-14T01:14:36.529569+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:14:36.529569+0000","last_undegraded":"2023-10-14T01:14:36.529569+0000","last_fullsized":"2023-10-14T01:14:36.529569+0000","mapping_epoch":13,"log_start":"150'270216","ondisk_log_start":"150'270216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3695911130,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":276040,"num_read_kb":1060568,"num_write":266077,"num_write_kb":1063837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'260750","reported_seq":513578,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:14:36.478173+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:14:36.478173+0000","last_peered":"2023-10-14T01:14:36.478173+0000","last_clean":"2023-10-14T01:14:36.478173+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:14:36.478173+0000","last_undegraded":"2023-10-14T01:14:36.478173+0000","last_fullsized":"2023-10-14T01:14:36.478173+0000","mapping_epoch":13,"log_start":"150'250723","ondisk_log_start":"150'250723","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3470508736,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":255061,"num_read_kb":991891,"num_write":250629,"num_write_kb":1002206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"153'258319","reported_seq":512588,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:14:36.559951+0000","last_change":"2023-10-14T00:36:03.651331+0000","last_active":"2023-10-14T01:14:36.559951+0000","last_peered":"2023-10-14T01:14:36.559951+0000","last_clean":"2023-10-14T01:14:36.559951+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:14:36.559951+0000","last_undegraded":"2023-10-14T01:14:36.559951+0000","last_fullsized":"2023-10-14T01:14:36.559951+0000","mapping_epoch":13,"log_start":"150'248317","ondisk_log_start":"150'248317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3487625898,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":256208,"num_read_kb":999788,"num_write":252410,"num_write_kb":1009389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"153'263749","reported_seq":525712,"reported_epoch":153,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:14:35.750357+0000","last_change":"2023-10-14T01:05:54.560635+0000","last_active":"2023-10-14T01:14:35.750357+0000","last_peered":"2023-10-14T01:14:35.750357+0000","last_clean":"2023-10-14T01:14:35.750357+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:14:35.750357+0000","last_undegraded":"2023-10-14T01:14:35.750357+0000","last_fullsized":"2023-10-14T01:14:35.750357+0000","mapping_epoch":13,"log_start":"150'253723","ondisk_log_start":"150'253723","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2282,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 521s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3557007881,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":264304,"num_read_kb":1019422,"num_write":257752,"num_write_kb":1030529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"153'265596","reported_seq":525925,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:14:38.432080+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:14:38.432080+0000","last_peered":"2023-10-14T01:14:38.432080+0000","last_clean":"2023-10-14T01:14:38.432080+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:14:38.432080+0000","last_undegraded":"2023-10-14T01:14:38.432080+0000","last_fullsized":"2023-10-14T01:14:38.432080+0000","mapping_epoch":13,"log_start":"150'255512","ondisk_log_start":"150'255512","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3599577406,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":261970,"num_read_kb":1025490,"num_write":260366,"num_write_kb":1041303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"153'266928","reported_seq":529458,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:14:38.438845+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:14:38.438845+0000","last_peered":"2023-10-14T01:14:38.438845+0000","last_clean":"2023-10-14T01:14:38.438845+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:14:38.438845+0000","last_undegraded":"2023-10-14T01:14:38.438845+0000","last_fullsized":"2023-10-14T01:14:38.438845+0000","mapping_epoch":13,"log_start":"150'256916","ondisk_log_start":"150'256916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3630973479,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":263971,"num_read_kb":1034740,"num_write":261651,"num_write_kb":1046467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"153'301858","reported_seq":584102,"reported_epoch":153,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:14:36.518335+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:14:36.518335+0000","last_peered":"2023-10-14T01:14:36.518335+0000","last_clean":"2023-10-14T01:14:36.518335+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:14:36.518335+0000","last_undegraded":"2023-10-14T01:14:36.518335+0000","last_fullsized":"2023-10-14T01:14:36.518335+0000","mapping_epoch":13,"log_start":"150'291816","ondisk_log_start":"150'291816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":54,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 25s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3788698089,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":285560,"num_read_kb":1091726,"num_write":275541,"num_write_kb":1101509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":329,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:14:05.448968+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:14:05.448968+0000","last_peered":"2023-10-14T01:14:05.448968+0000","last_clean":"2023-10-14T01:14:05.448968+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:14:05.448968+0000","last_undegraded":"2023-10-14T01:14:05.448968+0000","last_fullsized":"2023-10-14T01:14:05.448968+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28725026739,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2121244,"num_read_kb":8223665,"num_write":2076307,"num_write_kb":8302417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17002795008,"data_stored":29575286630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80329,"ondisk_log_size":80329,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4623808,"kb_used_data":3190904,"kb_used_omap":495,"kb_used_meta":1432400,"kb_avail":89748032,"statfs":{"total":96636764160,"available":91901984768,"internally_reserved":0,"allocated":3267485696,"data_stored":5657423347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507789,"internal_metadata":1466777715},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,5,5,7,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:13:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":0.94099999999999995,"15min":1.0389999999999999},"min":{"1min":0.221,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.1239999999999997,"5min":6.1239999999999997,"15min":8.5800000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.98899999999999999,"15min":1.0900000000000001},"min":{"1min":0.27600000000000002,"5min":0.215,"15min":0.215},"max":{"1min":6.1559999999999997,"5min":6.1559999999999997,"15min":8.6140000000000008},"last":0.34799999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:13:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.64900000000000002,"15min":0.78400000000000003},"min":{"1min":0.193,"5min":0.193,"15min":0.183},"max":{"1min":4.7859999999999996,"5min":4.7859999999999996,"15min":11.999000000000001},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.98999999999999999,"15min":1.097},"min":{"1min":0.25700000000000001,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":6.0739999999999998,"5min":11.082000000000001,"15min":16.649000000000001},"last":0.307}]}]},{"osd":1,"up_from":8,"seq":34359739247,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10142348,"kb_used_data":8301952,"kb_used_omap":1515,"kb_used_meta":1838868,"kb_avail":84229492,"statfs":{"total":96636764160,"available":86250999808,"internally_reserved":0,"allocated":8501198848,"data_stored":14787164792,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1552053,"internal_metadata":1883001163},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,3,8,5,34],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:14:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.0940000000000001,"15min":0.97799999999999998},"min":{"1min":0.24299999999999999,"5min":0.186,"15min":0.154},"max":{"1min":5.7290000000000001,"5min":12.076000000000001,"15min":12.933},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.046,"5min":1.306,"15min":1.2669999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":7.8940000000000001,"5min":17.196999999999999,"15min":17.196999999999999},"last":0.48699999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:14:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.5740000000000001,"15min":1.2629999999999999},"min":{"1min":0.22600000000000001,"5min":0.20999999999999999,"15min":0.183},"max":{"1min":7.2290000000000001,"5min":9.8510000000000009,"15min":11.945},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82199999999999995,"15min":0.68300000000000005},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":3.798,"5min":8.1430000000000007,"15min":8.1430000000000007},"last":0.28899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739260,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5914748,"kb_used_data":5113200,"kb_used_omap":934,"kb_used_meta":800601,"kb_avail":88457092,"statfs":{"total":96636764160,"available":90580062208,"internally_reserved":0,"allocated":5235916800,"data_stored":9131132202,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":819816238},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,3,0,4,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:14:29 2023","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.677,"15min":1.2090000000000001},"min":{"1min":0.28599999999999998,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":7.8899999999999997,"5min":25.927,"15min":25.927},"last":0.22800000000000001},{"interface":"front","average":{"1min":2.1520000000000001,"5min":1.758,"15min":1.361},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":13.903,"5min":26.632999999999999,"15min":26.632999999999999},"last":0.317}]},{"osd":2,"last update":"Sat Oct 14 01:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":1.044,"15min":0.90900000000000003},"min":{"1min":0.23200000000000001,"5min":0.214,"15min":0.191},"max":{"1min":2.4500000000000002,"5min":8.5559999999999992,"15min":10.106},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.77000000000000002,"15min":0.98599999999999999},"min":{"1min":0.251,"5min":0.22,"15min":0.21299999999999999},"max":{"1min":2.6000000000000001,"5min":5.4020000000000001,"15min":10.250999999999999},"last":0.35499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5235208192,"data_stored":9130703461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8501391360,"data_stored":14787637171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3266195456,"data_stored":5656945998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:14:41.076 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:14:41.077 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:14:41.077 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:14:41.077 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:14:41.078 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:14:41.078 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:14:41.079 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:14:42.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:42.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:42.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:42.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:42.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:42.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:42.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:42.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:42.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:42.177+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:42.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:42.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:42.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:42.185+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:42.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:42.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:42.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:42.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:43.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:43.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:43.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:43.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:43.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:43.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:43.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:43.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:43.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:43.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.153+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:43.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:43.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:43.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:43.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:43.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:43.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:44.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:44.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:44.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:44.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:44.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:44.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:44.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:44.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:44.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:44.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:44.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:44.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:44.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:44.041+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:44.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:44.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:44.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:44.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:44.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:44.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:44.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:44.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:45.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:45.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:45.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:45.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:45.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:45.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.117+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:45.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.133+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:45.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:45.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:45.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:14:45.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:14:45.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:14:45.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:45.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:45.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:45.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:45.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:45.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:45.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:45.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:45.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:45.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.257+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:45.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:45.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:45.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:45.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:45.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:45.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:45.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:45.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:45.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:45.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.549+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:45.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.565+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:45.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:45.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:45.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:46.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:46.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:14:46.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:46.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:46.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:46.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:46.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:46.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:46.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:46.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:46.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:46.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:46.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:46.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:46.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:46.401+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:46.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:46.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:46.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:46.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:46.971 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:14:46.965+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:14:48.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:48.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:14:48.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:48.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:48.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:48.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:48.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:48.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:48.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:48.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:48.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:48.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:48.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:48.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:48.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:48.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:48.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:48.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:48.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:48.217+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:48.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:48.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:48.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:48.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:49.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:49.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:49.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:49.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:51.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:14:51.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:14:51.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:51.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:51.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:51.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:51.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:51.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:51.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:51.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:51.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:51.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.816+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:51.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:51.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:51.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:52.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:14:52.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:52.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:52.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:52.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:52.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:52.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:52.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:52.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.704+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:52.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:52.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:52.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:52.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:52.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:52.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:52.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:52.940+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:54.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:54.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:54.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:54.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:54.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:54.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:54.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:54.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:54.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:54.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.776+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:54.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.776+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:54.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:14:54.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:14:54.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:54.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:54.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:54.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:54.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:54.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:54.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:54.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.932+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:54.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:54.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.968+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:54.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:54.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:54.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:54.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:54.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:54.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:54.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:54.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:55.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:55.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:55.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:55.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:55.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:55.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:55.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:55.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:55.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:55.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:55.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:55.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:55.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:55.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:55.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:55.256+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:55.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:55.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:55.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:55.260+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:56.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:55.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:56.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:55.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:56.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:56.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:56.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:56.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.044+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:56.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:56.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:56.163 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:14:56.160+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T01:14:56.163 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:14:56.160+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:14:56.164 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:14:56.160+0000 7f30478aa640 -1 reset not still connected to 0x55c894ab09c0 2023-10-14T01:14:56.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:14:56.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:56.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:56.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:56.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:56.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:56.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:56.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:56.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.764+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:56.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:56.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.764+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:56.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:56.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:56.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:56.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:56.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:57.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:57.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:57.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:57.000+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:57.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:57.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:57.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:57.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:57.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:57.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:57.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:57.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:57.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:57.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:57.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:57.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:57.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:57.288+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:58.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:14:58.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:58.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:58.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:58.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:58.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:58.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:58.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:58.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:58.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:58.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:58.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:14:58.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:58.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:14:59.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:59.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:14:59.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:59.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:14:59.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:59.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:14:59.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:59.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:14:59.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:59.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:59.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:59.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:14:59.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:59.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:14:59.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:59.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:14:59.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:59.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:14:59.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:59.248+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:14:59.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:59.248+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:14:59.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:14:59.248+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:00.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:00.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:00.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:00.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:00.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:00.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:00.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:00.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:00.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:00.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:00.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:00.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:00.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:00.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:00.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:00.596+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:00.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:00.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:00.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:00.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:01.079 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:15:01.873 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:15:01.874 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:15:01.935 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2399,"stamp":"2023-10-14T01:15:01.463883+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28757979603,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2129695,"num_read_kb":8256976,"num_write":2084736,"num_write_kb":8337479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80460,"ondisk_log_size":80460,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20860232,"kb_used_data":16676456,"kb_used_omap":2945,"kb_used_meta":4180798,"kb_avail":262255288,"statfs":{"total":289910292480,"available":268549414912,"internally_reserved":0,"allocated":17076690944,"data_stored":29647809941,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3016468,"internal_metadata":4281137388},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,1,1,9,3,10,12,11,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16613376,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4226,"num_read_kb":16824,"num_write":4244,"num_write_kb":16976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002010"},"pg_stats":[{"pgid":"2.7","version":"153'267230","reported_seq":523903,"reported_epoch":153,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:14:57.313766+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:14:57.313766+0000","last_peered":"2023-10-14T01:14:57.313766+0000","last_clean":"2023-10-14T01:14:57.313766+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:14:57.313766+0000","last_undegraded":"2023-10-14T01:14:57.313766+0000","last_fullsized":"2023-10-14T01:14:57.313766+0000","mapping_epoch":13,"log_start":"150'257217","ondisk_log_start":"150'257217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":144,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 50s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3498410520,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":259076,"num_read_kb":1003804,"num_write":252815,"num_write_kb":1010913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'281438","reported_seq":554608,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:14:57.364322+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:14:57.364322+0000","last_peered":"2023-10-14T01:14:57.364322+0000","last_clean":"2023-10-14T01:14:57.364322+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:14:57.364322+0000","last_undegraded":"2023-10-14T01:14:57.364322+0000","last_fullsized":"2023-10-14T01:14:57.364322+0000","mapping_epoch":13,"log_start":"150'271416","ondisk_log_start":"150'271416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3700109530,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":277099,"num_read_kb":1064800,"num_write":267146,"num_write_kb":1068113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'261808","reported_seq":515653,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:14:57.339089+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:14:57.339089+0000","last_peered":"2023-10-14T01:14:57.339089+0000","last_clean":"2023-10-14T01:14:57.339089+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:14:57.339089+0000","last_undegraded":"2023-10-14T01:14:57.339089+0000","last_fullsized":"2023-10-14T01:14:57.339089+0000","mapping_epoch":13,"log_start":"150'251723","ondisk_log_start":"150'251723","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3474371264,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":256069,"num_read_kb":995883,"num_write":251634,"num_write_kb":1006226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"153'259335","reported_seq":514613,"reported_epoch":153,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:14:57.357939+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:14:57.357939+0000","last_peered":"2023-10-14T01:14:57.357939+0000","last_clean":"2023-10-14T01:14:57.357939+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:14:57.357939+0000","last_undegraded":"2023-10-14T01:14:57.357939+0000","last_fullsized":"2023-10-14T01:14:57.357939+0000","mapping_epoch":13,"log_start":"150'249317","ondisk_log_start":"150'249317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3491390122,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":257210,"num_read_kb":1003788,"num_write":253400,"num_write_kb":1013349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"153'265064","reported_seq":528345,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:01.167195+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:15:01.167195+0000","last_peered":"2023-10-14T01:15:01.167195+0000","last_clean":"2023-10-14T01:15:01.167195+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:15:01.167195+0000","last_undegraded":"2023-10-14T01:15:01.167195+0000","last_fullsized":"2023-10-14T01:15:01.167195+0000","mapping_epoch":13,"log_start":"150'255023","ondisk_log_start":"150'255023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3562013193,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":265590,"num_read_kb":1024546,"num_write":259014,"num_write_kb":1035577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"153'266608","reported_seq":527907,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:14:58.599240+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:14:58.599240+0000","last_peered":"2023-10-14T01:14:58.599240+0000","last_clean":"2023-10-14T01:14:58.599240+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:14:58.599240+0000","last_undegraded":"2023-10-14T01:14:58.599240+0000","last_fullsized":"2023-10-14T01:14:58.599240+0000","mapping_epoch":13,"log_start":"150'256512","ondisk_log_start":"150'256512","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3603493182,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":262935,"num_read_kb":1029330,"num_write":261368,"num_write_kb":1045311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"153'267934","reported_seq":531453,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:14:58.591004+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:14:58.591004+0000","last_peered":"2023-10-14T01:14:58.591004+0000","last_clean":"2023-10-14T01:14:58.591004+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:14:58.591004+0000","last_undegraded":"2023-10-14T01:14:58.591004+0000","last_fullsized":"2023-10-14T01:14:58.591004+0000","mapping_epoch":13,"log_start":"150'257916","ondisk_log_start":"150'257916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3634909735,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":264955,"num_read_kb":1038656,"num_write":262647,"num_write_kb":1050451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"153'303084","reported_seq":586449,"reported_epoch":153,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:14:57.327591+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:14:57.327591+0000","last_peered":"2023-10-14T01:14:57.327591+0000","last_clean":"2023-10-14T01:14:57.327591+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:14:57.327591+0000","last_undegraded":"2023-10-14T01:14:57.327591+0000","last_fullsized":"2023-10-14T01:14:57.327591+0000","mapping_epoch":13,"log_start":"150'293016","ondisk_log_start":"150'293016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":119,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 46s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3792691689,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":286655,"num_read_kb":1096078,"num_write":276575,"num_write_kb":1105645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":329,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:14:05.448968+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:14:05.448968+0000","last_peered":"2023-10-14T01:14:05.448968+0000","last_clean":"2023-10-14T01:14:05.448968+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:14:05.448968+0000","last_undegraded":"2023-10-14T01:14:05.448968+0000","last_fullsized":"2023-10-14T01:14:05.448968+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28757389235,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2129589,"num_read_kb":8256885,"num_write":2084599,"num_write_kb":8335585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17073266688,"data_stored":29645758310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80361,"ondisk_log_size":80361,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739265,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4667608,"kb_used_data":3202768,"kb_used_omap":495,"kb_used_meta":1464336,"kb_avail":89704232,"statfs":{"total":96636764160,"available":91857133568,"internally_reserved":0,"allocated":3279634432,"data_stored":5669572083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507789,"internal_metadata":1499480179},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,0,1,0,2,5,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.748,"15min":1},"min":{"1min":0.19500000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.68300000000000005,"5min":6.1239999999999997,"15min":8.5800000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.434,"5min":0.79600000000000004,"15min":1.052},"min":{"1min":0.25700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.71599999999999997,"5min":6.1559999999999997,"15min":8.6140000000000008},"last":0.58099999999999996}]},{"osd":1,"last update":"Sat Oct 14 01:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.72699999999999998,"15min":0.78900000000000003},"min":{"1min":0.21299999999999999,"5min":0.193,"15min":0.193},"max":{"1min":6.4329999999999998,"5min":6.4329999999999998,"15min":11.999000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.83299999999999996,"15min":1.0369999999999999},"min":{"1min":0.246,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":2.7010000000000001,"5min":6.9210000000000003,"15min":11.082000000000001},"last":0.621}]}]},{"osd":1,"up_from":8,"seq":34359739251,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10310184,"kb_used_data":8335136,"kb_used_omap":1515,"kb_used_meta":1973524,"kb_avail":84061656,"statfs":{"total":96636764160,"available":86079135744,"internally_reserved":0,"allocated":8535179264,"data_stored":14821145208,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1552053,"internal_metadata":2020888907},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,7,2,5,5,8,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:14:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.0940000000000001,"15min":0.97799999999999998},"min":{"1min":0.24299999999999999,"5min":0.186,"15min":0.154},"max":{"1min":5.7290000000000001,"5min":12.076000000000001,"15min":12.933},"last":0.193},{"interface":"front","average":{"1min":1.046,"5min":1.306,"15min":1.2669999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":7.8940000000000001,"5min":17.196999999999999,"15min":17.196999999999999},"last":0.248}]},{"osd":2,"last update":"Sat Oct 14 01:14:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.5740000000000001,"15min":1.2629999999999999},"min":{"1min":0.22600000000000001,"5min":0.20999999999999999,"15min":0.183},"max":{"1min":7.2290000000000001,"5min":9.8510000000000009,"15min":11.945},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82199999999999995,"15min":0.68300000000000005},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":3.798,"5min":8.1430000000000007,"15min":8.1430000000000007},"last":0.29899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739265,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5882440,"kb_used_data":5138552,"kb_used_omap":934,"kb_used_meta":742937,"kb_avail":88489400,"statfs":{"total":96636764160,"available":90613145600,"internally_reserved":0,"allocated":5261877248,"data_stored":9157092650,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":760768302},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,1,1,3,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:14:29 2023","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.677,"15min":1.2090000000000001},"min":{"1min":0.28599999999999998,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":7.8899999999999997,"5min":25.927,"15min":25.927},"last":0.46200000000000002},{"interface":"front","average":{"1min":2.1520000000000001,"5min":1.758,"15min":1.361},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":13.903,"5min":26.632999999999999,"15min":26.632999999999999},"last":0.496}]},{"osd":2,"last update":"Sat Oct 14 01:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":1.044,"15min":0.90900000000000003},"min":{"1min":0.23200000000000001,"5min":0.214,"15min":0.191},"max":{"1min":2.4500000000000002,"5min":8.5559999999999992,"15min":10.106},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.77000000000000002,"15min":0.98599999999999999},"min":{"1min":0.251,"5min":0.22,"15min":0.21299999999999999},"max":{"1min":2.6000000000000001,"5min":5.4020000000000001,"15min":10.250999999999999},"last":0.32100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5260423168,"data_stored":9155918437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8534290432,"data_stored":14820536243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3278553088,"data_stored":5669303630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:15:01.937 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:01.937 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:01.937 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:01.938 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:01.938 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:01.939 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:15:03.104 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:15:03.100+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:15:04.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:04.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:04.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:04.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:04.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:04.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:04.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:04.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:04.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:04.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:04.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:04.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:04.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:04.868+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:04.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:04.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:04.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:04.868+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:05.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:05.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:05.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:05.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:05.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:05.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:05.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:05.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.144+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:05.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:05.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:05.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:05.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:05.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:05.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:05.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:05.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:05.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:05.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:05.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.620+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:05.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:05.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:05.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:06.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:06.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:06.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:06.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:06.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:06.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:06.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:06.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:06.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:06.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:06.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:06.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:06.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:06.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:06.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:06.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:06.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:06.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:06.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:06.324+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:06.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:06.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:06.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:06.324+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:07.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:07.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:07.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:07.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:07.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:07.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:07.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:07.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:07.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:07.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:07.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:07.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:07.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:07.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:07.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:07.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:07.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:07.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:07.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:07.348+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:07.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:07.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:07.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:07.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:08.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:08.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:08.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:08.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:08.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:08.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:08.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:08.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:08.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:08.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:08.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:08.560+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:08.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:08.560+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:08.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:08.564+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:08.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:08.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:08.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:08.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:08.702 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:15:08.700+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:15:09.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:09.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:09.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:09.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:09.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:09.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:09.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:09.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:09.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:09.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:09.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:09.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:09.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:09.716+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:09.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:09.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:09.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:09.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:11.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:11.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:11.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.024+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:11.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.024+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:11.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:11.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:11.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:11.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:11.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:11.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:11.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:11.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:11.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.960+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:11.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:11.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:11.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:12.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:12.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:12.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:12.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:12.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:12.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:12.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:12.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:12.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:12.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:12.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:12.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:12.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:12.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:12.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:12.148+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:12.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:12.148+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:12.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:12.148+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:13.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:13.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:13.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:13.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:13.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:13.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:13.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:13.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.092+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:13.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.092+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:13.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.100+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:13.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:13.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:13.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:13.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:13.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:13.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:13.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:13.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:13.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:13.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:13.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.744+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:13.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:13.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:13.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:15.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:15:15.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:15.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:15.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:15.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:15.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:15.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:15.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:15.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:15.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:15.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:15.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.644+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:15.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:15.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:15.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:16.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:16.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:16.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:16.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:16.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:16.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:16.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:16.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:17.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:17.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:17.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:17.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:17.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:17.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:17.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:17.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:17.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:17.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:17.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:17.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:17.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:17.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:18.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:18.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:18.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:18.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:18.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:18.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:18.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:18.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:18.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:18.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:18.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:18.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:18.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:18.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:18.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:18.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:18.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:18.788+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:18.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:18.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:18.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:18.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:20.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:20.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:20.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:20.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:20.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:20.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:20.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:20.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:20.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:20.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:20.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.300+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:20.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:20.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:20.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:21.410 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:15:21.408+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:15:21.940 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:15:22.757 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:15:22.759 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:15:22.810 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2409,"stamp":"2023-10-14T01:15:21.469655+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28788470227,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2137598,"num_read_kb":8288436,"num_write":2092557,"num_write_kb":8368763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80567,"ondisk_log_size":80567,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21144052,"kb_used_data":16738140,"kb_used_omap":2945,"kb_used_meta":4402942,"kb_avail":261971468,"statfs":{"total":289910292480,"available":268258783232,"internally_reserved":0,"allocated":17139855360,"data_stored":29710974357,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3016468,"internal_metadata":4508612844},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,1,6,5,8,14,6,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15654912,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4181,"num_read_kb":16644,"num_write":4014,"num_write_kb":16056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004470"},"pg_stats":[{"pgid":"2.7","version":"153'268303","reported_seq":525979,"reported_epoch":153,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:15:17.962947+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:15:17.962947+0000","last_peered":"2023-10-14T01:15:17.962947+0000","last_clean":"2023-10-14T01:15:17.962947+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:15:17.962947+0000","last_undegraded":"2023-10-14T01:15:17.962947+0000","last_fullsized":"2023-10-14T01:15:17.962947+0000","mapping_epoch":13,"log_start":"150'258217","ondisk_log_start":"150'258217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":240,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 71s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3502121496,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":260055,"num_read_kb":1007700,"num_write":253758,"num_write_kb":1014685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'282555","reported_seq":556754,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:17.936456+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:15:17.936456+0000","last_peered":"2023-10-14T01:15:17.936456+0000","last_clean":"2023-10-14T01:15:17.936456+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:15:17.936456+0000","last_undegraded":"2023-10-14T01:15:17.936456+0000","last_fullsized":"2023-10-14T01:15:17.936456+0000","mapping_epoch":13,"log_start":"150'272516","ondisk_log_start":"150'272516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3704242394,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":278114,"num_read_kb":1068840,"num_write":268206,"num_write_kb":1072353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'262766","reported_seq":517560,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:17.924399+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:15:17.924399+0000","last_peered":"2023-10-14T01:15:17.924399+0000","last_clean":"2023-10-14T01:15:17.924399+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:15:17.924399+0000","last_undegraded":"2023-10-14T01:15:17.924399+0000","last_fullsized":"2023-10-14T01:15:17.924399+0000","mapping_epoch":13,"log_start":"150'252723","ondisk_log_start":"150'252723","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3477971648,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":257010,"num_read_kb":999635,"num_write":252551,"num_write_kb":1009894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"153'260365","reported_seq":516626,"reported_epoch":153,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:15:17.880071+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:15:17.880071+0000","last_peered":"2023-10-14T01:15:17.880071+0000","last_clean":"2023-10-14T01:15:17.880071+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:15:17.880071+0000","last_undegraded":"2023-10-14T01:15:17.880071+0000","last_fullsized":"2023-10-14T01:15:17.880071+0000","mapping_epoch":13,"log_start":"150'250317","ondisk_log_start":"150'250317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":93,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 20s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3495076522,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":258181,"num_read_kb":1007640,"num_write":254340,"num_write_kb":1017109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"153'266066","reported_seq":530324,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:21.398093+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:15:21.398093+0000","last_peered":"2023-10-14T01:15:21.398093+0000","last_clean":"2023-10-14T01:15:21.398093+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:15:21.398093+0000","last_undegraded":"2023-10-14T01:15:21.398093+0000","last_fullsized":"2023-10-14T01:15:21.398093+0000","mapping_epoch":13,"log_start":"150'256023","ondisk_log_start":"150'256023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3565896201,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":266560,"num_read_kb":1028406,"num_write":260004,"num_write_kb":1039537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"153'267574","reported_seq":529851,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:18.727659+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:15:18.727659+0000","last_peered":"2023-10-14T01:15:18.727659+0000","last_clean":"2023-10-14T01:15:18.727659+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:15:18.727659+0000","last_undegraded":"2023-10-14T01:15:18.727659+0000","last_fullsized":"2023-10-14T01:15:18.727659+0000","mapping_epoch":13,"log_start":"150'257512","ondisk_log_start":"150'257512","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3607257406,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":263909,"num_read_kb":1033214,"num_write":262329,"num_write_kb":1049155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"153'268890","reported_seq":533395,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:18.696244+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:15:18.696244+0000","last_peered":"2023-10-14T01:15:18.696244+0000","last_clean":"2023-10-14T01:15:18.696244+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:15:18.696244+0000","last_undegraded":"2023-10-14T01:15:18.696244+0000","last_fullsized":"2023-10-14T01:15:18.696244+0000","mapping_epoch":13,"log_start":"150'258816","ondisk_log_start":"150'258816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3638612519,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":265937,"num_read_kb":1042568,"num_write":263598,"num_write_kb":1054255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"153'304289","reported_seq":588752,"reported_epoch":153,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:15:17.877732+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:15:17.877732+0000","last_peered":"2023-10-14T01:15:17.877732+0000","last_clean":"2023-10-14T01:15:17.877732+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:15:17.877732+0000","last_undegraded":"2023-10-14T01:15:17.877732+0000","last_fullsized":"2023-10-14T01:15:17.877732+0000","mapping_epoch":13,"log_start":"151'294216","ondisk_log_start":"151'294216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":158,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 67s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3796701673,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":287726,"num_read_kb":1100342,"num_write":277634,"num_write_kb":1109881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":329,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:14:05.448968+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:14:05.448968+0000","last_peered":"2023-10-14T01:14:05.448968+0000","last_clean":"2023-10-14T01:14:05.448968+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:14:05.448968+0000","last_undegraded":"2023-10-14T01:14:05.448968+0000","last_fullsized":"2023-10-14T01:14:05.448968+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28787879859,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2137492,"num_read_kb":8288345,"num_write":2092420,"num_write_kb":8366869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17137520640,"data_stored":29710012262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80468,"ondisk_log_size":80468,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739269,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4711356,"kb_used_data":3214580,"kb_used_omap":495,"kb_used_meta":1496272,"kb_avail":89660484,"statfs":{"total":96636764160,"available":91812335616,"internally_reserved":0,"allocated":3291729920,"data_stored":5681667571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507789,"internal_metadata":1532182643},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,1,3,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.748,"15min":1},"min":{"1min":0.19500000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.68300000000000005,"5min":6.1239999999999997,"15min":8.5800000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.434,"5min":0.79600000000000004,"15min":1.052},"min":{"1min":0.25700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.71599999999999997,"5min":6.1559999999999997,"15min":8.6140000000000008},"last":0.42599999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.72699999999999998,"15min":0.78900000000000003},"min":{"1min":0.21299999999999999,"5min":0.193,"15min":0.193},"max":{"1min":6.4329999999999998,"5min":6.4329999999999998,"15min":11.999000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.83299999999999996,"15min":1.0369999999999999},"min":{"1min":0.246,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":2.7010000000000001,"5min":6.9210000000000003,"15min":11.082000000000001},"last":0.35799999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739255,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10458992,"kb_used_data":8365928,"kb_used_omap":1515,"kb_used_meta":2091540,"kb_avail":83912848,"statfs":{"total":96636764160,"available":85926756352,"internally_reserved":0,"allocated":8566710272,"data_stored":14852676216,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1552053,"internal_metadata":2141737291},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,1,3,4,12,6,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:14:22 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.0940000000000001,"15min":0.97799999999999998},"min":{"1min":0.24299999999999999,"5min":0.186,"15min":0.154},"max":{"1min":5.7290000000000001,"5min":12.076000000000001,"15min":12.933},"last":0.39000000000000001},{"interface":"front","average":{"1min":1.046,"5min":1.306,"15min":1.2669999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":7.8940000000000001,"5min":17.196999999999999,"15min":17.196999999999999},"last":0.42699999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:14:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.5740000000000001,"15min":1.2629999999999999},"min":{"1min":0.22600000000000001,"5min":0.20999999999999999,"15min":0.183},"max":{"1min":7.2290000000000001,"5min":9.8510000000000009,"15min":11.945},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.82199999999999995,"15min":0.68300000000000005},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":3.798,"5min":8.1430000000000007,"15min":8.1430000000000007},"last":0.32000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739269,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5973704,"kb_used_data":5157632,"kb_used_omap":934,"kb_used_meta":815129,"kb_avail":88398136,"statfs":{"total":96636764160,"available":90519691264,"internally_reserved":0,"allocated":5281415168,"data_stored":9176630570,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":834692910},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:14:29 2023","interfaces":[{"interface":"back","average":{"1min":1.7090000000000001,"5min":1.677,"15min":1.2090000000000001},"min":{"1min":0.28599999999999998,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":7.8899999999999997,"5min":25.927,"15min":25.927},"last":0.37},{"interface":"front","average":{"1min":2.1520000000000001,"5min":1.758,"15min":1.361},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.189},"max":{"1min":13.903,"5min":26.632999999999999,"15min":26.632999999999999},"last":0.34999999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":1.044,"15min":0.90900000000000003},"min":{"1min":0.23200000000000001,"5min":0.214,"15min":0.191},"max":{"1min":2.4500000000000002,"5min":8.5559999999999992,"15min":10.106},"last":2.0960000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.77000000000000002,"15min":0.98599999999999999},"min":{"1min":0.251,"5min":0.22,"15min":0.21299999999999999},"max":{"1min":2.6000000000000001,"5min":5.4020000000000001,"15min":10.250999999999999},"last":2.0659999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5280141312,"data_stored":9175636581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8566792192,"data_stored":14853038003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3290587136,"data_stored":5681337678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:15:22.814 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:22.815 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:22.815 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:22.815 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:22.816 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:22.816 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:15:23.541 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:15:23.540+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:15:23.685 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:15:23.684+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:15:25.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:25.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:25.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:25.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:25.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:25.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:25.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:25.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:25.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:25.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:25.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:25.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:25.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:25.564+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:25.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:25.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:25.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:25.568+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:25.885 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:15:25.884+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:15:26.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:26.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:26.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:26.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:26.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:26.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:28.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:15:28.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:28.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:15:28.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:28.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:28.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:28.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:28.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:28.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:28.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:28.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:28.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:28.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.392+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:28.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:28.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:28.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:29.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:29.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:15:29.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:29.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:29.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:29.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:29.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:29.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:29.486 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:15:29.484+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:15:29.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:29.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:29.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:29.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:29.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:29.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:29.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:29.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:29.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:29.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:29.539 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:15:29.536+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:15:29.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:29.572+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:29.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:29.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:29.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:29.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:30.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:30.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:30.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:30.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:30.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:30.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:30.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:30.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:30.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:30.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:30.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:30.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:30.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:30.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:30.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:30.992+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:30.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:30.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:30.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:30.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:32.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:32.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:32.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:32.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:32.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:32.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:32.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:32.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:32.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:32.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:32.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.316+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:32.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:32.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:32.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:32.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:32.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:32.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:32.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:32.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:32.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:34.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:34.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:34.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:34.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:34.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:34.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.476+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:34.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:34.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:34.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:34.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:15:34.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:34.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:34.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:34.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:34.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:34.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:34.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:34.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:34.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.828+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:34.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:34.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:34.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:35.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:35.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:35.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:35.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:35.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:35.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:35.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.204+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:35.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:35.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:35.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:35.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:35.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:35.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:35.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:35.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:35.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:35.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:35.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:35.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:35.968+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:37.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:15:37.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:37.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:37.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:37.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:37.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:37.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:37.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:37.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:37.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:37.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.240+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:37.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:37.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:37.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:39.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:39.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:39.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:39.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:40.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:40.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:40.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:40.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:40.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:40.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:40.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:40.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:40.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:40.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:40.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:40.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:40.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:40.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:40.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:40.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:40.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:40.180+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:40.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:40.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:40.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:40.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:40.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:40.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:41.780 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:15:41.780+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:15:41.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:41.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:41.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:41.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:41.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:41.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:41.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:41.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:41.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:41.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:42.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:42.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:42.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:42.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:42.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:42.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:42.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:42.012+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:42.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:42.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:42.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:42.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:42.818 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:15:42.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:42.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:43.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:43.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:43.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:43.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:43.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:43.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:43.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:43.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:43.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.108+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:43.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:43.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:43.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:43.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:43.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:43.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:43.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:43.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:43.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:43.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.460+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:43.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.476+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:43.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:43.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:43.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:43.803 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:15:43.804 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:15:43.870 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2420,"stamp":"2023-10-14T01:15:43.481155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28819001811,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2145561,"num_read_kb":8320140,"num_write":2100384,"num_write_kb":8400071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80481,"ondisk_log_size":80481,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20760440,"kb_used_data":16800160,"kb_used_omap":3062,"kb_used_meta":3957193,"kb_avail":262355080,"statfs":{"total":289910292480,"available":268651601920,"internally_reserved":0,"allocated":17203363840,"data_stored":29774482837,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3135636,"internal_metadata":4052166508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,2,6,7,15,21,9,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15384576,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3971,"num_read_kb":15796,"num_write":3933,"num_write_kb":15732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005449"},"pg_stats":[{"pgid":"2.7","version":"153'269373","reported_seq":528031,"reported_epoch":153,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:15:38.826461+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:15:38.826461+0000","last_peered":"2023-10-14T01:15:38.826461+0000","last_clean":"2023-10-14T01:15:38.826461+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:15:38.826461+0000","last_undegraded":"2023-10-14T01:15:38.826461+0000","last_fullsized":"2023-10-14T01:15:38.826461+0000","mapping_epoch":13,"log_start":"151'259317","ondisk_log_start":"151'259317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":314,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 92s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3505992216,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":261018,"num_read_kb":1011536,"num_write":254730,"num_write_kb":1018573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"153'283606","reported_seq":558851,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:38.831142+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:15:38.831142+0000","last_peered":"2023-10-14T01:15:38.831142+0000","last_clean":"2023-10-14T01:15:38.831142+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:15:38.831142+0000","last_undegraded":"2023-10-14T01:15:38.831142+0000","last_fullsized":"2023-10-14T01:15:38.831142+0000","mapping_epoch":13,"log_start":"151'273516","ondisk_log_start":"151'273516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3708166362,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":279150,"num_read_kb":1072960,"num_write":269215,"num_write_kb":1076389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"153'263746","reported_seq":519579,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:38.840689+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:15:38.840689+0000","last_peered":"2023-10-14T01:15:38.840689+0000","last_clean":"2023-10-14T01:15:38.840689+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:15:38.840689+0000","last_undegraded":"2023-10-14T01:15:38.840689+0000","last_fullsized":"2023-10-14T01:15:38.840689+0000","mapping_epoch":13,"log_start":"150'253723","ondisk_log_start":"150'253723","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3481678528,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":258042,"num_read_kb":1003731,"num_write":253503,"num_write_kb":1013702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"153'261460","reported_seq":518696,"reported_epoch":153,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:15:38.825239+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:15:38.825239+0000","last_peered":"2023-10-14T01:15:38.825239+0000","last_clean":"2023-10-14T01:15:38.825239+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:15:38.825239+0000","last_undegraded":"2023-10-14T01:15:38.825239+0000","last_fullsized":"2023-10-14T01:15:38.825239+0000","mapping_epoch":13,"log_start":"151'251417","ondisk_log_start":"151'251417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":164,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 41s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3498984106,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":259145,"num_read_kb":1011492,"num_write":255366,"num_write_kb":1021213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"153'267031","reported_seq":532247,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:41.527742+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:15:41.527742+0000","last_peered":"2023-10-14T01:15:41.527742+0000","last_clean":"2023-10-14T01:15:41.527742+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:15:41.527742+0000","last_undegraded":"2023-10-14T01:15:41.527742+0000","last_fullsized":"2023-10-14T01:15:41.527742+0000","mapping_epoch":13,"log_start":"151'257023","ondisk_log_start":"151'257023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3569623561,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":267504,"num_read_kb":1032154,"num_write":260948,"num_write_kb":1043313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"153'268472","reported_seq":531769,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:38.858967+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:15:38.858967+0000","last_peered":"2023-10-14T01:15:38.858967+0000","last_clean":"2023-10-14T01:15:38.858967+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:15:38.858967+0000","last_undegraded":"2023-10-14T01:15:38.858967+0000","last_fullsized":"2023-10-14T01:15:38.858967+0000","mapping_epoch":13,"log_start":"151'258412","ondisk_log_start":"151'258412","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3610751294,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":264925,"num_read_kb":1037266,"num_write":263220,"num_write_kb":1052719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"153'269848","reported_seq":535300,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:38.858243+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:15:38.858243+0000","last_peered":"2023-10-14T01:15:38.858243+0000","last_clean":"2023-10-14T01:15:38.858243+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:15:38.858243+0000","last_undegraded":"2023-10-14T01:15:38.858243+0000","last_fullsized":"2023-10-14T01:15:38.858243+0000","mapping_epoch":13,"log_start":"151'259816","ondisk_log_start":"151'259816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3642348071,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":266880,"num_read_kb":1046320,"num_write":264549,"num_write_kb":1058059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"153'305486","reported_seq":591043,"reported_epoch":153,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:15:38.818882+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:15:38.818882+0000","last_peered":"2023-10-14T01:15:38.818882+0000","last_clean":"2023-10-14T01:15:38.818882+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:15:38.818882+0000","last_undegraded":"2023-10-14T01:15:38.818882+0000","last_fullsized":"2023-10-14T01:15:38.818882+0000","mapping_epoch":13,"log_start":"151'295416","ondisk_log_start":"151'295416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":201,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 88s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3800867305,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":288791,"num_read_kb":1104590,"num_write":278716,"num_write_kb":1114209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":329,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-10-14T01:14:05.448968+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:14:05.448968+0000","last_peered":"2023-10-14T01:14:05.448968+0000","last_clean":"2023-10-14T01:14:05.448968+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:14:05.448968+0000","last_undegraded":"2023-10-14T01:14:05.448968+0000","last_fullsized":"2023-10-14T01:14:05.448968+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28818411443,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2145455,"num_read_kb":8320049,"num_write":2100247,"num_write_kb":8398177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17201082368,"data_stored":29773573990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80382,"ondisk_log_size":80382,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739273,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4789328,"kb_used_data":3225928,"kb_used_omap":495,"kb_used_meta":1562896,"kb_avail":89582512,"statfs":{"total":96636764160,"available":91732492288,"internally_reserved":0,"allocated":3303350272,"data_stored":5693287923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507789,"internal_metadata":1600405619},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,4,2,7,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.748,"15min":1},"min":{"1min":0.19500000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.68300000000000005,"5min":6.1239999999999997,"15min":8.5800000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.79600000000000004,"15min":1.052},"min":{"1min":0.25700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.71599999999999997,"5min":6.1559999999999997,"15min":8.6140000000000008},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat Oct 14 01:14:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.72699999999999998,"15min":0.78900000000000003},"min":{"1min":0.21299999999999999,"5min":0.193,"15min":0.193},"max":{"1min":6.4329999999999998,"5min":6.4329999999999998,"15min":11.999000000000001},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.83299999999999996,"15min":1.0369999999999999},"min":{"1min":0.246,"5min":0.23100000000000001,"15min":0.222},"max":{"1min":2.7010000000000001,"5min":6.9210000000000003,"15min":11.082000000000001},"last":0.56999999999999995}]}]},{"osd":1,"up_from":8,"seq":34359739259,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10032800,"kb_used_data":8397720,"kb_used_omap":1632,"kb_used_meta":1633439,"kb_avail":84339040,"statfs":{"total":96636764160,"available":86363176960,"internally_reserved":0,"allocated":8599265280,"data_stored":14885231224,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1671221,"internal_metadata":1672642507},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,3,1,3,3,8,12,5,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":1.054,"15min":0.92500000000000004},"min":{"1min":0.193,"5min":0.193,"15min":0.154},"max":{"1min":0.57399999999999995,"5min":12.076000000000001,"15min":12.933},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.374,"5min":1.222,"15min":1.238},"min":{"1min":0.248,"5min":0.185,"15min":0.185},"max":{"1min":0.49099999999999999,"5min":17.196999999999999,"15min":17.196999999999999},"last":0.27000000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.538,"15min":1.232},"min":{"1min":0.22800000000000001,"5min":0.22600000000000001,"15min":0.183},"max":{"1min":4.8650000000000002,"5min":9.8510000000000009,"15min":10.866},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.78300000000000003,"15min":0.65000000000000002},"min":{"1min":0.25900000000000001,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":0.503,"5min":8.1430000000000007,"15min":8.1430000000000007},"last":0.41299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739273,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5938312,"kb_used_data":5176512,"kb_used_omap":934,"kb_used_meta":760857,"kb_avail":88433528,"statfs":{"total":96636764160,"available":90555932672,"internally_reserved":0,"allocated":5300748288,"data_stored":9195963690,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":779118382},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,0,5,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":1.165,"15min":1.194},"min":{"1min":0.22800000000000001,"5min":0.20300000000000001,"15min":0.17899999999999999},"max":{"1min":2.2839999999999998,"5min":7.8899999999999997,"15min":25.927},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.306,"15min":1.3660000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":3.27,"5min":13.903,"15min":26.632999999999999},"last":0.32100000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.93500000000000005,"15min":0.86499999999999999},"min":{"1min":0.221,"5min":0.22,"15min":0.191},"max":{"1min":2.129,"5min":8.5559999999999992,"15min":8.5559999999999992},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.93700000000000006},"min":{"1min":0.216,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":3.194,"5min":5.4020000000000001,"15min":10.228999999999999},"last":0.28299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5299408896,"data_stored":9194904165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8599265280,"data_stored":14885511091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3302408192,"data_stored":5693158734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:15:43.872 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:43.872 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:43.873 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:43.873 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:43.874 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:15:43.874 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:15:45.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:45.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:45.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:45.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:45.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:45.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:45.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:45.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:45.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:45.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:45.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:45.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:45.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:45.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:45.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:45.232+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:45.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:45.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:45.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:45.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:46.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:46.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:46.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:46.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:46.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:46.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:46.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:46.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:46.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:46.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.312+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:46.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:46.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:46.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.644+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:46.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:46.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:46.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:46.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:46.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:48.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:48.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:48.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:48.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:48.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:48.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:48.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:48.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:48.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:48.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:48.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:48.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:48.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:48.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:48.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:48.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:48.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:48.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:48.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:48.448+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:48.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:48.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:48.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:48.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:49.558 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:15:49.556+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:15:50.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:50.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:50.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:50.644+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:51.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:51.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:51.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:51.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:51.530 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:15:51.532+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:15:51.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:51.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:51.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:51.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:51.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:51.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:51.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:51.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:51.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:51.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:51.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:51.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:51.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:51.648+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:51.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:51.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:51.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:51.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:52.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:52.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:52.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:52.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:52.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:52.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:52.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:52.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:52.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.928+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:52.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:52.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.940+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:52.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.940+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:52.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:52.940+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:53.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:53.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:53.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:53.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:53.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:53.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:53.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:53.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:53.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:53.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:53.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:53.344+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:53.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:53.352+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:53.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:53.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:53.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:53.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:54.966 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:15:54.959+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:15:56.952 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:15:56.943+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:15:57.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:57.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:57.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:57.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:57.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:57.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:57.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:57.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:57.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:57.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:57.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:57.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:57.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:57.255+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:57.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:57.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:57.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:57.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:58.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:58.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:58.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:58.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:58.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:58.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:58.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:58.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:58.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.543+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:58.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:58.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:58.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:58.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:15:58.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:58.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:58.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:59.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:59.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:58.991+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:59.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.003+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:59.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.031+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:59.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.031+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:59.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.031+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:15:59.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:59.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:59.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:59.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:59.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:59.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.159+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:59.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:15:59.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:15:59.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:15:59.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:15:59.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:15:59.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:15:59.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:15:59.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:15:59.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:15:59.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.731+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:15:59.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:15:59.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:15:59.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:00.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:00.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:00.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:00.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:00.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:00.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:00.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:00.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:00.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:00.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:00.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:00.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:00.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:00.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:00.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:00.487+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:00.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:00.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:00.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:00.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:01.934 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:16:01.931+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:16:03.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:03.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:16:03.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:03.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:03.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:03.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:03.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:03.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:03.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:03.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:03.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:03.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.859+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:03.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:03.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:03.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:03.875 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:16:04.752 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:16:04.753 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:16:04.817 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2431,"stamp":"2023-10-14T01:16:03.490900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28849971667,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2153745,"num_read_kb":8352692,"num_write":2108303,"num_write_kb":8431747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80442,"ondisk_log_size":80442,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21075656,"kb_used_data":16863336,"kb_used_omap":3062,"kb_used_meta":4209225,"kb_avail":262039864,"statfs":{"total":289910292480,"available":268328820736,"internally_reserved":0,"allocated":17268056064,"data_stored":29839162977,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3135636,"internal_metadata":4310247276},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,0,3,14,8,9,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16523264,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4450,"num_read_kb":17720,"num_write":4234,"num_write_kb":16936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002477"},"pg_stats":[{"pgid":"2.7","version":"154'270467","reported_seq":530154,"reported_epoch":154,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:15:59.312610+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:15:59.312610+0000","last_peered":"2023-10-14T01:15:59.312610+0000","last_clean":"2023-10-14T01:15:59.312610+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:15:59.312610+0000","last_undegraded":"2023-10-14T01:15:59.312610+0000","last_fullsized":"2023-10-14T01:15:59.312610+0000","mapping_epoch":13,"log_start":"151'260417","ondisk_log_start":"151'260417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":385,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 112s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3509948952,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":262024,"num_read_kb":1015528,"num_write":255723,"num_write_kb":1022545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"154'284671","reported_seq":560986,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:15:59.285136+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:15:59.285136+0000","last_peered":"2023-10-14T01:15:59.285136+0000","last_clean":"2023-10-14T01:15:59.285136+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:15:59.285136+0000","last_undegraded":"2023-10-14T01:15:59.285136+0000","last_fullsized":"2023-10-14T01:15:59.285136+0000","mapping_epoch":13,"log_start":"151'274616","ondisk_log_start":"151'274616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3712110810,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":280206,"num_read_kb":1077160,"num_write":270232,"num_write_kb":1080457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"154'264725","reported_seq":521564,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:15:59.305450+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:15:59.305450+0000","last_peered":"2023-10-14T01:15:59.305450+0000","last_clean":"2023-10-14T01:15:59.305450+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:15:59.305450+0000","last_undegraded":"2023-10-14T01:15:59.305450+0000","last_fullsized":"2023-10-14T01:15:59.305450+0000","mapping_epoch":13,"log_start":"151'254723","ondisk_log_start":"151'254723","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3485434560,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":259039,"num_read_kb":1007695,"num_write":254449,"num_write_kb":1017486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"154'262531","reported_seq":520842,"reported_epoch":154,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:15:59.279294+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:15:59.279294+0000","last_peered":"2023-10-14T01:15:59.279294+0000","last_clean":"2023-10-14T01:15:59.279294+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:15:59.279294+0000","last_undegraded":"2023-10-14T01:15:59.279294+0000","last_fullsized":"2023-10-14T01:15:59.279294+0000","mapping_epoch":13,"log_start":"151'252517","ondisk_log_start":"151'252517","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":276,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 62s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3502748330,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":260206,"num_read_kb":1015724,"num_write":256336,"num_write_kb":1025093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"154'268008","reported_seq":534239,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:16:01.704584+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:16:01.704584+0000","last_peered":"2023-10-14T01:16:01.704584+0000","last_clean":"2023-10-14T01:16:01.704584+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:16:01.704584+0000","last_undegraded":"2023-10-14T01:16:01.704584+0000","last_fullsized":"2023-10-14T01:16:01.704584+0000","mapping_epoch":13,"log_start":"151'257923","ondisk_log_start":"151'257923","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3573449225,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":268508,"num_read_kb":1036154,"num_write":261922,"num_write_kb":1047209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"154'269456","reported_seq":533758,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:15:58.986713+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:15:58.986713+0000","last_peered":"2023-10-14T01:15:58.986713+0000","last_clean":"2023-10-14T01:15:58.986713+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:15:58.986713+0000","last_undegraded":"2023-10-14T01:15:58.986713+0000","last_fullsized":"2023-10-14T01:15:58.986713+0000","mapping_epoch":13,"log_start":"151'259412","ondisk_log_start":"151'259412","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3614597438,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":265930,"num_read_kb":1041246,"num_write":264196,"num_write_kb":1056623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"154'270851","reported_seq":537304,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:15:58.981376+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:15:58.981376+0000","last_peered":"2023-10-14T01:15:58.981376+0000","last_clean":"2023-10-14T01:15:58.981376+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:15:58.981376+0000","last_undegraded":"2023-10-14T01:15:58.981376+0000","last_fullsized":"2023-10-14T01:15:58.981376+0000","mapping_epoch":13,"log_start":"151'260816","ondisk_log_start":"151'260816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3646218791,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":267877,"num_read_kb":1050292,"num_write":265544,"num_write_kb":1062039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"154'306674","reported_seq":593323,"reported_epoch":154,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:15:59.306036+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:15:59.306036+0000","last_peered":"2023-10-14T01:15:59.306036+0000","last_clean":"2023-10-14T01:15:59.306036+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:15:59.306036+0000","last_undegraded":"2023-10-14T01:15:59.306036+0000","last_fullsized":"2023-10-14T01:15:59.306036+0000","mapping_epoch":13,"log_start":"151'296616","ondisk_log_start":"151'296616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":259,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 108s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3804873193,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":289849,"num_read_kb":1108802,"num_write":279764,"num_write_kb":1118401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":331,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:49.000601+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:15:49.000601+0000","last_peered":"2023-10-14T01:15:49.000601+0000","last_clean":"2023-10-14T01:15:49.000601+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:15:49.000601+0000","last_undegraded":"2023-10-14T01:15:49.000601+0000","last_fullsized":"2023-10-14T01:15:49.000601+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28849381299,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2153639,"num_read_kb":8352601,"num_write":2108166,"num_write_kb":8429853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17265651712,"data_stored":29838143334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80343,"ondisk_log_size":80343,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739277,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4869324,"kb_used_data":3237892,"kb_used_omap":495,"kb_used_meta":1630928,"kb_avail":89502516,"statfs":{"total":96636764160,"available":91650576384,"internally_reserved":0,"allocated":3315601408,"data_stored":5705535031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507789,"internal_metadata":1670070387},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.83299999999999996,"15min":0.89500000000000002},"min":{"1min":0.23300000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":3.8090000000000002,"5min":6.1239999999999997,"15min":8.5800000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.88100000000000001,"15min":0.94599999999999995},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":3.8700000000000001,"5min":6.1559999999999997,"15min":8.6140000000000008},"last":0.443}]},{"osd":1,"last update":"Sat Oct 14 01:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.749,"15min":0.78800000000000003},"min":{"1min":0.23300000000000001,"5min":0.193,"15min":0.193},"max":{"1min":5.0910000000000002,"5min":6.4329999999999998,"15min":11.999000000000001},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.84199999999999997,"15min":0.96199999999999997},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.222},"max":{"1min":5.0540000000000003,"5min":6.9210000000000003,"15min":11.082000000000001},"last":0.47299999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739263,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10195076,"kb_used_data":8430136,"kb_used_omap":1632,"kb_used_meta":1763295,"kb_avail":84176764,"statfs":{"total":96636764160,"available":86197006336,"internally_reserved":0,"allocated":8632459264,"data_stored":14918421180,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1671221,"internal_metadata":1805615051},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,12,5,9,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":1.054,"15min":0.92500000000000004},"min":{"1min":0.193,"5min":0.193,"15min":0.154},"max":{"1min":0.57399999999999995,"5min":12.076000000000001,"15min":12.933},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.374,"5min":1.222,"15min":1.238},"min":{"1min":0.248,"5min":0.185,"15min":0.185},"max":{"1min":0.49099999999999999,"5min":17.196999999999999,"15min":17.196999999999999},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.538,"15min":1.232},"min":{"1min":0.22800000000000001,"5min":0.22600000000000001,"15min":0.183},"max":{"1min":4.8650000000000002,"5min":9.8510000000000009,"15min":10.866},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.78300000000000003,"15min":0.65000000000000002},"min":{"1min":0.25900000000000001,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":0.503,"5min":8.1430000000000007,"15min":8.1430000000000007},"last":0.33900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739277,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6011256,"kb_used_data":5195308,"kb_used_omap":934,"kb_used_meta":815001,"kb_avail":88360584,"statfs":{"total":96636764160,"available":90481238016,"internally_reserved":0,"allocated":5319995392,"data_stored":9215206766,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":834561838},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,0,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":1.165,"15min":1.194},"min":{"1min":0.22800000000000001,"5min":0.20300000000000001,"15min":0.17899999999999999},"max":{"1min":2.2839999999999998,"5min":7.8899999999999997,"15min":25.927},"last":2.7669999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.306,"15min":1.3660000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":3.27,"5min":13.903,"15min":26.632999999999999},"last":2.8250000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.93500000000000005,"15min":0.86499999999999999},"min":{"1min":0.221,"5min":0.22,"15min":0.191},"max":{"1min":2.129,"5min":8.5559999999999992,"15min":8.5559999999999992},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.93700000000000006},"min":{"1min":0.216,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":3.194,"5min":5.4020000000000001,"15min":10.228999999999999},"last":0.25600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5319233536,"data_stored":9214728805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8631738368,"data_stored":14917984179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3314679808,"data_stored":5705430350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:16:04.819 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:04.820 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:04.821 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:04.821 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:04.822 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:04.822 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:16:05.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:16:05.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:05.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:05.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:05.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:05.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:05.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:05.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:05.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:05.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:05.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.459+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:05.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.467+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:05.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:05.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:05.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:06.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:06.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:06.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:06.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:06.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:06.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:06.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:06.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:06.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:06.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:06.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:06.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:06.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:06.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:06.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:06.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:06.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:06.279+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:06.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:06.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:06.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:06.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:07.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:07.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:07.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:07.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:07.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:07.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:07.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:07.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:07.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:07.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:07.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:07.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:07.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:07.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:07.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:07.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:07.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:07.695+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:07.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:07.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:07.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:07.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:11.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:11.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:11.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:11.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:11.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:11.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:11.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:11.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:11.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:11.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:11.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:11.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.507+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:11.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:11.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:11.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:11.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:12.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:12.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:12.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:12.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:12.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:12.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:12.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.455+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:12.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:12.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.479+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:12.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:16:12.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:12.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:16:12.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:12.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:12.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:12.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:12.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:12.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:12.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:12.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:12.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:12.575+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:18.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:18.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:18.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:18.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:18.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:18.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:18.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:18.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:18.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:18.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:18.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:18.195+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:18.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:18.199+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:19.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:19.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:19.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:19.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:19.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:19.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:19.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:19.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:19.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:19.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:19.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:19.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:19.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:19.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:19.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:19.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.591+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:19.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:19.591+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:21.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:21.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:21.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:21.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:21.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:21.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:21.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:21.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:21.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:21.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:21.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:21.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:21.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:21.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:21.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:21.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:21.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:21.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:21.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:21.679+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:21.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:21.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:21.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:21.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:24.824 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:16:25.827 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:16:25.828 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:16:25.924 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2442,"stamp":"2023-10-14T01:16:25.496876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28888117715,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2163994,"num_read_kb":8393400,"num_write":2118080,"num_write_kb":8470855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80389,"ondisk_log_size":80389,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21428428,"kb_used_data":16939056,"kb_used_omap":3062,"kb_used_meta":4486281,"kb_avail":261687092,"statfs":{"total":289910292480,"available":267967582208,"internally_reserved":0,"allocated":17345593344,"data_stored":29916700257,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3135636,"internal_metadata":4593952620},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,4,8,13,11,17],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22941696,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6097,"num_read_kb":24220,"num_write":5851,"num_write_kb":23404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004343"},"pg_stats":[{"pgid":"2.7","version":"154'271761","reported_seq":532756,"reported_epoch":154,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:16:25.250851+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:16:25.250851+0000","last_peered":"2023-10-14T01:16:25.250851+0000","last_clean":"2023-10-14T01:16:25.250851+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:16:25.250851+0000","last_undegraded":"2023-10-14T01:16:25.250851+0000","last_fullsized":"2023-10-14T01:16:25.250851+0000","mapping_epoch":13,"log_start":"151'261717","ondisk_log_start":"151'261717","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":514,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 138s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3514540568,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":263309,"num_read_kb":1020644,"num_write":256881,"num_write_kb":1027177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"154'286001","reported_seq":563651,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:16:25.214446+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:16:25.214446+0000","last_peered":"2023-10-14T01:16:25.214446+0000","last_clean":"2023-10-14T01:16:25.214446+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:16:25.214446+0000","last_undegraded":"2023-10-14T01:16:25.214446+0000","last_fullsized":"2023-10-14T01:16:25.214446+0000","mapping_epoch":13,"log_start":"151'275916","ondisk_log_start":"151'275916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3717103834,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":281526,"num_read_kb":1082408,"num_write":271520,"num_write_kb":1085609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"154'266037","reported_seq":524187,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:16:25.224894+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:16:25.224894+0000","last_peered":"2023-10-14T01:16:25.224894+0000","last_clean":"2023-10-14T01:16:25.224894+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:16:25.224894+0000","last_undegraded":"2023-10-14T01:16:25.224894+0000","last_fullsized":"2023-10-14T01:16:25.224894+0000","mapping_epoch":13,"log_start":"151'256023","ondisk_log_start":"151'256023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3490448064,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":260340,"num_read_kb":1012867,"num_write":255733,"num_write_kb":1022622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"154'263841","reported_seq":523452,"reported_epoch":154,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:16:25.125119+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:16:25.125119+0000","last_peered":"2023-10-14T01:16:25.125119+0000","last_clean":"2023-10-14T01:16:25.125119+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:16:25.125119+0000","last_undegraded":"2023-10-14T01:16:25.125119+0000","last_fullsized":"2023-10-14T01:16:25.125119+0000","mapping_epoch":13,"log_start":"151'253817","ondisk_log_start":"151'253817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":414,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 88s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3507385002,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":261488,"num_read_kb":1020828,"num_write":257530,"num_write_kb":1029869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"154'268989","reported_seq":536285,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:16:21.849845+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:16:21.849845+0000","last_peered":"2023-10-14T01:16:21.849845+0000","last_clean":"2023-10-14T01:16:21.849845+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:16:21.849845+0000","last_undegraded":"2023-10-14T01:16:21.849845+0000","last_fullsized":"2023-10-14T01:16:21.849845+0000","mapping_epoch":13,"log_start":"151'258923","ondisk_log_start":"151'258923","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3577180681,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":269565,"num_read_kb":1040338,"num_write":262885,"num_write_kb":1051061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"154'270713","reported_seq":536368,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:16:24.165814+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:16:24.165814+0000","last_peered":"2023-10-14T01:16:24.165814+0000","last_clean":"2023-10-14T01:16:24.165814+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:16:24.165814+0000","last_undegraded":"2023-10-14T01:16:24.165814+0000","last_fullsized":"2023-10-14T01:16:24.165814+0000","mapping_epoch":13,"log_start":"151'260712","ondisk_log_start":"151'260712","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3619533118,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":267272,"num_read_kb":1046570,"num_write":265448,"num_write_kb":1061631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"154'272120","reported_seq":539838,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:16:24.196250+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:16:24.196250+0000","last_peered":"2023-10-14T01:16:24.196250+0000","last_clean":"2023-10-14T01:16:24.196250+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:16:24.196250+0000","last_undegraded":"2023-10-14T01:16:24.196250+0000","last_fullsized":"2023-10-14T01:16:24.196250+0000","mapping_epoch":13,"log_start":"151'262116","ondisk_log_start":"151'262116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3651211815,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":269137,"num_read_kb":1055284,"num_write":266808,"num_write_kb":1067095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"154'308168","reported_seq":596257,"reported_epoch":154,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:16:25.138238+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:16:25.138238+0000","last_peered":"2023-10-14T01:16:25.138238+0000","last_clean":"2023-10-14T01:16:25.138238+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:16:25.138238+0000","last_undegraded":"2023-10-14T01:16:25.138238+0000","last_fullsized":"2023-10-14T01:16:25.138238+0000","mapping_epoch":13,"log_start":"152'298116","ondisk_log_start":"152'298116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":308,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 134s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3810124265,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":291251,"num_read_kb":1114370,"num_write":281138,"num_write_kb":1123897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":331,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:49.000601+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:15:49.000601+0000","last_peered":"2023-10-14T01:15:49.000601+0000","last_clean":"2023-10-14T01:15:49.000601+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:15:49.000601+0000","last_undegraded":"2023-10-14T01:15:49.000601+0000","last_fullsized":"2023-10-14T01:15:49.000601+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28887527347,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2163888,"num_read_kb":8393309,"num_write":2117943,"num_write_kb":8468961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17342603264,"data_stored":29915094886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80290,"ondisk_log_size":80290,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4945672,"kb_used_data":3253760,"kb_used_omap":495,"kb_used_meta":1691408,"kb_avail":89426168,"statfs":{"total":96636764160,"available":91572396032,"internally_reserved":0,"allocated":3331850240,"data_stored":5721783863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507789,"internal_metadata":1732001907},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,1,1,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.83299999999999996,"15min":0.89500000000000002},"min":{"1min":0.23300000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":3.8090000000000002,"5min":6.1239999999999997,"15min":8.5800000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.88100000000000001,"15min":0.94599999999999995},"min":{"1min":0.28599999999999998,"5min":0.215,"15min":0.215},"max":{"1min":3.8700000000000001,"5min":6.1559999999999997,"15min":8.6140000000000008},"last":0.64100000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:15:40 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.749,"15min":0.78800000000000003},"min":{"1min":0.23300000000000001,"5min":0.193,"15min":0.193},"max":{"1min":5.0910000000000002,"5min":6.4329999999999998,"15min":11.999000000000001},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.84199999999999997,"15min":0.96199999999999997},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.222},"max":{"1min":5.0540000000000003,"5min":6.9210000000000003,"15min":11.082000000000001},"last":0.58299999999999996}]}]},{"osd":1,"up_from":8,"seq":34359739268,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10376048,"kb_used_data":8470884,"kb_used_omap":1632,"kb_used_meta":1903519,"kb_avail":83995792,"statfs":{"total":96636764160,"available":86011691008,"internally_reserved":0,"allocated":8674185216,"data_stored":14960147132,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1671221,"internal_metadata":1949204427},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,4,8,6,5,12],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":1.054,"15min":0.92500000000000004},"min":{"1min":0.193,"5min":0.193,"15min":0.154},"max":{"1min":0.57399999999999995,"5min":12.076000000000001,"15min":12.933},"last":0.318},{"interface":"front","average":{"1min":0.374,"5min":1.222,"15min":1.238},"min":{"1min":0.248,"5min":0.185,"15min":0.185},"max":{"1min":0.49099999999999999,"5min":17.196999999999999,"15min":17.196999999999999},"last":0.27600000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:15:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.538,"15min":1.232},"min":{"1min":0.22800000000000001,"5min":0.22600000000000001,"15min":0.183},"max":{"1min":4.8650000000000002,"5min":9.8510000000000009,"15min":10.866},"last":0.215},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.78300000000000003,"15min":0.65000000000000002},"min":{"1min":0.25900000000000001,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":0.503,"5min":8.1430000000000007,"15min":8.1430000000000007},"last":0.34899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739281,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6106708,"kb_used_data":5214412,"kb_used_omap":934,"kb_used_meta":891353,"kb_avail":88265132,"statfs":{"total":96636764160,"available":90383495168,"internally_reserved":0,"allocated":5339557888,"data_stored":9234769262,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":912746286},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,0,6,5],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":1.165,"15min":1.194},"min":{"1min":0.22800000000000001,"5min":0.20300000000000001,"15min":0.17899999999999999},"max":{"1min":2.2839999999999998,"5min":7.8899999999999997,"15min":25.927},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":1.306,"15min":1.3660000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":3.27,"5min":13.903,"15min":26.632999999999999},"last":6.6340000000000003}]},{"osd":2,"last update":"Sat Oct 14 01:15:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.93500000000000005,"15min":0.86499999999999999},"min":{"1min":0.221,"5min":0.22,"15min":0.191},"max":{"1min":2.129,"5min":8.5559999999999992,"15min":8.5559999999999992},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.93700000000000006},"min":{"1min":0.216,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":3.194,"5min":5.4020000000000001,"15min":10.228999999999999},"last":6.6710000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5338877952,"data_stored":9234373221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8673218560,"data_stored":14959464371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3330506752,"data_stored":5721257294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:16:25.926 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:25.926 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:25.927 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:25.927 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:25.928 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:25.928 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:16:27.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:27.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:16:27.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:27.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:27.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:27.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:27.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:27.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:27.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:27.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:27.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:27.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.287+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:27.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:27.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:27.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:29.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:16:29.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:29.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:16:29.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:29.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:29.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:29.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:29.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:29.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:29.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:29.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:29.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:29.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.323+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:29.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:29.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:29.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:29.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:29.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:29.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:29.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:29.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:29.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:29.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:29.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:29.751+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:30.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.383+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:16:30.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:30.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:16:30.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:30.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:30.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:30.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:30.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:30.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:30.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:30.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.463+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:30.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.475+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:30.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:30.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:30.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:31.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:31.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:31.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:31.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:31.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:31.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:31.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:31.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:31.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.227+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:31.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:31.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:31.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:31.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:31.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:31.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:31.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:31.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:31.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:31.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:31.491+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:33.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:33.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:16:33.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:33.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:33.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:33.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:33.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:33.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:33.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:33.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.939+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:33.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:33.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:33.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:34.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:33.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:34.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:34.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:34.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:34.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:34.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:34.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:34.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:34.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:34.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:34.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:34.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:34.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:34.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:34.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:34.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:34.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:34.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:34.087+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:34.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:34.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:34.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:34.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:35.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:35.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:35.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:35.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:35.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:35.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:35.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:35.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:35.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:35.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:35.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:35.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:35.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:35.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:35.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:35.307+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:35.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:35.319+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:35.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:35.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:35.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:35.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:40.260 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:16:40.259+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:16:40.893 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:16:40.891+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:16:40.959 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:16:40.959+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:16:41.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:41.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:41.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:41.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:41.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:41.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:41.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:41.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:41.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:41.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.351+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:41.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:41.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:41.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:41.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:41.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:41.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:41.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:41.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:41.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:41.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:41.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:41.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:41.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.571+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:41.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:41.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:41.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:43.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:16:43.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:16:43.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:43.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:43.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:43.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:43.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:43.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:43.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:43.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:43.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:43.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.967+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:43.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:43.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:43.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:45.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:45.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:45.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:45.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:45.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:45.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:45.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:45.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.283+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:45.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:45.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.319+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:45.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:45.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:45.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:45.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:45.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:45.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:45.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.535+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:45.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.535+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:45.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.535+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:45.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:45.535+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:45.929 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:16:46.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:46.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:46.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:46.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:46.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:46.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:46.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:46.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:46.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:46.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:46.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:46.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:46.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:46.063+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:46.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:46.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:46.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:46.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:46.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:46.147+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:46.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:46.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:46.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:46.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:46.768 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:16:46.769 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:16:46.839 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2452,"stamp":"2023-10-14T01:16:45.504528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28914016723,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2170894,"num_read_kb":8420844,"num_write":2124724,"num_write_kb":8497431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80416,"ondisk_log_size":80416,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21789712,"kb_used_data":16993844,"kb_used_omap":3062,"kb_used_meta":4792777,"kb_avail":261325808,"statfs":{"total":289910292480,"available":267597627392,"internally_reserved":0,"allocated":17401696256,"data_stored":29972803169,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3135636,"internal_metadata":4907804524},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,4,2,6,16,10,5,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17149952,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4532,"num_read_kb":18028,"num_write":4398,"num_write_kb":17592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006303"},"pg_stats":[{"pgid":"2.7","version":"154'272567","reported_seq":534325,"reported_epoch":154,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:16:40.619441+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:16:40.619441+0000","last_peered":"2023-10-14T01:16:40.619441+0000","last_clean":"2023-10-14T01:16:40.619441+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:16:40.619441+0000","last_undegraded":"2023-10-14T01:16:40.619441+0000","last_fullsized":"2023-10-14T01:16:40.619441+0000","mapping_epoch":13,"log_start":"151'262517","ondisk_log_start":"151'262517","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":579,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 154s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3517432344,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":264053,"num_read_kb":1023596,"num_write":257610,"num_write_kb":1030093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"154'286769","reported_seq":565232,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:16:40.669481+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:16:40.669481+0000","last_peered":"2023-10-14T01:16:40.669481+0000","last_clean":"2023-10-14T01:16:40.669481+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:16:40.669481+0000","last_undegraded":"2023-10-14T01:16:40.669481+0000","last_fullsized":"2023-10-14T01:16:40.669481+0000","mapping_epoch":13,"log_start":"152'276716","ondisk_log_start":"152'276716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3719971034,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":282329,"num_read_kb":1085600,"num_write":272258,"num_write_kb":1088561,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"154'266813","reported_seq":525728,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:16:40.639818+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:16:40.639818+0000","last_peered":"2023-10-14T01:16:40.639818+0000","last_clean":"2023-10-14T01:16:40.639818+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:16:40.639818+0000","last_undegraded":"2023-10-14T01:16:40.639818+0000","last_fullsized":"2023-10-14T01:16:40.639818+0000","mapping_epoch":13,"log_start":"151'256723","ondisk_log_start":"151'256723","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3493413568,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":261098,"num_read_kb":1015887,"num_write":256489,"num_write_kb":1025646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"154'264651","reported_seq":525046,"reported_epoch":154,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:16:40.672849+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:16:40.672849+0000","last_peered":"2023-10-14T01:16:40.672849+0000","last_clean":"2023-10-14T01:16:40.672849+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:16:40.672849+0000","last_undegraded":"2023-10-14T01:16:40.672849+0000","last_fullsized":"2023-10-14T01:16:40.672849+0000","mapping_epoch":13,"log_start":"151'254617","ondisk_log_start":"151'254617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":478,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 103s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3510244010,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":262260,"num_read_kb":1023908,"num_write":258281,"num_write_kb":1032873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"154'269924","reported_seq":538269,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:16:42.146341+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:16:42.146341+0000","last_peered":"2023-10-14T01:16:42.146341+0000","last_clean":"2023-10-14T01:16:42.146341+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:16:42.146341+0000","last_undegraded":"2023-10-14T01:16:42.146341+0000","last_fullsized":"2023-10-14T01:16:42.146341+0000","mapping_epoch":13,"log_start":"151'259923","ondisk_log_start":"151'259923","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3580793353,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":270599,"num_read_kb":1044442,"num_write":263814,"num_write_kb":1054777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"154'271669","reported_seq":538308,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:16:44.309615+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:16:44.309615+0000","last_peered":"2023-10-14T01:16:44.309615+0000","last_clean":"2023-10-14T01:16:44.309615+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:16:44.309615+0000","last_undegraded":"2023-10-14T01:16:44.309615+0000","last_fullsized":"2023-10-14T01:16:44.309615+0000","mapping_epoch":13,"log_start":"151'261612","ondisk_log_start":"151'261612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3623268670,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":268252,"num_read_kb":1050470,"num_write":266398,"num_write_kb":1065431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"154'273131","reported_seq":541845,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:16:44.334216+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:16:44.334216+0000","last_peered":"2023-10-14T01:16:44.334216+0000","last_clean":"2023-10-14T01:16:44.334216+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:16:44.334216+0000","last_undegraded":"2023-10-14T01:16:44.334216+0000","last_fullsized":"2023-10-14T01:16:44.334216+0000","mapping_epoch":13,"log_start":"151'263116","ondisk_log_start":"151'263116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3655209511,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":270129,"num_read_kb":1059224,"num_write":267813,"num_write_kb":1071115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"154'309033","reported_seq":597966,"reported_epoch":154,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:16:40.684143+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:16:40.684143+0000","last_peered":"2023-10-14T01:16:40.684143+0000","last_clean":"2023-10-14T01:16:40.684143+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:16:40.684143+0000","last_undegraded":"2023-10-14T01:16:40.684143+0000","last_fullsized":"2023-10-14T01:16:40.684143+0000","mapping_epoch":13,"log_start":"152'299016","ondisk_log_start":"152'299016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":343,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 150s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3813093865,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":292068,"num_read_kb":1117626,"num_write":281924,"num_write_kb":1127041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":331,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-10-14T01:15:49.000601+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:15:49.000601+0000","last_peered":"2023-10-14T01:15:49.000601+0000","last_clean":"2023-10-14T01:15:49.000601+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:15:49.000601+0000","last_undegraded":"2023-10-14T01:15:49.000601+0000","last_fullsized":"2023-10-14T01:15:49.000601+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28913426355,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2170788,"num_read_kb":8420753,"num_write":2124587,"num_write_kb":8495537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17398697984,"data_stored":29971189606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80317,"ondisk_log_size":80317,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739286,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5013756,"kb_used_data":3265588,"kb_used_omap":495,"kb_used_meta":1747664,"kb_avail":89358084,"statfs":{"total":96636764160,"available":91502678016,"internally_reserved":0,"allocated":3343962112,"data_stored":5733895735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507789,"internal_metadata":1789608051},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,0,3,4,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":0.97799999999999998,"15min":0.94899999999999995},"min":{"1min":0.188,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.6340000000000003,"5min":6.6340000000000003,"15min":8.5800000000000001},"last":6.1459999999999999},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.0269999999999999,"15min":1.0009999999999999},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":8.6140000000000008},"last":6.1849999999999996}]},{"osd":1,"last update":"Sat Oct 14 01:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.81100000000000005,"15min":0.72999999999999998},"min":{"1min":0.22900000000000001,"5min":0.193,"15min":0.193},"max":{"1min":6.593,"5min":6.593,"15min":8.2479999999999993},"last":0.28699999999999998},{"interface":"front","average":{"1min":1.01,"5min":0.89800000000000002,"15min":0.997},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.222},"max":{"1min":6.7300000000000004,"5min":6.9210000000000003,"15min":11.082000000000001},"last":0.317}]}]},{"osd":1,"up_from":8,"seq":34359739271,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10559564,"kb_used_data":8494080,"kb_used_omap":1632,"kb_used_meta":2063839,"kb_avail":83812276,"statfs":{"total":96636764160,"available":85823770624,"internally_reserved":0,"allocated":8697937920,"data_stored":14983899836,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1671221,"internal_metadata":2113372107},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,2,2,11,5,3,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.995,"15min":0.91100000000000003},"min":{"1min":0.28299999999999997,"5min":0.193,"15min":0.154},"max":{"1min":2.5619999999999998,"5min":12.076000000000001,"15min":12.933},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.34799999999999998,"5min":1.2090000000000001,"15min":1.208},"min":{"1min":0.216,"5min":0.185,"15min":0.185},"max":{"1min":0.54900000000000004,"5min":17.196999999999999,"15min":17.196999999999999},"last":5.6260000000000003}]},{"osd":2,"last update":"Sat Oct 14 01:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.538,"15min":1.29},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":10.07,"5min":10.07,"15min":10.866},"last":5.6950000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":2.6949999999999998,"5min":8.1430000000000007,"15min":8.1430000000000007},"last":0.89400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739285,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6216392,"kb_used_data":5234176,"kb_used_omap":934,"kb_used_meta":981273,"kb_avail":88155448,"statfs":{"total":96636764160,"available":90271178752,"internally_reserved":0,"allocated":5359796224,"data_stored":9255007598,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":1004824366},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,1,1,1,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":1.038,"15min":1.169},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.17899999999999999},"max":{"1min":2.7669999999999999,"5min":7.8899999999999997,"15min":25.927},"last":0.27800000000000002},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.294,"15min":1.339},"min":{"1min":0.25900000000000001,"5min":0.188,"15min":0.188},"max":{"1min":6.6340000000000003,"5min":13.903,"15min":26.632999999999999},"last":0.32200000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.81299999999999994,"15min":0.84999999999999998},"min":{"1min":0.23100000000000001,"5min":0.221,"15min":0.214},"max":{"1min":0.626,"5min":7.2640000000000002,"15min":8.5559999999999992},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.028,"5min":0.751,"15min":0.95799999999999996},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":6.6710000000000003,"5min":6.6710000000000003,"15min":10.228999999999999},"last":0.29299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5358411776,"data_stored":9253907045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8697614336,"data_stored":14983860147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3342671872,"data_stored":5733422414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:16:46.840 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:46.841 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:46.841 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:46.842 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:46.842 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:16:46.843 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:16:53.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:53.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:53.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:53.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:53.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:53.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:53.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:53.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:53.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.254+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:53.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:53.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.290+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:53.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:53.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:53.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:53.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:53.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:53.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:53.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:53.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.698+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:53.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:53.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:53.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:54.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:54.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:54.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:54.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:54.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:54.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:54.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:54.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:54.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:54.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:54.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:54.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:54.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:54.742+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:54.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:54.742+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:54.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:54.742+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:54.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:54.742+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:56.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:56.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:56.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:56.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.142+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:56.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:56.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:56.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:56.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:56.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.166+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:56.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:56.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:56.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:56.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.650+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:56.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:56.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:56.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:56.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:56.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.690+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:56.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.738+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:56.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.738+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:56.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:56.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:56.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:56.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:56.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.894+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:56.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.918+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:56.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.926+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:56.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:56.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:56.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:57.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:57.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:57.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:57.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:57.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:57.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:57.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:57.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:57.817 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:57.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:57.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:57.814+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:57.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:57.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:57.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:57.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:59.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:16:59.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:59.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:59.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:59.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:59.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:59.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:59.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:59.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:59.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:59.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:59.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.202+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:16:59.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:16:59.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:16:59.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:16:59.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:16:59.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:16:59.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:16:59.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:16:59.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:16:59.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:16:59.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:16:59.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:16:59.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:16:59.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:16:59.490+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:02.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:02.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:02.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:02.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:02.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:02.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:02.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:02.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:02.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:02.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:02.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:02.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:03.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:03.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:03.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:03.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:03.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.530+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:03.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:03.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:03.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:17:03.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:03.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:03.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.566+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:03.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.566+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:03.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:03.566+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:05.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:05.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:05.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:05.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:05.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:05.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:05.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:05.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.510+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:05.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.514+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:05.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:05.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:05.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:05.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:05.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:05.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:05.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:05.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:05.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.946+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:05.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.946+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:05.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.954+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:05.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:05.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:05.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:05.954+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:06.668 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:06.666+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:17:06.844 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:17:07.698 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:17:07.699 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:17:07.761 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2464,"stamp":"2023-10-14T01:17:07.516129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28950303187,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2180614,"num_read_kb":8459588,"num_write":2134043,"num_write_kb":8534707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80444,"ondisk_log_size":80444,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20798784,"kb_used_data":17069796,"kb_used_omap":3063,"kb_used_meta":3725896,"kb_avail":262316736,"statfs":{"total":289910292480,"available":268612337664,"internally_reserved":0,"allocated":17479471104,"data_stored":30050569875,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3137315,"internal_metadata":3815317725},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,5,9,4,14,20,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15040512,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3981,"num_read_kb":15880,"num_write":3856,"num_write_kb":15424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.006489"},"pg_stats":[{"pgid":"2.7","version":"155'273877","reported_seq":536922,"reported_epoch":155,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:17:06.539433+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:17:06.539433+0000","last_peered":"2023-10-14T01:17:06.539433+0000","last_clean":"2023-10-14T01:17:06.539433+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:17:06.539433+0000","last_undegraded":"2023-10-14T01:17:06.539433+0000","last_fullsized":"2023-10-14T01:17:06.539433+0000","mapping_epoch":13,"log_start":"152'263817","ondisk_log_start":"152'263817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":671,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 180s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3522097688,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":265313,"num_read_kb":1028596,"num_write":258796,"num_write_kb":1034837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'288089","reported_seq":567933,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:06.544575+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:17:06.544575+0000","last_peered":"2023-10-14T01:17:06.544575+0000","last_clean":"2023-10-14T01:17:06.544575+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:17:06.544575+0000","last_undegraded":"2023-10-14T01:17:06.544575+0000","last_fullsized":"2023-10-14T01:17:06.544575+0000","mapping_epoch":13,"log_start":"152'278016","ondisk_log_start":"152'278016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3724939482,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":283695,"num_read_kb":1091048,"num_write":273521,"num_write_kb":1093613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'268054","reported_seq":528236,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:06.509267+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:17:06.509267+0000","last_peered":"2023-10-14T01:17:06.509267+0000","last_clean":"2023-10-14T01:17:06.509267+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:17:06.509267+0000","last_undegraded":"2023-10-14T01:17:06.509267+0000","last_fullsized":"2023-10-14T01:17:06.509267+0000","mapping_epoch":13,"log_start":"152'258023","ondisk_log_start":"152'258023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3498058432,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":262353,"num_read_kb":1020895,"num_write":257689,"num_write_kb":1030446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'265980","reported_seq":527604,"reported_epoch":155,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:17:06.494156+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:17:06.494156+0000","last_peered":"2023-10-14T01:17:06.494156+0000","last_clean":"2023-10-14T01:17:06.494156+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:17:06.494156+0000","last_undegraded":"2023-10-14T01:17:06.494156+0000","last_fullsized":"2023-10-14T01:17:06.494156+0000","mapping_epoch":13,"log_start":"152'255917","ondisk_log_start":"152'255917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":602,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 129s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3514946218,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":263476,"num_read_kb":1028760,"num_write":259493,"num_write_kb":1037721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"155'271127","reported_seq":540701,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:07.430632+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:17:07.430632+0000","last_peered":"2023-10-14T01:17:07.430632+0000","last_clean":"2023-10-14T01:17:07.430632+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:17:07.430632+0000","last_undegraded":"2023-10-14T01:17:07.430632+0000","last_fullsized":"2023-10-14T01:17:07.430632+0000","mapping_epoch":13,"log_start":"152'261123","ondisk_log_start":"152'261123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3585421833,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":271811,"num_read_kb":1049270,"num_write":265002,"num_write_kb":1059529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"154'272622","reported_seq":540265,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:17:04.427551+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:17:04.427551+0000","last_peered":"2023-10-14T01:17:04.427551+0000","last_clean":"2023-10-14T01:17:04.427551+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:17:04.427551+0000","last_undegraded":"2023-10-14T01:17:04.427551+0000","last_fullsized":"2023-10-14T01:17:04.427551+0000","mapping_epoch":13,"log_start":"152'262612","ondisk_log_start":"152'262612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3626938686,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":269254,"num_read_kb":1054466,"num_write":267348,"num_write_kb":1069231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"154'274120","reported_seq":543853,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:17:04.439261+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:17:04.439261+0000","last_peered":"2023-10-14T01:17:04.439261+0000","last_clean":"2023-10-14T01:17:04.439261+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:17:04.439261+0000","last_undegraded":"2023-10-14T01:17:04.439261+0000","last_fullsized":"2023-10-14T01:17:04.439261+0000","mapping_epoch":13,"log_start":"152'264116","ondisk_log_start":"152'264116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3659104807,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":271144,"num_read_kb":1063284,"num_write":268799,"num_write_kb":1075059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"155'310516","reported_seq":600881,"reported_epoch":155,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:17:06.511240+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:17:06.511240+0000","last_peered":"2023-10-14T01:17:06.511240+0000","last_clean":"2023-10-14T01:17:06.511240+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:17:06.511240+0000","last_undegraded":"2023-10-14T01:17:06.511240+0000","last_fullsized":"2023-10-14T01:17:06.511240+0000","mapping_epoch":13,"log_start":"152'300416","ondisk_log_start":"152'300416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":382,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 175s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3818205673,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":293462,"num_read_kb":1123178,"num_write":283258,"num_write_kb":1132377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":332,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:15:50.047719+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:15:50.047719+0000","last_peered":"2023-10-14T01:15:50.047719+0000","last_clean":"2023-10-14T01:15:50.047719+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:15:50.047719+0000","last_undegraded":"2023-10-14T01:15:50.047719+0000","last_fullsized":"2023-10-14T01:15:50.047719+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28949712819,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2180508,"num_read_kb":8459497,"num_write":2133906,"num_write_kb":8532813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17476038656,"data_stored":30048530278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80345,"ondisk_log_size":80345,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739290,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5074168,"kb_used_data":3277424,"kb_used_omap":495,"kb_used_meta":1796240,"kb_avail":89297672,"statfs":{"total":96636764160,"available":91440816128,"internally_reserved":0,"allocated":3356082176,"data_stored":5746015799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507789,"internal_metadata":1839349875},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,1,1,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":0.97799999999999998,"15min":0.94899999999999995},"min":{"1min":0.188,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.6340000000000003,"5min":6.6340000000000003,"15min":8.5800000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.0269999999999999,"15min":1.0009999999999999},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":8.6140000000000008},"last":0.68500000000000005}]},{"osd":1,"last update":"Sat Oct 14 01:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.81100000000000005,"15min":0.72999999999999998},"min":{"1min":0.22900000000000001,"5min":0.193,"15min":0.193},"max":{"1min":6.593,"5min":6.593,"15min":8.2479999999999993},"last":0.31900000000000001},{"interface":"front","average":{"1min":1.01,"5min":0.89800000000000002,"15min":0.997},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.222},"max":{"1min":6.7300000000000004,"5min":6.9210000000000003,"15min":11.082000000000001},"last":0.36799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739276,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9402460,"kb_used_data":8534352,"kb_used_omap":1633,"kb_used_meta":866462,"kb_avail":84969380,"statfs":{"total":96636764160,"available":87008645120,"internally_reserved":0,"allocated":8739176448,"data_stored":15025134293,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1672900,"internal_metadata":887257404},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,2,7,1,12,13,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.995,"15min":0.91100000000000003},"min":{"1min":0.28299999999999997,"5min":0.193,"15min":0.154},"max":{"1min":2.5619999999999998,"5min":12.076000000000001,"15min":12.933},"last":1.9950000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":1.2090000000000001,"15min":1.208},"min":{"1min":0.216,"5min":0.185,"15min":0.185},"max":{"1min":0.54900000000000004,"5min":17.196999999999999,"15min":17.196999999999999},"last":2.0369999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.538,"15min":1.29},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":10.07,"5min":10.07,"15min":10.866},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":2.6949999999999998,"5min":8.1430000000000007,"15min":8.1430000000000007},"last":0.28000000000000003}]}]},{"osd":0,"up_from":8,"seq":34359739290,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6322156,"kb_used_data":5258020,"kb_used_omap":934,"kb_used_meta":1063193,"kb_avail":88049684,"statfs":{"total":96636764160,"available":90162876416,"internally_reserved":0,"allocated":5384212480,"data_stored":9279419783,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":1088710446},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,2,2,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":1.038,"15min":1.169},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.17899999999999999},"max":{"1min":2.7669999999999999,"5min":7.8899999999999997,"15min":25.927},"last":0.35499999999999998},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.294,"15min":1.339},"min":{"1min":0.25900000000000001,"5min":0.188,"15min":0.188},"max":{"1min":6.6340000000000003,"5min":13.903,"15min":26.632999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.81299999999999994,"15min":0.84999999999999998},"min":{"1min":0.23100000000000001,"5min":0.221,"15min":0.214},"max":{"1min":0.626,"5min":7.2640000000000002,"15min":8.5559999999999992},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.028,"5min":0.751,"15min":0.95799999999999996},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":6.6710000000000003,"5min":6.6710000000000003,"15min":10.228999999999999},"last":0.38200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5382963200,"data_stored":9278458469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8738209792,"data_stored":15024455603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3354865664,"data_stored":5745616206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:17:07.762 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:07.763 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:07.763 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:07.764 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:07.764 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:07.764 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T01:17:07.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:07.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:17:07.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:07.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:07.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:07.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:07.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:07.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:07.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:07.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:07.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:07.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:07.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:07.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:07.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:07.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:07.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:07.934+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:07.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:07.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:07.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:07.934+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:08.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:08.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:08.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:08.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:08.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:08.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:08.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:08.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:08.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:08.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:08.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:08.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:08.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:08.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:08.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:08.414+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:08.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:08.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:08.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:08.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:08.635 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T01:17:08.670 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:17:09.065 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:09.062+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:17:09.076 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:09.074+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:17:09.529 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:17:09.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:09.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:09.587 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T01:17:09.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:09.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:09.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:09.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:09.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:09.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:09.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:09.726+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:09.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:09.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:09.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:09.754+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:09.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:09.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:09.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:09.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:10.430 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T01:17:10.514 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T01:17:11.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:11.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:11.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:11.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:11.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:11.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:11.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:11.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:11.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:11.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:11.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:11.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:11.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:11.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:11.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:11.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:11.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:11.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:11.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:11.270+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:11.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:11.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:11.377 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T01:17:11.405 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T01:17:12.114 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T01:17:12.193 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:17:15.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:15.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:15.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:15.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:15.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:15.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:15.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:15.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:15.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:15.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:15.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:15.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:15.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:15.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:15.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:15.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:15.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:17.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:17:17.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:17.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:17.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:17.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:17.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:17.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:17.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:17.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:17.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:17.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.346+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:17.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:17.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:17.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:17.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:17.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:17.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:17.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:17.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:18.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:18.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:18.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.038+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:18.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.038+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:18.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.038+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:18.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:18.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:18.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:18.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:18.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:18.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:18.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:18.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:18.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:18.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.802+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:18.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:18.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:18.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:19.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:19.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:17:19.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:19.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:19.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:19.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:19.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:19.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:19.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:19.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:19.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:19.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:19.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:19.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:19.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:19.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:19.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:19.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:19.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:19.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:19.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:19.162+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:21.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:17:21.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:17:21.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:21.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:21.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:21.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:21.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:21.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:21.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:21.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.658+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:21.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.658+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:21.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.658+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:21.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.658+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:21.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.658+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:21.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:17:21.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:21.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:21.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:21.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:21.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:21.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:21.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:21.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:21.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:21.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:21.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:21.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.838+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:21.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.854+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:21.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.890+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:21.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:21.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:21.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:23.161 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:23.158+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:17:23.161 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:23.158+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:17:24.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:24.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:24.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:24.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:24.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:24.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:24.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:24.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:24.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:24.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:24.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:24.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:24.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:24.430+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:24.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:24.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:24.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:24.470+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:24.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:24.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:24.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:24.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:25.195 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:25.190+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:17:27.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:17:27.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:17:27.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:17:27.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:27.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:27.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:27.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:27.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:27.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:27.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:27.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:27.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:27.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.354+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:27.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:27.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:27.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:28.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:28.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:28.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:28.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:28.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:28.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:28.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:28.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:28.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:28.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:28.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:28.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:28.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:28.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:28.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:28.622+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:28.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:28.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:28.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:28.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:29.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:29.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:29.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:29.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:29.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:29.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:29.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:29.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:30.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:29.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:30.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:30.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:30.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:30.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:30.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.046+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:30.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:30.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:30.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:17:30.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:30.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:30.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:30.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:30.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:30.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:30.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:30.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:30.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.134+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:30.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.154+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:30.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:30.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:30.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:30.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:30.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:30.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:30.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:30.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:30.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:31.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.998+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:31.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:31.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:30.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:32.194 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:17:32.385 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:32.382+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:17:32.386 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:32.382+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:17:32.926 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:17:32.927 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:17:32.964 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2476,"stamp":"2023-10-14T01:17:31.524369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":28982604243,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2189358,"num_read_kb":8494432,"num_write":2142341,"num_write_kb":8567899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80550,"ondisk_log_size":80550,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21167784,"kb_used_data":17135240,"kb_used_omap":3063,"kb_used_meta":4029448,"kb_avail":261947736,"statfs":{"total":289910292480,"available":268234481664,"internally_reserved":0,"allocated":17546485760,"data_stored":30117580460,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3137315,"internal_metadata":4126154973},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2,4,9,16,12,18,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17448960,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4749,"num_read_kb":18940,"num_write":4474,"num_write_kb":17896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006250"},"pg_stats":[{"pgid":"2.7","version":"155'274903","reported_seq":538983,"reported_epoch":155,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:17:27.177573+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:17:27.177573+0000","last_peered":"2023-10-14T01:17:27.177573+0000","last_clean":"2023-10-14T01:17:27.177573+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:17:27.177573+0000","last_undegraded":"2023-10-14T01:17:27.177573+0000","last_fullsized":"2023-10-14T01:17:27.177573+0000","mapping_epoch":13,"log_start":"152'264817","ondisk_log_start":"152'264817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":768,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 200s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3525698072,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":266324,"num_read_kb":1032632,"num_write":259712,"num_write_kb":1038501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'289108","reported_seq":570018,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:27.182097+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:17:27.182097+0000","last_peered":"2023-10-14T01:17:27.182097+0000","last_clean":"2023-10-14T01:17:27.182097+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:17:27.182097+0000","last_undegraded":"2023-10-14T01:17:27.182097+0000","last_fullsized":"2023-10-14T01:17:27.182097+0000","mapping_epoch":13,"log_start":"152'279016","ondisk_log_start":"152'279016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3728777434,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":284750,"num_read_kb":1095264,"num_write":274498,"num_write_kb":1097521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'269100","reported_seq":530339,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:27.137194+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:17:27.137194+0000","last_peered":"2023-10-14T01:17:27.137194+0000","last_clean":"2023-10-14T01:17:27.137194+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:17:27.137194+0000","last_undegraded":"2023-10-14T01:17:27.137194+0000","last_fullsized":"2023-10-14T01:17:27.137194+0000","mapping_epoch":13,"log_start":"152'259023","ondisk_log_start":"152'259023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3502039744,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":263403,"num_read_kb":1025083,"num_write":258708,"num_write_kb":1034522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'267047","reported_seq":529663,"reported_epoch":155,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:17:27.113933+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:17:27.113933+0000","last_peered":"2023-10-14T01:17:27.113933+0000","last_clean":"2023-10-14T01:17:27.113933+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:17:27.113933+0000","last_undegraded":"2023-10-14T01:17:27.113933+0000","last_fullsized":"2023-10-14T01:17:27.113933+0000","mapping_epoch":13,"log_start":"152'257017","ondisk_log_start":"152'257017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":687,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 150s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3518726826,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":264450,"num_read_kb":1032644,"num_write":260481,"num_write_kb":1041673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"155'272082","reported_seq":542655,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:27.677605+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:17:27.677605+0000","last_peered":"2023-10-14T01:17:27.677605+0000","last_clean":"2023-10-14T01:17:27.677605+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:17:27.677605+0000","last_undegraded":"2023-10-14T01:17:27.677605+0000","last_fullsized":"2023-10-14T01:17:27.677605+0000","mapping_epoch":13,"log_start":"152'262023","ondisk_log_start":"152'262023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3589112329,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":272798,"num_read_kb":1053202,"num_write":265951,"num_write_kb":1063325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"155'273861","reported_seq":542736,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:29.611454+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:17:29.611454+0000","last_peered":"2023-10-14T01:17:29.611454+0000","last_clean":"2023-10-14T01:17:29.611454+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:17:29.611454+0000","last_undegraded":"2023-10-14T01:17:29.611454+0000","last_fullsized":"2023-10-14T01:17:29.611454+0000","mapping_epoch":13,"log_start":"152'263812","ondisk_log_start":"152'263812","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3631743294,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":270478,"num_read_kb":1059342,"num_write":268581,"num_write_kb":1074163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"155'275332","reported_seq":546357,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:29.608557+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:17:29.608557+0000","last_peered":"2023-10-14T01:17:29.608557+0000","last_clean":"2023-10-14T01:17:29.608557+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:17:29.608557+0000","last_undegraded":"2023-10-14T01:17:29.608557+0000","last_fullsized":"2023-10-14T01:17:29.608557+0000","mapping_epoch":13,"log_start":"152'265316","ondisk_log_start":"152'265316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3663823399,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":272432,"num_read_kb":1068404,"num_write":270005,"num_write_kb":1079883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"155'311658","reported_seq":603207,"reported_epoch":155,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:17:27.129594+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:17:27.129594+0000","last_peered":"2023-10-14T01:17:27.129594+0000","last_clean":"2023-10-14T01:17:27.129594+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:17:27.129594+0000","last_undegraded":"2023-10-14T01:17:27.129594+0000","last_fullsized":"2023-10-14T01:17:27.129594+0000","mapping_epoch":13,"log_start":"152'301616","ondisk_log_start":"152'301616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":449,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 196s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3822092777,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":294617,"num_read_kb":1127770,"num_write":284268,"num_write_kb":1136417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":332,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-14T01:15:50.047719+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:15:50.047719+0000","last_peered":"2023-10-14T01:15:50.047719+0000","last_clean":"2023-10-14T01:15:50.047719+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:15:50.047719+0000","last_undegraded":"2023-10-14T01:15:50.047719+0000","last_fullsized":"2023-10-14T01:15:50.047719+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":28982013875,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2189252,"num_read_kb":8494341,"num_write":2142204,"num_write_kb":8566005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17543184384,"data_stored":30115676006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80451,"ondisk_log_size":80451,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739295,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5199532,"kb_used_data":3292196,"kb_used_omap":495,"kb_used_meta":1906832,"kb_avail":89172308,"statfs":{"total":96636764160,"available":91312443392,"internally_reserved":0,"allocated":3371208704,"data_stored":5761138256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507789,"internal_metadata":1952596083},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,1,4,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:16:42 2023","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":0.97799999999999998,"15min":0.94899999999999995},"min":{"1min":0.188,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":6.6340000000000003,"5min":6.6340000000000003,"15min":8.5800000000000001},"last":3.7480000000000002},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.0269999999999999,"15min":1.0009999999999999},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":6.6859999999999999,"5min":6.6859999999999999,"15min":8.6140000000000008},"last":3.8319999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.81100000000000005,"15min":0.72999999999999998},"min":{"1min":0.22900000000000001,"5min":0.193,"15min":0.193},"max":{"1min":6.593,"5min":6.593,"15min":8.2479999999999993},"last":0.27400000000000002},{"interface":"front","average":{"1min":1.01,"5min":0.89800000000000002,"15min":0.997},"min":{"1min":0.25600000000000001,"5min":0.24299999999999999,"15min":0.222},"max":{"1min":6.7300000000000004,"5min":6.9210000000000003,"15min":11.082000000000001},"last":3.7909999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739280,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9550720,"kb_used_data":8566004,"kb_used_omap":1633,"kb_used_meta":983070,"kb_avail":84821120,"statfs":{"total":96636764160,"available":86856826880,"internally_reserved":0,"allocated":8771588096,"data_stored":15057545941,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1672900,"internal_metadata":1006663996},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,2,4,10,8,13,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.995,"15min":0.91100000000000003},"min":{"1min":0.28299999999999997,"5min":0.193,"15min":0.154},"max":{"1min":2.5619999999999998,"5min":12.076000000000001,"15min":12.933},"last":0.313},{"interface":"front","average":{"1min":0.34799999999999998,"5min":1.2090000000000001,"15min":1.208},"min":{"1min":0.216,"5min":0.185,"15min":0.185},"max":{"1min":0.54900000000000004,"5min":17.196999999999999,"15min":17.196999999999999},"last":0.29399999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:16:27 2023","interfaces":[{"interface":"back","average":{"1min":1.758,"5min":1.538,"15min":1.29},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":10.07,"5min":10.07,"15min":10.866},"last":0.217},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":2.6949999999999998,"5min":8.1430000000000007,"15min":8.1430000000000007},"last":0.26400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739294,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6417532,"kb_used_data":5277040,"kb_used_omap":934,"kb_used_meta":1139545,"kb_avail":87954308,"statfs":{"total":96636764160,"available":90065211392,"internally_reserved":0,"allocated":5403688960,"data_stored":9298896263,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":1166894894},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2,3,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":1.038,"15min":1.169},"min":{"1min":0.23100000000000001,"5min":0.20300000000000001,"15min":0.17899999999999999},"max":{"1min":2.7669999999999999,"5min":7.8899999999999997,"15min":25.927},"last":0.308},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.294,"15min":1.339},"min":{"1min":0.25900000000000001,"5min":0.188,"15min":0.188},"max":{"1min":6.6340000000000003,"5min":13.903,"15min":26.632999999999999},"last":0.20999999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.81299999999999994,"15min":0.84999999999999998},"min":{"1min":0.23100000000000001,"5min":0.221,"15min":0.214},"max":{"1min":0.626,"5min":7.2640000000000002,"15min":8.5559999999999992},"last":0.27100000000000002},{"interface":"front","average":{"1min":1.028,"5min":0.751,"15min":0.95799999999999996},"min":{"1min":0.25600000000000001,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":6.6710000000000003,"5min":6.6710000000000003,"15min":10.228999999999999},"last":0.24399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5402558464,"data_stored":9298053733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8770613248,"data_stored":15056859059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3370012672,"data_stored":5760763214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:17:32.967 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:32.967 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:32.968 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:32.969 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:32.969 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:32.970 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:17:33.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:33.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:33.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:33.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:33.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:33.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:33.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:33.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:33.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:33.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:33.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:33.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:33.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:33.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:33.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:33.298+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:33.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:33.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:33.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:33.346+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:33.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:33.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:33.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:33.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:33.767 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:33.762+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:17:35.054 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:35.050+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:17:36.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:17:36.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:36.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:36.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:36.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:36.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:36.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:36.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:36.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:36.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:36.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.818+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:36.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:36.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:36.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:37.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:37.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:37.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:37.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:37.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:37.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:37.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:37.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:37.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:17:37.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:17:37.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:37.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:37.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:37.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:37.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:37.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:37.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:37.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:37.539 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:37.534+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:17:37.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:17:37.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:37.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:37.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:37.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:37.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:37.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:37.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:37.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:37.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:37.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.842+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:37.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:37.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:37.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:38.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:38.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:38.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:38.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:38.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:38.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:38.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:38.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:38.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:38.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:38.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:38.614+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:38.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:38.622+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:41.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:41.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:41.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:41.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:41.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:41.362+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:41.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:41.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:41.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:41.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:42.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:17:42.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.818+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:42.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:42.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:42.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:42.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:42.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:42.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:42.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:42.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.878+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:42.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.910+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:42.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:42.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:42.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:43.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:43.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:43.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:43.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:43.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:43.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:43.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:43.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:43.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:43.482+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:43.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:43.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:43.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:43.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:45.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:45.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:45.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:45.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:45.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:45.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:45.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:45.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:45.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:45.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:45.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:45.742+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:45.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:45.742+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:45.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:45.770+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:45.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:45.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:45.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:45.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:48.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:48.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:48.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:48.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:48.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:48.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:48.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:48.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:48.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:48.426+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:48.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:48.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:48.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:48.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:48.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:48.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:48.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:48.438+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:48.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:48.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:48.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:48.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:49.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:49.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:49.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:49.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:49.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:49.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:49.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.290+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:49.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.290+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:49.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.290+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:49.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:17:49.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:49.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:49.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:49.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:49.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:49.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:49.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:49.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:49.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.798+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:49.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.826+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:49.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:49.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:49.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:17:49.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:17:49.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:49.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:49.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:49.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:49.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:49.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:49.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:49.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:49.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:49.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.994+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:50.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:50.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:49.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:52.971 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:17:53.782 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:17:53.785 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:17:53.827 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2487,"stamp":"2023-10-14T01:17:53.537495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29019820499,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2199227,"num_read_kb":8533736,"num_write":2151880,"num_write_kb":8606055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80459,"ondisk_log_size":80459,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21572936,"kb_used_data":17210732,"kb_used_omap":3063,"kb_used_meta":4359112,"kb_avail":261542584,"statfs":{"total":289910292480,"available":267819606016,"internally_reserved":0,"allocated":17623789568,"data_stored":30194884268,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3137315,"internal_metadata":4463730909},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,8,5,12,31,12,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21786624,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5788,"num_read_kb":23068,"num_write":5564,"num_write_kb":22256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008329"},"pg_stats":[{"pgid":"2.7","version":"155'276266","reported_seq":541623,"reported_epoch":155,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:17:52.902740+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:17:52.902740+0000","last_peered":"2023-10-14T01:17:52.902740+0000","last_clean":"2023-10-14T01:17:52.902740+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:17:52.902740+0000","last_undegraded":"2023-10-14T01:17:52.902740+0000","last_fullsized":"2023-10-14T01:17:52.902740+0000","mapping_epoch":13,"log_start":"153'266217","ondisk_log_start":"153'266217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":853,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 226s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3530662424,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":267593,"num_read_kb":1037700,"num_write":260956,"num_write_kb":1043477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'290505","reported_seq":572806,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:52.888642+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:17:52.888642+0000","last_peered":"2023-10-14T01:17:52.888642+0000","last_clean":"2023-10-14T01:17:52.888642+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:17:52.888642+0000","last_undegraded":"2023-10-14T01:17:52.888642+0000","last_fullsized":"2023-10-14T01:17:52.888642+0000","mapping_epoch":13,"log_start":"153'280416","ondisk_log_start":"153'280416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3734048986,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":286126,"num_read_kb":1100740,"num_write":275841,"num_write_kb":1102893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'270367","reported_seq":532957,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:52.903582+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:17:52.903582+0000","last_peered":"2023-10-14T01:17:52.903582+0000","last_clean":"2023-10-14T01:17:52.903582+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:17:52.903582+0000","last_undegraded":"2023-10-14T01:17:52.903582+0000","last_fullsized":"2023-10-14T01:17:52.903582+0000","mapping_epoch":13,"log_start":"152'260323","ondisk_log_start":"152'260323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3506848448,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":264742,"num_read_kb":1030399,"num_write":259939,"num_write_kb":1039446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'268342","reported_seq":532281,"reported_epoch":155,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:17:52.858884+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:17:52.858884+0000","last_peered":"2023-10-14T01:17:52.858884+0000","last_clean":"2023-10-14T01:17:52.858884+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:17:52.858884+0000","last_undegraded":"2023-10-14T01:17:52.858884+0000","last_fullsized":"2023-10-14T01:17:52.858884+0000","mapping_epoch":13,"log_start":"153'258317","ondisk_log_start":"153'258317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":791,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 175s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3523318442,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":265761,"num_read_kb":1037876,"num_write":261681,"num_write_kb":1046473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"155'273304","reported_seq":545085,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:52.867902+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:17:52.867902+0000","last_peered":"2023-10-14T01:17:52.867902+0000","last_clean":"2023-10-14T01:17:52.867902+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:17:52.867902+0000","last_undegraded":"2023-10-14T01:17:52.867902+0000","last_fullsized":"2023-10-14T01:17:52.867902+0000","mapping_epoch":13,"log_start":"152'263223","ondisk_log_start":"152'263223","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3593880073,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":273996,"num_read_kb":1057962,"num_write":267170,"num_write_kb":1068201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"155'274827","reported_seq":544672,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:49.694669+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:17:49.694669+0000","last_peered":"2023-10-14T01:17:49.694669+0000","last_clean":"2023-10-14T01:17:49.694669+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:17:49.694669+0000","last_undegraded":"2023-10-14T01:17:49.694669+0000","last_fullsized":"2023-10-14T01:17:49.694669+0000","mapping_epoch":13,"log_start":"152'264812","ondisk_log_start":"152'264812","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3635470654,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":271447,"num_read_kb":1063206,"num_write":269542,"num_write_kb":1078007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"155'276344","reported_seq":548354,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:49.650050+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:17:49.650050+0000","last_peered":"2023-10-14T01:17:49.650050+0000","last_clean":"2023-10-14T01:17:49.650050+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:17:49.650050+0000","last_undegraded":"2023-10-14T01:17:49.650050+0000","last_fullsized":"2023-10-14T01:17:49.650050+0000","mapping_epoch":13,"log_start":"152'266316","ondisk_log_start":"152'266316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3667784231,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":273412,"num_read_kb":1072312,"num_write":271012,"num_write_kb":1083911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"155'313145","reported_seq":606164,"reported_epoch":155,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:17:52.886588+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:17:52.886588+0000","last_peered":"2023-10-14T01:17:52.886588+0000","last_clean":"2023-10-14T01:17:52.886588+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:17:52.886588+0000","last_undegraded":"2023-10-14T01:17:52.886588+0000","last_fullsized":"2023-10-14T01:17:52.886588+0000","mapping_epoch":13,"log_start":"153'303116","ondisk_log_start":"153'303116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":514,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 222s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3827216873,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":296044,"num_read_kb":1133450,"num_write":285602,"num_write_kb":1141753,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":333,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:05.104325+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:17:05.104325+0000","last_peered":"2023-10-14T01:17:05.104325+0000","last_clean":"2023-10-14T01:17:05.104325+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:17:05.104325+0000","last_undegraded":"2023-10-14T01:17:05.104325+0000","last_fullsized":"2023-10-14T01:17:05.104325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29019230131,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2199121,"num_read_kb":8533645,"num_write":2151743,"num_write_kb":8604161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17622269952,"data_stored":30194761574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80360,"ondisk_log_size":80360,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739299,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5261448,"kb_used_data":3304128,"kb_used_omap":495,"kb_used_meta":1956816,"kb_avail":89110392,"statfs":{"total":96636764160,"available":91249041408,"internally_reserved":0,"allocated":3383427072,"data_stored":5773356624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":507789,"internal_metadata":2003779699},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,1,3,7,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.91900000000000004,"15min":0.94699999999999995},"min":{"1min":0.20899999999999999,"5min":0.188,"15min":0.18099999999999999},"max":{"1min":3.7480000000000002,"5min":6.6340000000000003,"15min":8.5800000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.96599999999999997,"15min":1},"min":{"1min":0.245,"5min":0.245,"15min":0.215},"max":{"1min":3.8319999999999999,"5min":6.6859999999999999,"15min":8.6140000000000008},"last":0.54600000000000004}]},{"osd":1,"last update":"Sat Oct 14 01:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.77100000000000002,"15min":0.70199999999999996},"min":{"1min":0.20899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.70899999999999996,"5min":6.593,"15min":8.2479999999999993},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.97799999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":3.7909999999999999,"5min":6.7300000000000004,"15min":11.082000000000001},"last":0.25700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739285,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9748460,"kb_used_data":8605476,"kb_used_omap":1633,"kb_used_meta":1141342,"kb_avail":84623380,"statfs":{"total":96636764160,"available":86654341120,"internally_reserved":0,"allocated":8812007424,"data_stored":15097965269,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1672900,"internal_metadata":1168734524},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,2,2,19,7,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.79900000000000004,"15min":0.88900000000000001},"min":{"1min":0.25700000000000001,"5min":0.193,"15min":0.154},"max":{"1min":2.6240000000000001,"5min":12.076000000000001,"15min":12.933},"last":3.3319999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.89000000000000001,"15min":1.1719999999999999},"min":{"1min":0.221,"5min":0.185,"15min":0.185},"max":{"1min":5.6260000000000003,"5min":17.196999999999999,"15min":17.196999999999999},"last":0.23599999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:17:32 2023","interfaces":[{"interface":"back","average":{"1min":2.601,"5min":1.611,"15min":1.389},"min":{"1min":0.21199999999999999,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":9.2539999999999996,"5min":10.07,"15min":10.866},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.66100000000000003},"min":{"1min":0.251,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":2.4670000000000001,"5min":5.931,"15min":8.1430000000000007},"last":3.2909999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6563028,"kb_used_data":5301128,"kb_used_omap":934,"kb_used_meta":1260953,"kb_avail":87808812,"statfs":{"total":96636764160,"available":89916223488,"internally_reserved":0,"allocated":5428355072,"data_stored":9323562375,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":1291216686},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,2,7,5,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.0209999999999999,"15min":1.1180000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.17899999999999999},"max":{"1min":3.4089999999999998,"5min":7.8899999999999997,"15min":25.927},"last":0.434},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4059999999999999,"15min":1.3520000000000001},"min":{"1min":0.20999999999999999,"5min":0.188,"15min":0.188},"max":{"1min":6.0259999999999998,"5min":13.903,"15min":26.632999999999999},"last":0.35799999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.23699999999999999,"5min":0.221,"15min":0.214},"max":{"1min":3.4969999999999999,"5min":7.2640000000000002,"15min":8.5559999999999992},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.79700000000000004,"15min":0.92900000000000005},"min":{"1min":0.24399999999999999,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":4.5730000000000004,"5min":6.6710000000000003,"15min":10.228999999999999},"last":0.46100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5427638272,"data_stored":9323133541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8812359680,"data_stored":15098605491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3382272000,"data_stored":5773022542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:17:53.828 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:53.829 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:53.829 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:53.830 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:53.830 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:17:53.831 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:17:54.611 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:17:54.605+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T01:17:54.612 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:17:54.605+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:17:54.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:54.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:54.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:54.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:54.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:54.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:55.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:55.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:55.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:55.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:55.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:55.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:55.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:55.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:56.888 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:56.885+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:17:56.945 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:56.941+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:17:57.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:57.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:57.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:57.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:57.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:57.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:57.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:57.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:57.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:57.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:57.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:57.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:57.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:57.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:57.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:57.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:57.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:57.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:57.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:57.433+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:57.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:57.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:57.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:57.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:58.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:58.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:58.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:58.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:17:58.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:58.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:17:58.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:58.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:58.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:58.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:58.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:58.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:58.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:58.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:17:58.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:58.705+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:17:58.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:58.705+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:58.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:58.705+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:17:58.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:58.705+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:17:58.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:58.705+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:17:59.075 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:17:59.069+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:17:59.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:59.701+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:17:59.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:59.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:17:59.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:59.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:17:59.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:59.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:17:59.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:59.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:17:59.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:59.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:00.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:17:59.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:00.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:00.001+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:01.774 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:18:01.769+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:18:01.794 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:18:01.789+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:18:02.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:02.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:02.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:02.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:02.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:02.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:02.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:02.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:02.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:02.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:02.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:02.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:02.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:02.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:02.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:02.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:02.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:02.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:02.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:02.913+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:02.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:02.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:02.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:02.917+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:03.386 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:18:03.381+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:18:06.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:06.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:06.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:06.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:06.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:06.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:06.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:06.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:06.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:06.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:06.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:06.877+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:06.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:06.881+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:06.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:06.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:06.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:06.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:07.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:07.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:07.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:07.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:07.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:07.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:07.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:07.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:08.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:08.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:08.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:08.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.085+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:08.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:08.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:08.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:18:08.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:08.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:08.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:08.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:08.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:08.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:08.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:08.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.541+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:08.563 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:18:08.557+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:18:08.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.573+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:08.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.597+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:08.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:08.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:08.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:08.916 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:18:08.913+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:18:10.671 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:18:10.665+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:18:12.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:12.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:12.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:12.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:12.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:12.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:12.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:12.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:12.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:12.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:12.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:12.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:12.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:12.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:12.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:12.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:12.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:12.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:12.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:12.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:13.090 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:18:13.085+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:18:13.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:13.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:13.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:13.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:13.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:13.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:13.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:13.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:13.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:13.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:13.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:13.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:13.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:13.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:13.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:13.669+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:13.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:13.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:13.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:13.725+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:13.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:13.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:13.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:13.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:13.832 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:18:14.539 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:18:14.540 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:18:14.594 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2497,"stamp":"2023-10-14T01:18:13.540836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29046567379,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2206459,"num_read_kb":8562552,"num_write":2158732,"num_write_kb":8633463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80390,"ondisk_log_size":80390,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21407800,"kb_used_data":17267872,"kb_used_omap":3236,"kb_used_meta":4136667,"kb_avail":261707720,"statfs":{"total":289910292480,"available":267988705280,"internally_reserved":0,"allocated":17682300928,"data_stored":30253395628,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3314288,"internal_metadata":4235947408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,4,9,7,11,14,7,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16797696,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4488,"num_read_kb":17888,"num_write":4315,"num_write_kb":17260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001990"},"pg_stats":[{"pgid":"2.7","version":"155'277054","reported_seq":543207,"reported_epoch":155,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:18:08.681593+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:18:08.681593+0000","last_peered":"2023-10-14T01:18:08.681593+0000","last_clean":"2023-10-14T01:18:08.681593+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:18:08.681593+0000","last_undegraded":"2023-10-14T01:18:08.681593+0000","last_fullsized":"2023-10-14T01:18:08.681593+0000","mapping_epoch":13,"log_start":"153'267017","ondisk_log_start":"153'267017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":899,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 242s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3533554200,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":268353,"num_read_kb":1040736,"num_write":261684,"num_write_kb":1046389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'291330","reported_seq":574522,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:18:08.684382+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:18:08.684382+0000","last_peered":"2023-10-14T01:18:08.684382+0000","last_clean":"2023-10-14T01:18:08.684382+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:18:08.684382+0000","last_undegraded":"2023-10-14T01:18:08.684382+0000","last_fullsized":"2023-10-14T01:18:08.684382+0000","mapping_epoch":13,"log_start":"153'281316","ondisk_log_start":"153'281316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3737161946,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":287004,"num_read_kb":1104236,"num_write":276639,"num_write_kb":1106085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'271154","reported_seq":534500,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:18:08.666376+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:18:08.666376+0000","last_peered":"2023-10-14T01:18:08.666376+0000","last_clean":"2023-10-14T01:18:08.666376+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:18:08.666376+0000","last_undegraded":"2023-10-14T01:18:08.666376+0000","last_fullsized":"2023-10-14T01:18:08.666376+0000","mapping_epoch":13,"log_start":"153'261123","ondisk_log_start":"153'261123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3509842624,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":265492,"num_read_kb":1033387,"num_write":260708,"num_write_kb":1042522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"155'269150","reported_seq":533949,"reported_epoch":155,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:18:08.662206+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:18:08.662206+0000","last_peered":"2023-10-14T01:18:08.662206+0000","last_clean":"2023-10-14T01:18:08.662206+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:18:08.662206+0000","last_undegraded":"2023-10-14T01:18:08.662206+0000","last_fullsized":"2023-10-14T01:18:08.662206+0000","mapping_epoch":13,"log_start":"153'259118","ondisk_log_start":"153'259118","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":868,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 191s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3526193834,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":266606,"num_read_kb":1041232,"num_write":262419,"num_write_kb":1049425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"155'274279","reported_seq":547113,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:18:13.101855+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:18:13.101855+0000","last_peered":"2023-10-14T01:18:13.101855+0000","last_clean":"2023-10-14T01:18:13.101855+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:18:13.101855+0000","last_undegraded":"2023-10-14T01:18:13.101855+0000","last_fullsized":"2023-10-14T01:18:13.101855+0000","mapping_epoch":13,"log_start":"153'264223","ondisk_log_start":"153'264223","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3597660681,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":275034,"num_read_kb":1062102,"num_write":268139,"num_write_kb":1072077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"155'275838","reported_seq":546752,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:18:09.805213+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:18:09.805213+0000","last_peered":"2023-10-14T01:18:09.805213+0000","last_clean":"2023-10-14T01:18:09.805213+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:18:09.805213+0000","last_undegraded":"2023-10-14T01:18:09.805213+0000","last_fullsized":"2023-10-14T01:18:09.805213+0000","mapping_epoch":13,"log_start":"153'265812","ondisk_log_start":"153'265812","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3639419198,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":272515,"num_read_kb":1067458,"num_write":270540,"num_write_kb":1081999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"155'277378","reported_seq":550433,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:18:09.806440+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:18:09.806440+0000","last_peered":"2023-10-14T01:18:09.806440+0000","last_clean":"2023-10-14T01:18:09.806440+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:18:09.806440+0000","last_undegraded":"2023-10-14T01:18:09.806440+0000","last_fullsized":"2023-10-14T01:18:09.806440+0000","mapping_epoch":13,"log_start":"153'267316","ondisk_log_start":"153'267316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3671786023,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":274450,"num_read_kb":1076452,"num_write":272033,"num_write_kb":1087995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"155'314049","reported_seq":607946,"reported_epoch":155,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:18:08.632115+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:18:08.632115+0000","last_peered":"2023-10-14T01:18:08.632115+0000","last_clean":"2023-10-14T01:18:08.632115+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:18:08.632115+0000","last_undegraded":"2023-10-14T01:18:08.632115+0000","last_fullsized":"2023-10-14T01:18:08.632115+0000","mapping_epoch":13,"log_start":"153'304016","ondisk_log_start":"153'304016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":539,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 237s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3830358505,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":296899,"num_read_kb":1136858,"num_write":286433,"num_write_kb":1145077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":333,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:05.104325+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:17:05.104325+0000","last_peered":"2023-10-14T01:17:05.104325+0000","last_clean":"2023-10-14T01:17:05.104325+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:17:05.104325+0000","last_undegraded":"2023-10-14T01:17:05.104325+0000","last_fullsized":"2023-10-14T01:17:05.104325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29045977011,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2206353,"num_read_kb":8562461,"num_write":2158595,"num_write_kb":8631569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17679486976,"data_stored":30251978598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80291,"ondisk_log_size":80291,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739303,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4890724,"kb_used_data":3316380,"kb_used_omap":668,"kb_used_meta":1573667,"kb_avail":89481116,"statfs":{"total":96636764160,"available":91628662784,"internally_reserved":0,"allocated":3395973120,"data_stored":5785902672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1611435302},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,1,4,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.91900000000000004,"15min":0.94699999999999995},"min":{"1min":0.20899999999999999,"5min":0.188,"15min":0.18099999999999999},"max":{"1min":3.7480000000000002,"5min":6.6340000000000003,"15min":8.5800000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.96599999999999997,"15min":1},"min":{"1min":0.245,"5min":0.245,"15min":0.215},"max":{"1min":3.8319999999999999,"5min":6.6859999999999999,"15min":8.6140000000000008},"last":0.61799999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.77100000000000002,"15min":0.70199999999999996},"min":{"1min":0.20899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.70899999999999996,"5min":6.593,"15min":8.2479999999999993},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.97799999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":3.7909999999999999,"5min":6.7300000000000004,"15min":11.082000000000001},"last":0.35799999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739288,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9876592,"kb_used_data":8631208,"kb_used_omap":1633,"kb_used_meta":1243742,"kb_avail":84495248,"statfs":{"total":96636764160,"available":86523133952,"internally_reserved":0,"allocated":8838356992,"data_stored":15124314837,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1672900,"internal_metadata":1273592124},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,7,2,4,11,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.79900000000000004,"15min":0.88900000000000001},"min":{"1min":0.25700000000000001,"5min":0.193,"15min":0.154},"max":{"1min":2.6240000000000001,"5min":12.076000000000001,"15min":12.933},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.89000000000000001,"15min":1.1719999999999999},"min":{"1min":0.221,"5min":0.185,"15min":0.185},"max":{"1min":5.6260000000000003,"5min":17.196999999999999,"15min":17.196999999999999},"last":0.498}]},{"osd":2,"last update":"Sat Oct 14 01:17:32 2023","interfaces":[{"interface":"back","average":{"1min":2.601,"5min":1.611,"15min":1.389},"min":{"1min":0.21199999999999999,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":9.2539999999999996,"5min":10.07,"15min":10.866},"last":4.5179999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.66100000000000003},"min":{"1min":0.251,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":2.4670000000000001,"5min":5.931,"15min":8.1430000000000007},"last":0.56899999999999995}]}]},{"osd":0,"up_from":8,"seq":34359739303,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6640484,"kb_used_data":5320284,"kb_used_omap":934,"kb_used_meta":1319257,"kb_avail":87731356,"statfs":{"total":96636764160,"available":89836908544,"internally_reserved":0,"allocated":5447970816,"data_stored":9343178119,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":1350919982},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,4,3,2,5,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.0209999999999999,"15min":1.1180000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.17899999999999999},"max":{"1min":3.4089999999999998,"5min":7.8899999999999997,"15min":25.927},"last":1.7729999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4059999999999999,"15min":1.3520000000000001},"min":{"1min":0.20999999999999999,"5min":0.188,"15min":0.188},"max":{"1min":6.0259999999999998,"5min":13.903,"15min":26.632999999999999},"last":1.74}]},{"osd":2,"last update":"Sat Oct 14 01:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.23699999999999999,"5min":0.221,"15min":0.214},"max":{"1min":3.4969999999999999,"5min":7.2640000000000002,"15min":8.5559999999999992},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.79700000000000004,"15min":0.92900000000000005},"min":{"1min":0.24399999999999999,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":4.5730000000000004,"5min":6.6710000000000003,"15min":10.228999999999999},"last":0.34300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5447380992,"data_stored":9342876261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8837210112,"data_stored":15123455923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3394895872,"data_stored":5785646414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:18:14.596 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:14.596 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:14.596 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:14.597 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:14.597 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:14.597 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:18:16.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:16.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:16.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:16.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:16.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:16.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:16.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:16.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:16.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:16.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:16.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:16.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:16.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:16.913+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:17.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:17.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:17.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:17.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:17.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:17.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:17.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:17.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:17.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.277+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:17.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:17.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:17.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:17.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:17.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:17.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:17.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:17.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:17.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:17.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:17.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.733+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:17.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:17.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:17.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:17.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:17.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:17.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:17.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:17.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:17.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:22.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:22.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:22.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:22.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:22.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:22.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:22.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:22.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:22.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.957+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:22.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:22.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:22.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:22.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:22.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:22.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:22.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:23.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:23.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:23.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:23.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:23.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:23.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:23.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:23.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:23.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:23.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:23.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:23.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:23.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.677+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:23.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:23.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:23.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:23.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:23.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:23.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:23.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:23.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:23.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:23.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:23.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:23.953+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:24.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:24.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:24.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:24.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:24.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:24.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:24.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:24.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:24.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:24.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:24.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:24.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:24.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:24.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:24.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:24.597+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:24.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:24.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:24.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:24.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:25.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:25.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:25.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:25.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:25.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:25.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:25.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:25.853+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:27.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:27.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:27.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:27.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:27.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:27.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:27.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:27.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:27.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:27.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:27.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:27.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:27.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:27.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:27.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:27.949+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:27.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:27.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:30.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:30.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:30.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:30.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:30.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:30.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:30.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:30.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:30.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:30.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:30.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:30.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:30.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:30.305+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:30.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:30.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:30.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:30.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:31.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:31.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:31.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:31.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:31.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.265+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:31.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:31.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:31.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:31.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:31.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:31.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:31.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:31.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.609+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:31.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:31.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:32.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:32.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:32.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:32.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.385+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:32.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:32.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:32.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.405+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:32.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.405+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:32.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.405+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:32.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.405+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:32.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.405+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:32.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:32.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:32.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:32.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:32.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:32.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.629+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:32.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:32.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:32.669+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:33.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:18:33.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:18:33.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:18:33.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:33.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:33.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:33.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:33.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:33.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:33.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:33.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:33.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:33.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.745+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:33.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:33.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:33.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:34.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:34.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:18:34.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:34.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:34.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:34.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:34.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:34.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:34.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:34.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:34.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:34.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:34.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:34.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:34.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:34.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:34.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:34.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:34.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:34.553+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:34.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:34.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:34.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:34.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:34.598 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:18:35.515 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:18:35.509+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:18:35.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:35.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:35.638 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:18:35.639 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:18:35.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:35.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:35.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:35.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:35.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:35.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:35.693 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2509,"stamp":"2023-10-14T01:18:35.544347+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29084561875,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2216310,"num_read_kb":8601804,"num_write":2168428,"num_write_kb":8672247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80581,"ondisk_log_size":80581,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21836832,"kb_used_data":17342276,"kb_used_omap":3236,"kb_used_meta":4491291,"kb_avail":261278688,"statfs":{"total":289910292480,"available":267549376512,"internally_reserved":0,"allocated":17758490624,"data_stored":30329572982,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3314288,"internal_metadata":4599082384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,2,8,20,18,15],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22695936,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5882,"num_read_kb":23456,"num_write":5783,"num_write_kb":23132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001887"},"pg_stats":[{"pgid":"2.7","version":"156'278375","reported_seq":545802,"reported_epoch":156,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:18:34.374923+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:18:34.374923+0000","last_peered":"2023-10-14T01:18:34.374923+0000","last_clean":"2023-10-14T01:18:34.374923+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:18:34.374923+0000","last_undegraded":"2023-10-14T01:18:34.374923+0000","last_fullsized":"2023-10-14T01:18:34.374923+0000","mapping_epoch":13,"log_start":"153'268317","ondisk_log_start":"153'268317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":992,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 267s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3538317848,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":269600,"num_read_kb":1045700,"num_write":262873,"num_write_kb":1051145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"156'292685","reported_seq":577213,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:18:34.368423+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:18:34.368423+0000","last_peered":"2023-10-14T01:18:34.368423+0000","last_clean":"2023-10-14T01:18:34.368423+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:18:34.368423+0000","last_undegraded":"2023-10-14T01:18:34.368423+0000","last_fullsized":"2023-10-14T01:18:34.368423+0000","mapping_epoch":13,"log_start":"153'282616","ondisk_log_start":"153'282616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3742277850,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":288327,"num_read_kb":1109508,"num_write":277934,"num_write_kb":1111265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"156'272412","reported_seq":536971,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:18:34.373156+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:18:34.373156+0000","last_peered":"2023-10-14T01:18:34.373156+0000","last_clean":"2023-10-14T01:18:34.373156+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:18:34.373156+0000","last_undegraded":"2023-10-14T01:18:34.373156+0000","last_fullsized":"2023-10-14T01:18:34.373156+0000","mapping_epoch":13,"log_start":"153'262323","ondisk_log_start":"153'262323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3514585792,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":266694,"num_read_kb":1038179,"num_write":261926,"num_write_kb":1047394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"156'270463","reported_seq":536536,"reported_epoch":156,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:18:34.356587+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:18:34.356587+0000","last_peered":"2023-10-14T01:18:34.356587+0000","last_clean":"2023-10-14T01:18:34.356587+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:18:34.356587+0000","last_undegraded":"2023-10-14T01:18:34.356587+0000","last_fullsized":"2023-10-14T01:18:34.356587+0000","mapping_epoch":13,"log_start":"153'260418","ondisk_log_start":"153'260418","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":938,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 217s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3531006634,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":267861,"num_read_kb":1046224,"num_write":263660,"num_write_kb":1054389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"156'275270","reported_seq":549076,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:18:33.220810+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:18:33.220810+0000","last_peered":"2023-10-14T01:18:33.220810+0000","last_clean":"2023-10-14T01:18:33.220810+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:18:33.220810+0000","last_undegraded":"2023-10-14T01:18:33.220810+0000","last_fullsized":"2023-10-14T01:18:33.220810+0000","mapping_epoch":13,"log_start":"153'265223","ondisk_log_start":"153'265223","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3601498633,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":275993,"num_read_kb":1065926,"num_write":269115,"num_write_kb":1075981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"156'277037","reported_seq":549174,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:18:35.017468+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:18:35.017468+0000","last_peered":"2023-10-14T01:18:35.017468+0000","last_clean":"2023-10-14T01:18:35.017468+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:18:35.017468+0000","last_undegraded":"2023-10-14T01:18:35.017468+0000","last_fullsized":"2023-10-14T01:18:35.017468+0000","mapping_epoch":13,"log_start":"153'267012","ondisk_log_start":"153'267012","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3644117310,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":273726,"num_read_kb":1072290,"num_write":271731,"num_write_kb":1086763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"156'278611","reported_seq":552915,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:18:35.022827+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:18:35.022827+0000","last_peered":"2023-10-14T01:18:35.022827+0000","last_clean":"2023-10-14T01:18:35.022827+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:18:35.022827+0000","last_undegraded":"2023-10-14T01:18:35.022827+0000","last_fullsized":"2023-10-14T01:18:35.022827+0000","mapping_epoch":13,"log_start":"153'268516","ondisk_log_start":"153'268516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3676631591,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":275696,"num_read_kb":1081428,"num_write":273258,"num_write_kb":1092895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"156'315570","reported_seq":610914,"reported_epoch":156,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:18:34.365150+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:18:34.365150+0000","last_peered":"2023-10-14T01:18:34.365150+0000","last_clean":"2023-10-14T01:18:34.365150+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:18:34.365150+0000","last_undegraded":"2023-10-14T01:18:34.365150+0000","last_fullsized":"2023-10-14T01:18:34.365150+0000","mapping_epoch":13,"log_start":"153'305516","ondisk_log_start":"153'305516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":591,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 263s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3835535849,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":298307,"num_read_kb":1142458,"num_write":287794,"num_write_kb":1150521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":334,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:52.887420+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:17:52.887420+0000","last_peered":"2023-10-14T01:17:52.887420+0000","last_clean":"2023-10-14T01:17:52.887420+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:17:52.887420+0000","last_undegraded":"2023-10-14T01:17:52.887420+0000","last_fullsized":"2023-10-14T01:17:52.887420+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29083971507,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2216204,"num_read_kb":8601713,"num_write":2168291,"num_write_kb":8670353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17756037120,"data_stored":30328528742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80482,"ondisk_log_size":80482,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739308,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4977800,"kb_used_data":3331264,"kb_used_omap":668,"kb_used_meta":1645859,"kb_avail":89394040,"statfs":{"total":96636764160,"available":91539496960,"internally_reserved":0,"allocated":3411214336,"data_stored":5801139774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1685359910},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,4,5,6,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.91900000000000004,"15min":0.94699999999999995},"min":{"1min":0.20899999999999999,"5min":0.188,"15min":0.18099999999999999},"max":{"1min":3.7480000000000002,"5min":6.6340000000000003,"15min":8.5800000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.96599999999999997,"15min":1},"min":{"1min":0.245,"5min":0.245,"15min":0.215},"max":{"1min":3.8319999999999999,"5min":6.6859999999999999,"15min":8.6140000000000008},"last":0.40999999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.77100000000000002,"15min":0.70199999999999996},"min":{"1min":0.20899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.70899999999999996,"5min":6.593,"15min":8.2479999999999993},"last":0.317},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.97799999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.222},"max":{"1min":3.7909999999999999,"5min":6.7300000000000004,"15min":11.082000000000001},"last":0.373}]}]},{"osd":1,"up_from":8,"seq":34359739293,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10102400,"kb_used_data":8670388,"kb_used_omap":1633,"kb_used_meta":1430366,"kb_avail":84269440,"statfs":{"total":96636764160,"available":86291906560,"internally_reserved":0,"allocated":8878477312,"data_stored":15164431043,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1672900,"internal_metadata":1464695100},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,4,14,9,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:17:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.79900000000000004,"15min":0.88900000000000001},"min":{"1min":0.25700000000000001,"5min":0.193,"15min":0.154},"max":{"1min":2.6240000000000001,"5min":12.076000000000001,"15min":12.933},"last":0.25},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.89000000000000001,"15min":1.1719999999999999},"min":{"1min":0.221,"5min":0.185,"15min":0.185},"max":{"1min":5.6260000000000003,"5min":17.196999999999999,"15min":17.196999999999999},"last":0.311}]},{"osd":2,"last update":"Sat Oct 14 01:17:32 2023","interfaces":[{"interface":"back","average":{"1min":2.601,"5min":1.611,"15min":1.389},"min":{"1min":0.21199999999999999,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":9.2539999999999996,"5min":10.07,"15min":10.866},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.66100000000000003},"min":{"1min":0.251,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":2.4670000000000001,"5min":5.931,"15min":8.1430000000000007},"last":0.222}]}]},{"osd":0,"up_from":8,"seq":34359739307,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6756632,"kb_used_data":5340624,"kb_used_omap":934,"kb_used_meta":1415065,"kb_avail":87615208,"statfs":{"total":96636764160,"available":89717972992,"internally_reserved":0,"allocated":5468798976,"data_stored":9364002165,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":1449027374},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,0,1,3,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.0209999999999999,"15min":1.1180000000000001},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.17899999999999999},"max":{"1min":3.4089999999999998,"5min":7.8899999999999997,"15min":25.927},"last":0.27000000000000002},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.4059999999999999,"15min":1.3520000000000001},"min":{"1min":0.20999999999999999,"5min":0.188,"15min":0.188},"max":{"1min":6.0259999999999998,"5min":13.903,"15min":26.632999999999999},"last":0.30599999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.79600000000000004,"15min":0.82199999999999995},"min":{"1min":0.23699999999999999,"5min":0.221,"15min":0.214},"max":{"1min":3.4969999999999999,"5min":7.2640000000000002,"15min":8.5559999999999992},"last":3.9359999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":0.79700000000000004,"15min":0.92900000000000005},"min":{"1min":0.24399999999999999,"5min":0.216,"15min":0.21299999999999999},"max":{"1min":4.5730000000000004,"5min":6.6710000000000003,"15min":10.228999999999999},"last":0.23499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5467336704,"data_stored":9362831973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8878452736,"data_stored":15164698547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3410247680,"data_stored":5800998222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:18:35.695 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:35.695 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:35.696 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:35.696 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:35.697 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:35.697 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:18:35.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:35.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:35.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:35.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:35.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:35.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:35.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:35.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:35.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:35.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:35.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:35.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:35.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:35.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:35.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:35.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:37.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:37.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:18:37.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:37.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:37.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:37.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:37.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:37.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:37.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:37.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:37.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:37.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:37.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:37.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:37.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:37.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:37.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:37.621+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:37.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:37.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:37.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:37.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:38.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:38.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:38.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:38.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:38.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:38.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.469+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:38.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:38.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.489+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:38.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:38.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:38.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:38.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:38.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:38.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:38.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:38.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:38.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:38.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:38.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:38.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.737+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:38.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:38.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:38.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:39.809 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:18:39.805+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:18:40.138 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:40.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:40.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:40.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:40.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:40.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:40.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.217+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:40.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.229+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:40.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.229+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:40.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:40.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:40.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:40.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.449+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:40.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:40.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:40.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:40.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.497+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:40.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:40.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:40.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:41.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:41.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:41.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:41.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:41.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:41.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:41.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:41.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:41.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:41.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.181+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:41.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:41.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:41.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:18:41.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:41.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:41.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:41.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:41.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:41.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:41.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:41.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:41.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:41.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.485+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:41.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:41.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:41.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:18:41.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:41.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:41.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:41.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:41.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:41.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:41.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:41.821+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:42.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:18:42.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:42.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:42.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:42.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:42.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:42.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:42.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:42.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:42.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:42.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.761+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:42.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:42.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:42.761+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:43.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:18:43.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:43.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:43.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:43.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:43.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:43.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:43.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:43.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:43.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:43.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.345+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:43.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:43.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:43.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:43.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:43.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:43.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:43.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:44.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.001+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:44.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:44.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:44.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:44.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:44.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.389+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:44.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.389+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:44.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.389+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:44.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.389+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:44.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.389+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:44.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:44.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:44.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:44.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:45.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:45.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:45.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:45.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:45.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:45.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:45.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:45.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:45.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:45.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:45.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:45.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:45.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:45.269+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:45.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:45.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:45.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:45.293+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:47.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:47.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:47.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:47.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:47.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:47.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:47.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:47.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:47.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:47.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.492+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:47.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:47.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:47.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:47.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:47.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:47.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:47.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.780+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:47.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:47.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:47.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:47.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.808+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:47.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:47.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:47.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:48.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:48.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:48.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:48.256+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:48.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:48.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:48.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:48.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:48.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:48.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:48.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:48.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:48.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:48.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:48.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:48.304+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:48.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:48.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:48.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:48.304+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:18:55.699 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:18:56.495 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:18:56.496 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:18:56.561 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2519,"stamp":"2023-10-14T01:18:55.551845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29115986387,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2224461,"num_read_kb":8634300,"num_write":2176423,"num_write_kb":8704227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80522,"ondisk_log_size":80522,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22230848,"kb_used_data":17407528,"kb_used_omap":3236,"kb_used_meta":4820059,"kb_avail":260884672,"statfs":{"total":289910292480,"available":267145904128,"internally_reserved":0,"allocated":17825308672,"data_stored":30396391030,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3314288,"internal_metadata":4935740816},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,5,7,21,18,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22671360,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5841,"num_read_kb":23292,"num_write":5773,"num_write_kb":23092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001888"},"pg_stats":[{"pgid":"2.7","version":"156'279480","reported_seq":547934,"reported_epoch":156,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:18:54.947598+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:18:54.947598+0000","last_peered":"2023-10-14T01:18:54.947598+0000","last_clean":"2023-10-14T01:18:54.947598+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:18:54.947598+0000","last_undegraded":"2023-10-14T01:18:54.947598+0000","last_fullsized":"2023-10-14T01:18:54.947598+0000","mapping_epoch":13,"log_start":"153'269417","ondisk_log_start":"153'269417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1055,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 288s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3542299160,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":270605,"num_read_kb":1049708,"num_write":263876,"num_write_kb":1055157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"156'293766","reported_seq":579342,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:18:54.888958+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:18:54.888958+0000","last_peered":"2023-10-14T01:18:54.888958+0000","last_clean":"2023-10-14T01:18:54.888958+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:18:54.888958+0000","last_undegraded":"2023-10-14T01:18:54.888958+0000","last_fullsized":"2023-10-14T01:18:54.888958+0000","mapping_epoch":13,"log_start":"153'283716","ondisk_log_start":"153'283716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3746291930,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":289361,"num_read_kb":1113612,"num_write":278958,"num_write_kb":1115361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"156'273401","reported_seq":538905,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:18:54.918340+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:18:54.918340+0000","last_peered":"2023-10-14T01:18:54.918340+0000","last_clean":"2023-10-14T01:18:54.918340+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:18:54.918340+0000","last_undegraded":"2023-10-14T01:18:54.918340+0000","last_fullsized":"2023-10-14T01:18:54.918340+0000","mapping_epoch":13,"log_start":"153'263323","ondisk_log_start":"153'263323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3518304960,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":267631,"num_read_kb":1041923,"num_write":262875,"num_write_kb":1051190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"156'271528","reported_seq":538638,"reported_epoch":156,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:18:54.917888+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:18:54.917888+0000","last_peered":"2023-10-14T01:18:54.917888+0000","last_clean":"2023-10-14T01:18:54.917888+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:18:54.917888+0000","last_undegraded":"2023-10-14T01:18:54.917888+0000","last_fullsized":"2023-10-14T01:18:54.917888+0000","mapping_epoch":13,"log_start":"153'261519","ondisk_log_start":"153'261519","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1023,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 237s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3534860970,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":268888,"num_read_kb":1050304,"num_write":264639,"num_write_kb":1058305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"156'276251","reported_seq":551020,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:18:53.369358+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:18:53.369358+0000","last_peered":"2023-10-14T01:18:53.369358+0000","last_clean":"2023-10-14T01:18:53.369358+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:18:53.369358+0000","last_undegraded":"2023-10-14T01:18:53.369358+0000","last_fullsized":"2023-10-14T01:18:53.369358+0000","mapping_epoch":13,"log_start":"153'266223","ondisk_log_start":"153'266223","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3605369353,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":276942,"num_read_kb":1069714,"num_write":270093,"num_write_kb":1079893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"156'278050","reported_seq":551214,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:18:55.213730+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:18:55.213730+0000","last_peered":"2023-10-14T01:18:55.213730+0000","last_clean":"2023-10-14T01:18:55.213730+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:18:55.213730+0000","last_undegraded":"2023-10-14T01:18:55.213730+0000","last_fullsized":"2023-10-14T01:18:55.213730+0000","mapping_epoch":13,"log_start":"153'268012","ondisk_log_start":"153'268012","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3648028990,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":274750,"num_read_kb":1076382,"num_write":272738,"num_write_kb":1090791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"156'279612","reported_seq":554924,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:18:55.192842+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:18:55.192842+0000","last_peered":"2023-10-14T01:18:55.192842+0000","last_clean":"2023-10-14T01:18:55.192842+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:18:55.192842+0000","last_undegraded":"2023-10-14T01:18:55.192842+0000","last_fullsized":"2023-10-14T01:18:55.192842+0000","mapping_epoch":13,"log_start":"153'269516","ondisk_log_start":"153'269516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3680625191,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":276697,"num_read_kb":1085424,"num_write":274253,"num_write_kb":1096875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"156'316777","reported_seq":613326,"reported_epoch":156,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:18:54.919295+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:18:54.919295+0000","last_peered":"2023-10-14T01:18:54.919295+0000","last_clean":"2023-10-14T01:18:54.919295+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:18:54.919295+0000","last_undegraded":"2023-10-14T01:18:54.919295+0000","last_fullsized":"2023-10-14T01:18:54.919295+0000","mapping_epoch":13,"log_start":"154'306716","ondisk_log_start":"154'306716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":642,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 284s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3839615465,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":299481,"num_read_kb":1147142,"num_write":288854,"num_write_kb":1154761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":334,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:52.887420+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:17:52.887420+0000","last_peered":"2023-10-14T01:17:52.887420+0000","last_clean":"2023-10-14T01:17:52.887420+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:17:52.887420+0000","last_undegraded":"2023-10-14T01:17:52.887420+0000","last_fullsized":"2023-10-14T01:17:52.887420+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29115396019,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2224355,"num_read_kb":8634209,"num_write":2176286,"num_write_kb":8702333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17821286400,"data_stored":30393778022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80423,"ondisk_log_size":80423,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739312,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5040336,"kb_used_data":3343816,"kb_used_omap":668,"kb_used_meta":1695843,"kb_avail":89331504,"statfs":{"total":96636764160,"available":91475460096,"internally_reserved":0,"allocated":3424067584,"data_stored":5813993022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1736543526},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,4,11,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.82599999999999996,"15min":0.96699999999999997},"min":{"1min":0.26100000000000001,"5min":0.188,"15min":0.18099999999999999},"max":{"1min":3.859,"5min":6.6340000000000003,"15min":8.5800000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.873,"15min":1.0189999999999999},"min":{"1min":0.32400000000000001,"5min":0.245,"15min":0.215},"max":{"1min":3.8959999999999999,"5min":6.6859999999999999,"15min":8.6140000000000008},"last":0.39800000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.75,"15min":0.69399999999999995},"min":{"1min":0.223,"5min":0.20899999999999999,"15min":0.193},"max":{"1min":4.2789999999999999,"5min":6.593,"15min":6.593},"last":0.245},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.82299999999999995,"15min":0.997},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":8.3699999999999992,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.36299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739297,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10306524,"kb_used_data":8703764,"kb_used_omap":1633,"kb_used_meta":1601118,"kb_avail":84065316,"statfs":{"total":96636764160,"available":86082883584,"internally_reserved":0,"allocated":8912654336,"data_stored":15198608067,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1672900,"internal_metadata":1639545148},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,3,3,7,12,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.702,"5min":0.83499999999999996,"15min":0.96699999999999997},"min":{"1min":0.23200000000000001,"5min":0.193,"15min":0.154},"max":{"1min":9.8879999999999999,"5min":9.8879999999999999,"15min":12.933},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.69599999999999995,"15min":1.139},"min":{"1min":0.23599999999999999,"5min":0.185,"15min":0.185},"max":{"1min":10.029999999999999,"5min":10.029999999999999,"15min":17.196999999999999},"last":0.214}]},{"osd":2,"last update":"Sat Oct 14 01:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.8,"5min":1.6879999999999999,"15min":1.474},"min":{"1min":0.249,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":9.3680000000000003,"5min":10.07,"15min":10.866},"last":0.23899999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":0.68999999999999995,"15min":0.70499999999999996},"min":{"1min":0.222,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":5.0629999999999997,"5min":5.0629999999999997,"15min":8.1430000000000007},"last":0.25800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739311,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6883988,"kb_used_data":5359948,"kb_used_omap":934,"kb_used_meta":1523097,"kb_avail":87487852,"statfs":{"total":96636764160,"available":89587560448,"internally_reserved":0,"allocated":5488586752,"data_stored":9383789941,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":1559652142},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,3,4,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.75700000000000001,"15min":1.071},"min":{"1min":0.26500000000000001,"5min":0.21299999999999999,"15min":0.17899999999999999},"max":{"1min":1.7729999999999999,"5min":7.8899999999999997,"15min":25.927},"last":0.36699999999999999},{"interface":"front","average":{"1min":1.399,"5min":1.361,"15min":1.381},"min":{"1min":0.23499999999999999,"5min":0.188,"15min":0.188},"max":{"1min":5.641,"5min":13.903,"15min":26.632999999999999},"last":0.26600000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.55500000000000005,"15min":0.80700000000000005},"min":{"1min":0.24199999999999999,"5min":0.221,"15min":0.214},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":8.5559999999999992},"last":0.29799999999999999},{"interface":"front","average":{"1min":1.52,"5min":0.94699999999999995,"15min":0.98099999999999998},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.214},"max":{"1min":8.7360000000000007,"5min":8.7360000000000007,"15min":10.228999999999999},"last":0.40200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5487181824,"data_stored":9382677093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8911380480,"data_stored":15197626291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3422724096,"data_stored":5813474638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:18:56.563 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:56.563 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:56.563 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:56.564 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:56.564 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:18:56.564 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:18:56.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:56.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:18:56.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:56.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:18:56.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:56.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:18:56.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:56.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:18:56.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:56.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:18:56.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:56.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:18:56.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:56.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:18:57.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:57.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:18:57.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:57.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:18:57.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:57.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:18:57.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:57.012+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:18:57.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:57.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:18:57.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:18:57.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:00.285 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:19:00.284+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:19:00.286 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:19:00.284+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:19:00.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:19:00.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:19:00.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:00.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:00.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:00.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:00.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:00.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:00.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:00.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.464+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:00.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.496+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:00.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.508+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:00.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:00.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:00.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:19:00.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:00.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:19:01.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:01.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:01.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:01.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:01.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:01.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:01.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:01.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:01.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:01.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.144+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:01.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:01.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.144+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:01.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:01.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:01.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:01.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:01.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:01.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:01.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:01.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:01.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:01.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.880+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:01.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:01.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:01.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:02.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:19:02.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:02.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:02.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:02.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:02.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:02.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:02.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:02.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:02.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.496+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:02.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.500+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:02.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:02.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:02.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:03.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:03.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:03.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:03.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:03.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:03.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:03.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:03.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:03.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:03.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:03.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:03.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:03.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:03.916+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:03.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:03.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:03.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:03.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:05.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:19:05.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:19:05.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:19:05.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:05.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:05.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:05.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:05.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:05.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:05.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:05.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:05.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:05.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.404+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:05.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:05.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:05.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:07.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:07.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:07.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:07.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:07.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:07.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:07.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:07.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:07.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:07.596+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:07.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:07.648+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:07.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:07.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:07.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:07.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:07.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:07.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:08.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:08.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:08.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.000+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:08.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:08.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:08.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:08.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:08.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:08.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.044+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:08.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:08.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:08.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:19:08.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:08.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:08.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:08.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:08.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:08.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.268+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:08.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.268+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:08.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.268+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:08.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.268+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:08.275 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:08.268+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:11.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:11.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:19:11.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:11.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:11.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:11.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:11.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:11.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:11.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:11.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:11.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:11.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:11.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:11.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:11.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:11.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:15.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:15.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:15.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:15.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:15.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:15.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:15.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:15.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:15.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:15.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:15.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:15.888+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:15.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:15.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:15.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:15.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:15.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:16.565 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:19:17.633 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:19:17.634 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:19:17.694 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2530,"stamp":"2023-10-14T01:19:17.558573+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29147906515,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2232438,"num_read_kb":8666104,"num_write":2184496,"num_write_kb":8736519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80449,"ondisk_log_size":80449,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22590288,"kb_used_data":17470900,"kb_used_omap":3236,"kb_used_meta":5116123,"kb_avail":260525232,"statfs":{"total":289910292480,"available":266777837568,"internally_reserved":0,"allocated":17890201600,"data_stored":30461283958,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3314288,"internal_metadata":5238910352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,3,5,11,9,9,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15962112,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3935,"num_read_kb":15668,"num_write":4029,"num_write_kb":16116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003530"},"pg_stats":[{"pgid":"2.7","version":"156'280527","reported_seq":549987,"reported_epoch":156,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:19:15.646885+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:19:15.646885+0000","last_peered":"2023-10-14T01:19:15.646885+0000","last_clean":"2023-10-14T01:19:15.646885+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:19:15.646885+0000","last_undegraded":"2023-10-14T01:19:15.646885+0000","last_fullsized":"2023-10-14T01:19:15.646885+0000","mapping_epoch":13,"log_start":"154'270517","ondisk_log_start":"154'270517","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1149,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 309s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3545969176,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":271589,"num_read_kb":1053632,"num_write":264821,"num_write_kb":1058937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"156'294844","reported_seq":581404,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:19:15.625815+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:19:15.625815+0000","last_peered":"2023-10-14T01:19:15.625815+0000","last_clean":"2023-10-14T01:19:15.625815+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:19:15.625815+0000","last_undegraded":"2023-10-14T01:19:15.625815+0000","last_fullsized":"2023-10-14T01:19:15.625815+0000","mapping_epoch":13,"log_start":"154'284816","ondisk_log_start":"154'284816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3750437082,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":290334,"num_read_kb":1117488,"num_write":280003,"num_write_kb":1119541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"156'274406","reported_seq":540872,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:19:15.651105+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:19:15.651105+0000","last_peered":"2023-10-14T01:19:15.651105+0000","last_clean":"2023-10-14T01:19:15.651105+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:19:15.651105+0000","last_undegraded":"2023-10-14T01:19:15.651105+0000","last_fullsized":"2023-10-14T01:19:15.651105+0000","mapping_epoch":13,"log_start":"154'264323","ondisk_log_start":"154'264323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3522273984,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":268586,"num_read_kb":1045743,"num_write":263858,"num_write_kb":1055122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"156'272610","reported_seq":540736,"reported_epoch":156,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:19:15.638209+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:19:15.638209+0000","last_peered":"2023-10-14T01:19:15.638209+0000","last_clean":"2023-10-14T01:19:15.638209+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:19:15.638209+0000","last_undegraded":"2023-10-14T01:19:15.638209+0000","last_fullsized":"2023-10-14T01:19:15.638209+0000","mapping_epoch":13,"log_start":"154'262520","ondisk_log_start":"154'262520","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1108,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 258s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3538784938,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":269888,"num_read_kb":1054288,"num_write":265645,"num_write_kb":1062329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"156'277226","reported_seq":552982,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:19:13.484858+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:19:13.484858+0000","last_peered":"2023-10-14T01:19:13.484858+0000","last_clean":"2023-10-14T01:19:13.484858+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:19:13.484858+0000","last_undegraded":"2023-10-14T01:19:13.484858+0000","last_fullsized":"2023-10-14T01:19:13.484858+0000","mapping_epoch":13,"log_start":"153'267223","ondisk_log_start":"153'267223","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3609129481,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":277916,"num_read_kb":1073594,"num_write":271059,"num_write_kb":1083757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"156'279055","reported_seq":553220,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:19:15.317403+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:19:15.317403+0000","last_peered":"2023-10-14T01:19:15.317403+0000","last_clean":"2023-10-14T01:19:15.317403+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:19:15.317403+0000","last_undegraded":"2023-10-14T01:19:15.317403+0000","last_fullsized":"2023-10-14T01:19:15.317403+0000","mapping_epoch":13,"log_start":"154'269012","ondisk_log_start":"154'269012","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3652018494,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":275746,"num_read_kb":1080354,"num_write":273740,"num_write_kb":1094799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"156'280630","reported_seq":556945,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-10-14T01:19:15.331317+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:19:15.331317+0000","last_peered":"2023-10-14T01:19:15.331317+0000","last_clean":"2023-10-14T01:19:15.331317+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:19:15.331317+0000","last_undegraded":"2023-10-14T01:19:15.331317+0000","last_fullsized":"2023-10-14T01:19:15.331317+0000","mapping_epoch":13,"log_start":"154'270616","ondisk_log_start":"154'270616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3684725287,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":277696,"num_read_kb":1089408,"num_write":275268,"num_write_kb":1100935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"156'317995","reported_seq":615659,"reported_epoch":156,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:19:15.623938+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:19:15.623938+0000","last_peered":"2023-10-14T01:19:15.623938+0000","last_clean":"2023-10-14T01:19:15.623938+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:19:15.623938+0000","last_undegraded":"2023-10-14T01:19:15.623938+0000","last_fullsized":"2023-10-14T01:19:15.623938+0000","mapping_epoch":13,"log_start":"154'307916","ondisk_log_start":"154'307916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":694,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 304s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3843977705,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":300577,"num_read_kb":1151506,"num_write":289965,"num_write_kb":1159205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":334,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-14T01:17:52.887420+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:17:52.887420+0000","last_peered":"2023-10-14T01:17:52.887420+0000","last_clean":"2023-10-14T01:17:52.887420+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:17:52.887420+0000","last_undegraded":"2023-10-14T01:17:52.887420+0000","last_fullsized":"2023-10-14T01:17:52.887420+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29147316147,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2232332,"num_read_kb":8666013,"num_write":2184359,"num_write_kb":8734625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17887236096,"data_stored":30459727718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80350,"ondisk_log_size":80350,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739316,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5101216,"kb_used_data":3356120,"kb_used_omap":668,"kb_used_meta":1744419,"kb_avail":89270624,"statfs":{"total":96636764160,"available":91413118976,"internally_reserved":0,"allocated":3436666880,"data_stored":5826592318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1786285350},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,2,2,2,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.82599999999999996,"15min":0.96699999999999997},"min":{"1min":0.26100000000000001,"5min":0.188,"15min":0.18099999999999999},"max":{"1min":3.859,"5min":6.6340000000000003,"15min":8.5800000000000001},"last":0.442},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.873,"15min":1.0189999999999999},"min":{"1min":0.32400000000000001,"5min":0.245,"15min":0.215},"max":{"1min":3.8959999999999999,"5min":6.6859999999999999,"15min":8.6140000000000008},"last":0.47599999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.75,"15min":0.69399999999999995},"min":{"1min":0.223,"5min":0.20899999999999999,"15min":0.193},"max":{"1min":4.2789999999999999,"5min":6.593,"15min":6.593},"last":0.25},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.82299999999999995,"15min":0.997},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":8.3699999999999992,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.50600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739301,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10495708,"kb_used_data":8735700,"kb_used_omap":1633,"kb_used_meta":1758366,"kb_avail":83876132,"statfs":{"total":96636764160,"available":85889159168,"internally_reserved":0,"allocated":8945356800,"data_stored":15231310531,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1672900,"internal_metadata":1800567100},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,6,4,9,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.702,"5min":0.83499999999999996,"15min":0.96699999999999997},"min":{"1min":0.23200000000000001,"5min":0.193,"15min":0.154},"max":{"1min":9.8879999999999999,"5min":9.8879999999999999,"15min":12.933},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.69599999999999995,"15min":1.139},"min":{"1min":0.23599999999999999,"5min":0.185,"15min":0.185},"max":{"1min":10.029999999999999,"5min":10.029999999999999,"15min":17.196999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Sat Oct 14 01:18:34 2023","interfaces":[{"interface":"back","average":{"1min":1.8,"5min":1.6879999999999999,"15min":1.474},"min":{"1min":0.249,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":9.3680000000000003,"5min":10.07,"15min":10.866},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":0.68999999999999995,"15min":0.70499999999999996},"min":{"1min":0.222,"5min":0.20699999999999999,"15min":0.186},"max":{"1min":5.0629999999999997,"5min":5.0629999999999997,"15min":8.1430000000000007},"last":0.498}]}]},{"osd":0,"up_from":8,"seq":34359739315,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6993364,"kb_used_data":5379080,"kb_used_omap":934,"kb_used_meta":1613337,"kb_avail":87378476,"statfs":{"total":96636764160,"available":89475559424,"internally_reserved":0,"allocated":5508177920,"data_stored":9403381109,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":1652057902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1,3,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.75700000000000001,"15min":1.071},"min":{"1min":0.26500000000000001,"5min":0.21299999999999999,"15min":0.17899999999999999},"max":{"1min":1.7729999999999999,"5min":7.8899999999999997,"15min":25.927},"last":0.375},{"interface":"front","average":{"1min":1.399,"5min":1.361,"15min":1.381},"min":{"1min":0.23499999999999999,"5min":0.188,"15min":0.188},"max":{"1min":5.641,"5min":13.903,"15min":26.632999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:18:38 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.55500000000000005,"15min":0.80700000000000005},"min":{"1min":0.24199999999999999,"5min":0.221,"15min":0.214},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":8.5559999999999992},"last":0.22500000000000001},{"interface":"front","average":{"1min":1.52,"5min":0.94699999999999995,"15min":0.98099999999999998},"min":{"1min":0.23499999999999999,"5min":0.216,"15min":0.214},"max":{"1min":8.7360000000000007,"5min":8.7360000000000007,"15min":10.228999999999999},"last":0.41199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5507055616,"data_stored":9402550885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8944799744,"data_stored":15231045555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3435380736,"data_stored":5826131278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:19:17.695 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:19:17.696 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:19:17.696 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:19:17.696 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:19:17.697 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:19:17.697 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T01:19:18.567 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T01:19:18.618 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:19:18.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:18.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:18.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:18.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:18.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:18.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:18.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:18.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:18.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:18.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:19.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:19.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:19.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:19.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:19.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:19.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:19.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:19.004+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:19.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:19.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:19.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:19.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:19.422 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:19:19.475 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T01:19:20.200 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T01:19:20.245 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T01:19:20.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:20.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:20.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:20.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:20.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:20.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:20.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:20.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:20.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:20.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.408+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:20.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:20.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:20.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:19:20.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.764+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:20.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:20.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:20.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:20.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:20.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:20.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.848+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:20.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.848+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:20.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.864+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:20.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:20.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:20.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:20.934 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T01:19:21.012 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T01:19:21.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.652+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:19:21.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:19:21.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:21.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:21.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:21.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:21.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:21.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:21.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:21.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:21.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:21.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.736+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:21.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:21.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:21.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:21.811 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T01:19:21.902 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:19:23.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:23.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:23.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:23.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:23.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:23.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:23.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:23.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:23.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:23.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:23.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:23.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:23.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:23.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:23.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:23.948+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:23.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:23.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:23.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:23.960+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:23.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:23.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:23.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:23.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:24.059 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:19:24.060+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:19:27.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:27.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:27.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:27.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:27.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:27.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:27.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:27.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:27.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:27.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:27.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:27.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:27.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:27.748+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:27.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:27.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:27.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:27.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:28.078 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:19:28.076+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:19:29.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:29.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:29.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:29.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:29.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:29.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:29.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:29.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:29.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.788+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:29.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:29.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:29.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:19:29.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:29.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:29.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:29.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:29.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:29.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:29.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:29.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:29.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:29.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.924+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:29.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:29.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:29.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:30.751 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:19:30.748+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:19:39.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:19:39.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:39.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:39.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:39.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:39.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:39.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:39.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:39.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:39.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:39.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.864+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:39.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:39.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:39.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:40.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:19:40.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:40.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:40.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:40.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:40.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:40.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:40.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:40.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:40.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:40.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.224+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:40.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:40.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:40.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.820+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:19:40.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:40.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:40.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:40.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:40.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:40.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:40.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:40.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.916+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:40.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:40.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.932+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:40.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.932+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:40.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:40.932+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:41.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:41.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:19:41.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:41.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:41.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:41.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:41.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:41.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:41.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:41.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:41.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:41.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:41.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:41.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:41.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:41.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:41.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:41.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:41.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:41.224+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:41.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:41.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:41.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:41.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:41.905 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:19:42.726 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:19:42.727 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:19:42.793 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2544,"stamp":"2023-10-14T01:19:41.565515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29186437587,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2242354,"num_read_kb":8705660,"num_write":2194267,"num_write_kb":8775603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80532,"ondisk_log_size":80532,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23107352,"kb_used_data":17548992,"kb_used_omap":3236,"kb_used_meta":5555099,"kb_avail":260008168,"statfs":{"total":289910292480,"available":266248364032,"internally_reserved":0,"allocated":17970167808,"data_stored":30541233495,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3314288,"internal_metadata":5688421776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,5,5,7,23,7,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15663104,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3955,"num_read_kb":15780,"num_write":3990,"num_write_kb":15960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.004661"},"pg_stats":[{"pgid":"2.7","version":"158'281823","reported_seq":552512,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:19:41.418297+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:19:41.418297+0000","last_peered":"2023-10-14T01:19:41.418297+0000","last_clean":"2023-10-14T01:19:41.418297+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:19:41.418297+0000","last_undegraded":"2023-10-14T01:19:41.418297+0000","last_fullsized":"2023-10-14T01:19:41.418297+0000","mapping_epoch":13,"log_start":"154'271817","ondisk_log_start":"154'271817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1252,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 335s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3550646808,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":272788,"num_read_kb":1058404,"num_write":266002,"num_write_kb":1063661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'296178","reported_seq":584023,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:19:41.436673+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:19:41.436673+0000","last_peered":"2023-10-14T01:19:41.436673+0000","last_clean":"2023-10-14T01:19:41.436673+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:19:41.436673+0000","last_undegraded":"2023-10-14T01:19:41.436673+0000","last_fullsized":"2023-10-14T01:19:41.436673+0000","mapping_epoch":13,"log_start":"154'286116","ondisk_log_start":"154'286116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3755585754,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":291599,"num_read_kb":1122536,"num_write":281298,"num_write_kb":1124721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'275554","reported_seq":543280,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:19:41.423882+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:19:41.423882+0000","last_peered":"2023-10-14T01:19:41.423882+0000","last_clean":"2023-10-14T01:19:41.423882+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:19:41.423882+0000","last_undegraded":"2023-10-14T01:19:41.423882+0000","last_fullsized":"2023-10-14T01:19:41.423882+0000","mapping_epoch":13,"log_start":"154'265523","ondisk_log_start":"154'265523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3526640320,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":269831,"num_read_kb":1050711,"num_write":264980,"num_write_kb":1059610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"158'273896","reported_seq":543252,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:19:41.429910+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:19:41.429910+0000","last_peered":"2023-10-14T01:19:41.429910+0000","last_clean":"2023-10-14T01:19:41.429910+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:19:41.429910+0000","last_undegraded":"2023-10-14T01:19:41.429910+0000","last_fullsized":"2023-10-14T01:19:41.429910+0000","mapping_epoch":13,"log_start":"154'263820","ondisk_log_start":"154'263820","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1207,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 284s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3543454378,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":271106,"num_read_kb":1059156,"num_write":266842,"num_write_kb":1067117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"157'278468","reported_seq":555473,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-14T01:19:38.670889+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:19:38.670889+0000","last_peered":"2023-10-14T01:19:38.670889+0000","last_clean":"2023-10-14T01:19:38.670889+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:19:38.670889+0000","last_undegraded":"2023-10-14T01:19:38.670889+0000","last_fullsized":"2023-10-14T01:19:38.670889+0000","mapping_epoch":13,"log_start":"154'268423","ondisk_log_start":"154'268423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3614073353,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":279153,"num_read_kb":1078526,"num_write":272295,"num_write_kb":1088701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"158'280298","reported_seq":555692,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:19:40.547906+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:19:40.547906+0000","last_peered":"2023-10-14T01:19:40.547906+0000","last_clean":"2023-10-14T01:19:40.547906+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:19:40.547906+0000","last_undegraded":"2023-10-14T01:19:40.547906+0000","last_fullsized":"2023-10-14T01:19:40.547906+0000","mapping_epoch":13,"log_start":"154'270212","ondisk_log_start":"154'270212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3656859966,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":276969,"num_read_kb":1085222,"num_write":274975,"num_write_kb":1099739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"158'281871","reported_seq":559432,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:19:40.526447+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:19:40.526447+0000","last_peered":"2023-10-14T01:19:40.526447+0000","last_clean":"2023-10-14T01:19:40.526447+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:19:40.526447+0000","last_undegraded":"2023-10-14T01:19:40.526447+0000","last_fullsized":"2023-10-14T01:19:40.526447+0000","mapping_epoch":13,"log_start":"154'271816","ondisk_log_start":"154'271816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3689685543,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":278935,"num_read_kb":1094352,"num_write":276501,"num_write_kb":1105867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"158'319388","reported_seq":618391,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:19:41.311168+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:19:41.311168+0000","last_peered":"2023-10-14T01:19:41.311168+0000","last_clean":"2023-10-14T01:19:41.311168+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:19:41.311168+0000","last_undegraded":"2023-10-14T01:19:41.311168+0000","last_fullsized":"2023-10-14T01:19:41.311168+0000","mapping_epoch":13,"log_start":"154'309316","ondisk_log_start":"154'309316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":750,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 330s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3848901097,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":301867,"num_read_kb":1156662,"num_write":291237,"num_write_kb":1164293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":336,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-10-14T01:19:25.165748+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:19:25.165748+0000","last_peered":"2023-10-14T01:19:25.165748+0000","last_clean":"2023-10-14T01:19:25.165748+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:19:25.165748+0000","last_undegraded":"2023-10-14T01:19:25.165748+0000","last_fullsized":"2023-10-14T01:19:25.165748+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29185847219,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2242248,"num_read_kb":8705569,"num_write":2194130,"num_write_kb":8773709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17967005696,"data_stored":30539497318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80433,"ondisk_log_size":80433,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739321,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5189072,"kb_used_data":3370824,"kb_used_omap":668,"kb_used_meta":1817571,"kb_avail":89182768,"statfs":{"total":96636764160,"available":91323154432,"internally_reserved":0,"allocated":3451723776,"data_stored":5841645057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1861192998},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,0,0,3,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.82599999999999996,"15min":0.96699999999999997},"min":{"1min":0.26100000000000001,"5min":0.188,"15min":0.18099999999999999},"max":{"1min":3.859,"5min":6.6340000000000003,"15min":8.5800000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.873,"15min":1.0189999999999999},"min":{"1min":0.32400000000000001,"5min":0.245,"15min":0.215},"max":{"1min":3.8959999999999999,"5min":6.6859999999999999,"15min":8.6140000000000008},"last":0.45200000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.75,"15min":0.69399999999999995},"min":{"1min":0.223,"5min":0.20899999999999999,"15min":0.193},"max":{"1min":4.2789999999999999,"5min":6.593,"15min":6.593},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.82299999999999995,"15min":0.997},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":8.3699999999999992,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.48799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739306,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10762200,"kb_used_data":8775696,"kb_used_omap":1633,"kb_used_meta":1984862,"kb_avail":83609640,"statfs":{"total":96636764160,"available":85616271360,"internally_reserved":0,"allocated":8986312704,"data_stored":15272258078,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1672900,"internal_metadata":2032499004},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,5,6,13,2,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.752,"15min":0.91600000000000004},"min":{"1min":0.253,"5min":0.193,"15min":0.154},"max":{"1min":2.9279999999999999,"5min":9.8879999999999999,"15min":12.933},"last":0.373},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59199999999999997,"15min":1.1100000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.185},"max":{"1min":2.9039999999999999,"5min":10.029999999999999,"15min":17.196999999999999},"last":0.434}]},{"osd":2,"last update":"Sat Oct 14 01:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.6830000000000001,"15min":1.4610000000000001},"min":{"1min":0.21099999999999999,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":5.7160000000000002,"5min":10.07,"15min":10.07},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.60099999999999998,"15min":0.63700000000000001},"min":{"1min":0.22900000000000001,"5min":0.222,"15min":0.186},"max":{"1min":0.84899999999999998,"5min":5.0629999999999997,"15min":8.1430000000000007},"last":0.27500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739320,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7156080,"kb_used_data":5402472,"kb_used_omap":934,"kb_used_meta":1752665,"kb_avail":87215760,"statfs":{"total":96636764160,"available":89308938240,"internally_reserved":0,"allocated":5532131328,"data_stored":9427330360,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":1794729774},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,7,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52800000000000002,"15min":1.056},"min":{"1min":0.25,"5min":0.21299999999999999,"15min":0.17899999999999999},"max":{"1min":3.2919999999999998,"5min":3.4089999999999998,"15min":25.927},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.0840000000000001,"15min":1.363},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":3.4649999999999999,"5min":6.6340000000000003,"15min":26.632999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Sat Oct 14 01:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58399999999999996,"15min":0.77300000000000002},"min":{"1min":0.222,"5min":0.221,"15min":0.214},"max":{"1min":3.5150000000000001,"5min":3.9359999999999999,"15min":8.5559999999999992},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.01,"15min":0.91000000000000003},"min":{"1min":0.26500000000000001,"5min":0.216,"15min":0.214},"max":{"1min":5.5010000000000003,"5min":8.7360000000000007,"15min":8.7379999999999995},"last":0.29199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5531279360,"data_stored":9426774629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8985133056,"data_stored":15271378867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3450593280,"data_stored":5841343822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:19:42.794 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:19:42.795 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:19:42.795 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:19:42.796 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:19:42.796 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:19:42.796 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:19:43.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:43.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:43.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:43.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:43.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:43.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:43.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:43.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:43.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:43.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:43.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:43.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:43.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:43.767+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:43.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:43.783+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:43.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:43.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:43.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:43.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:45.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:19:45.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:45.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:45.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:45.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:45.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:45.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:45.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:45.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:45.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:45.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.663+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:45.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:45.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:45.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:46.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:46.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:46.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:46.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:46.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:46.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:46.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:46.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:46.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:46.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:46.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:46.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:46.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:46.975+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:46.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:46.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:46.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:46.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:47.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:47.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:47.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:47.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:47.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:47.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:47.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:47.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:47.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:47.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:47.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:47.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:47.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:47.175+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:47.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:47.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:47.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:47.211+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:47.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:47.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:47.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:47.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:49.527 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:19:49.523+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:19:50.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:50.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:50.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:50.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:50.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:50.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:50.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:50.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:50.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:50.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:50.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:50.731+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:50.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:50.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:50.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:50.751+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:50.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:50.751+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:50.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:50.751+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:51.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:51.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:51.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:51.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:51.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:51.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:51.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:51.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:51.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:51.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.343+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:51.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.343+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:51.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.343+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:51.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:51.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:51.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:51.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:51.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:51.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:51.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:51.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.695+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:51.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:51.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:51.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:53.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:53.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:19:53.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:53.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:19:53.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:53.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:53.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:53.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:53.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:53.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:53.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:53.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:54.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:54.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:19:54.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:54.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:19:54.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:54.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:19:54.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:54.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:19:54.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:54.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:19:54.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:54.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:19:54.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:54.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:19:54.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:54.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:19:54.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:54.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:19:54.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:54.659+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:19:54.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:54.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:19:54.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:19:54.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:19:55.937 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:19:55.935+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:20:01.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:01.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:01.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:01.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:01.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:01.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:01.744 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:20:01.743+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:20:01.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:01.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:01.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:01.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:01.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:01.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:01.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:01.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:02.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:02.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:02.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:02.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:02.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:02.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:02.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:02.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:02.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:02.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:02.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:02.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:02.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:02.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:02.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:02.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:02.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:02.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:02.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:02.735+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:02.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:02.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:02.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:02.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:02.798 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:20:03.890 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:20:03.891 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:20:03.970 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2555,"stamp":"2023-10-14T01:20:03.572219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29217665491,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2250227,"num_read_kb":8737072,"num_write":2202181,"num_write_kb":8807259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80494,"ondisk_log_size":80494,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22814636,"kb_used_data":17611348,"kb_used_omap":3330,"kb_used_meta":5199933,"kb_avail":260300884,"statfs":{"total":289910292480,"available":266548105216,"internally_reserved":0,"allocated":18034020352,"data_stored":30605077639,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3410841,"internal_metadata":5324731495},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,8,4,8,11,16,11],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20443136,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5101,"num_read_kb":20340,"num_write":5172,"num_write_kb":20688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002094"},"pg_stats":[{"pgid":"2.7","version":"158'282882","reported_seq":554575,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:20:02.058269+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:20:02.058269+0000","last_peered":"2023-10-14T01:20:02.058269+0000","last_clean":"2023-10-14T01:20:02.058269+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:20:02.058269+0000","last_undegraded":"2023-10-14T01:20:02.058269+0000","last_fullsized":"2023-10-14T01:20:02.058269+0000","mapping_epoch":13,"log_start":"154'272817","ondisk_log_start":"154'272817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1356,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 355s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3554415128,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":273771,"num_read_kb":1062320,"num_write":266950,"num_write_kb":1067453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'297268","reported_seq":586146,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:02.046291+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:20:02.046291+0000","last_peered":"2023-10-14T01:20:02.046291+0000","last_clean":"2023-10-14T01:20:02.046291+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:20:02.046291+0000","last_undegraded":"2023-10-14T01:20:02.046291+0000","last_fullsized":"2023-10-14T01:20:02.046291+0000","mapping_epoch":13,"log_start":"154'287216","ondisk_log_start":"154'287216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3759833306,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":292623,"num_read_kb":1126612,"num_write":282358,"num_write_kb":1128961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'276519","reported_seq":545239,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:01.999286+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:20:01.999286+0000","last_peered":"2023-10-14T01:20:01.999286+0000","last_clean":"2023-10-14T01:20:01.999286+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:20:01.999286+0000","last_undegraded":"2023-10-14T01:20:01.999286+0000","last_fullsized":"2023-10-14T01:20:01.999286+0000","mapping_epoch":13,"log_start":"154'266423","ondisk_log_start":"154'266423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3530289856,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":270817,"num_read_kb":1054647,"num_write":265925,"num_write_kb":1063390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"158'274935","reported_seq":545248,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:20:02.008850+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:20:02.008850+0000","last_peered":"2023-10-14T01:20:02.008850+0000","last_clean":"2023-10-14T01:20:02.008850+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:20:02.008850+0000","last_undegraded":"2023-10-14T01:20:02.008850+0000","last_fullsized":"2023-10-14T01:20:02.008850+0000","mapping_epoch":13,"log_start":"154'264920","ondisk_log_start":"154'264920","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1269,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 305s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3547263658,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":272042,"num_read_kb":1062892,"num_write":267823,"num_write_kb":1071041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"158'279464","reported_seq":557471,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:19:58.905389+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:19:58.905389+0000","last_peered":"2023-10-14T01:19:58.905389+0000","last_clean":"2023-10-14T01:19:58.905389+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:19:58.905389+0000","last_undegraded":"2023-10-14T01:19:58.905389+0000","last_fullsized":"2023-10-14T01:19:58.905389+0000","mapping_epoch":13,"log_start":"154'269423","ondisk_log_start":"154'269423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3618034185,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":280139,"num_read_kb":1082466,"num_write":273288,"num_write_kb":1092673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"158'281267","reported_seq":557674,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:00.729342+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:20:00.729342+0000","last_peered":"2023-10-14T01:20:00.729342+0000","last_clean":"2023-10-14T01:20:00.729342+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:20:00.729342+0000","last_undegraded":"2023-10-14T01:20:00.729342+0000","last_fullsized":"2023-10-14T01:20:00.729342+0000","mapping_epoch":13,"log_start":"154'271212","ondisk_log_start":"154'271212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3660673342,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":277980,"num_read_kb":1089262,"num_write":275937,"num_write_kb":1103587,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"158'282864","reported_seq":561392,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:00.678290+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:20:00.678290+0000","last_peered":"2023-10-14T01:20:00.678290+0000","last_clean":"2023-10-14T01:20:00.678290+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:20:00.678290+0000","last_undegraded":"2023-10-14T01:20:00.678290+0000","last_fullsized":"2023-10-14T01:20:00.678290+0000","mapping_epoch":13,"log_start":"154'272816","ondisk_log_start":"154'272816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3693621799,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":279900,"num_read_kb":1098200,"num_write":277487,"num_write_kb":1109811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"158'320539","reported_seq":620558,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:20:01.983379+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:20:01.983379+0000","last_peered":"2023-10-14T01:20:01.983379+0000","last_clean":"2023-10-14T01:20:01.983379+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:20:01.983379+0000","last_undegraded":"2023-10-14T01:20:01.983379+0000","last_fullsized":"2023-10-14T01:20:01.983379+0000","mapping_epoch":13,"log_start":"155'310516","ondisk_log_start":"155'310516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":820,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 351s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3852943849,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":302849,"num_read_kb":1160582,"num_write":292276,"num_write_kb":1168449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":337,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:19:40.180775+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:19:40.180775+0000","last_peered":"2023-10-14T01:19:40.180775+0000","last_clean":"2023-10-14T01:19:40.180775+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:19:40.180775+0000","last_undegraded":"2023-10-14T01:19:40.180775+0000","last_fullsized":"2023-10-14T01:19:40.180775+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29217075123,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2250121,"num_read_kb":8736981,"num_write":2202044,"num_write_kb":8805365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18031939584,"data_stored":30604431206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80395,"ondisk_log_size":80395,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739325,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5232852,"kb_used_data":3382668,"kb_used_omap":668,"kb_used_meta":1849507,"kb_avail":89138988,"statfs":{"total":96636764160,"available":91278323712,"internally_reserved":0,"allocated":3463852032,"data_stored":5853769113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1893895462},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,3,3,6,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.92100000000000004,"15min":0.94499999999999995},"min":{"1min":0.19900000000000001,"5min":0.188,"15min":0.18099999999999999},"max":{"1min":4.3310000000000004,"5min":6.6340000000000003,"15min":8.5800000000000001},"last":1.827},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.96799999999999997,"15min":0.997},"min":{"1min":0.252,"5min":0.245,"15min":0.215},"max":{"1min":4.4009999999999998,"5min":6.6859999999999999,"15min":8.6140000000000008},"last":1.8620000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.65500000000000003,"15min":0.629},"min":{"1min":0.22700000000000001,"5min":0.20899999999999999,"15min":0.193},"max":{"1min":2.6909999999999998,"5min":6.593,"15min":6.593},"last":6.7889999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.79100000000000004,"15min":0.92800000000000005},"min":{"1min":0.27700000000000002,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":1.4419999999999999,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.34200000000000003}]}]},{"osd":1,"up_from":8,"seq":34359739310,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10329592,"kb_used_data":8806704,"kb_used_omap":1727,"kb_used_meta":1521152,"kb_avail":84042248,"statfs":{"total":96636764160,"available":86059261952,"internally_reserved":0,"allocated":9018064896,"data_stored":15304010270,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1769453,"internal_metadata":1557659667},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,8,1,4,5,4,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.752,"15min":0.91600000000000004},"min":{"1min":0.253,"5min":0.193,"15min":0.154},"max":{"1min":2.9279999999999999,"5min":9.8879999999999999,"15min":12.933},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59199999999999997,"15min":1.1100000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.185},"max":{"1min":2.9039999999999999,"5min":10.029999999999999,"15min":17.196999999999999},"last":0.22}]},{"osd":2,"last update":"Sat Oct 14 01:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.6830000000000001,"15min":1.4610000000000001},"min":{"1min":0.21099999999999999,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":5.7160000000000002,"5min":10.07,"15min":10.07},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.60099999999999998,"15min":0.63700000000000001},"min":{"1min":0.22900000000000001,"5min":0.222,"15min":0.186},"max":{"1min":0.84899999999999998,"5min":5.0629999999999997,"15min":8.1430000000000007},"last":0.313}]}]},{"osd":0,"up_from":8,"seq":34359739324,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7252192,"kb_used_data":5421976,"kb_used_omap":934,"kb_used_meta":1829273,"kb_avail":87119648,"statfs":{"total":96636764160,"available":89210519552,"internally_reserved":0,"allocated":5552103424,"data_stored":9447298256,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":1873176366},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,3,6,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52800000000000002,"15min":1.056},"min":{"1min":0.25,"5min":0.21299999999999999,"15min":0.17899999999999999},"max":{"1min":3.2919999999999998,"5min":3.4089999999999998,"15min":25.927},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.0840000000000001,"15min":1.363},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":3.4649999999999999,"5min":6.6340000000000003,"15min":26.632999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Sat Oct 14 01:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58399999999999996,"15min":0.77300000000000002},"min":{"1min":0.222,"5min":0.221,"15min":0.214},"max":{"1min":3.5150000000000001,"5min":3.9359999999999999,"15min":8.5559999999999992},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.01,"15min":0.91000000000000003},"min":{"1min":0.26500000000000001,"5min":0.216,"15min":0.214},"max":{"1min":5.5010000000000003,"5min":8.7360000000000007,"15min":8.7379999999999995},"last":0.26000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5551366144,"data_stored":9446861413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9017790464,"data_stored":15304036275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3462782976,"data_stored":5853533518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:20:03.971 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:03.972 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:03.972 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:03.972 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:03.973 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:03.973 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:20:04.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:04.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:04.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:04.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:20:04.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:04.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:04.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:04.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:04.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:04.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:04.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:04.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:04.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:04.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:04.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:04.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:04.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:04.247+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:04.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:04.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:04.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:04.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:05.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:05.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:05.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:05.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:05.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:05.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:05.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:05.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:05.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:05.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:05.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:05.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:05.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:05.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:05.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:05.287+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:05.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:05.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:05.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:05.315+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:05.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:05.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:05.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:05.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:08.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:08.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:08.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:08.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:08.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:08.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:08.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:08.795+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:08.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:08.799+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:10.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:10.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:20:10.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:10.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:10.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:10.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:10.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:10.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:10.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:10.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:10.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.951+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:10.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.967+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:10.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:10.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:10.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:13.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:13.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:13.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:13.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:13.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:13.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:13.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:13.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:13.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:13.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:13.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:13.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:13.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:13.471+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:14.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:14.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:14.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:14.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:14.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:14.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:14.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:14.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:14.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:14.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:14.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:14.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:14.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:14.831+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:14.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:14.831+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:14.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:14.835+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:14.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:14.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:14.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:14.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:17.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:17.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:17.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:17.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:17.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:17.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:17.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:17.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:17.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:17.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:17.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:17.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:17.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:17.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:17.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:17.139+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:17.468 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:20:17.467+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:20:18.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:18.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:18.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:18.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:18.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:18.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:18.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:18.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.683+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:18.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.683+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:18.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.683+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:18.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:20:18.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:18.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:18.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:18.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:18.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:18.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:18.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:18.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:18.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:18.991+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:19.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.011+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:19.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:19.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.011+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:19.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:19.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:19.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:19.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:19.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:19.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:19.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:19.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:19.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.735+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:19.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:19.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:19.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:20.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:20.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:20.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:20.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:20.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:20.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:20.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:20.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:20.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:20.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.451+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:20.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:20:20.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:20.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:20.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:20.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:20.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:20.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:20.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:20.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.843+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:20.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.843+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:20.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:20.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.879+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:20.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:20.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:20.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:23.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:23.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:23.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:23.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:23.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:23.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:23.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:23.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:23.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:23.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:23.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:23.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:23.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:23.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:23.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:23.779+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:23.975 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:20:24.879 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:20:24.880 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:20:24.951 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2565,"stamp":"2023-10-14T01:20:23.580801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29248946643,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2258081,"num_read_kb":8768388,"num_write":2210173,"num_write_kb":8839227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80440,"ondisk_log_size":80440,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23142352,"kb_used_data":17675576,"kb_used_omap":3330,"kb_used_meta":5463421,"kb_avail":259973168,"statfs":{"total":289910292480,"available":266212524032,"internally_reserved":0,"allocated":18099789824,"data_stored":30670847111,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3410841,"internal_metadata":5594543207},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,5,4,4,14,5,7,11],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20803584,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5217,"num_read_kb":20792,"num_write":5309,"num_write_kb":21236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007127"},"pg_stats":[{"pgid":"2.7","version":"158'283991","reported_seq":556670,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:20:22.649612+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:20:22.649612+0000","last_peered":"2023-10-14T01:20:22.649612+0000","last_clean":"2023-10-14T01:20:22.649612+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:20:22.649612+0000","last_undegraded":"2023-10-14T01:20:22.649612+0000","last_fullsized":"2023-10-14T01:20:22.649612+0000","mapping_epoch":13,"log_start":"155'273917","ondisk_log_start":"155'273917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1424,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 376s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3558470168,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":274738,"num_read_kb":1066188,"num_write":267968,"num_write_kb":1071525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'298321","reported_seq":588206,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:22.622621+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:20:22.622621+0000","last_peered":"2023-10-14T01:20:22.622621+0000","last_clean":"2023-10-14T01:20:22.622621+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:20:22.622621+0000","last_undegraded":"2023-10-14T01:20:22.622621+0000","last_fullsized":"2023-10-14T01:20:22.622621+0000","mapping_epoch":13,"log_start":"155'288316","ondisk_log_start":"155'288316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3763781850,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":293616,"num_read_kb":1130568,"num_write":283372,"num_write_kb":1133017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'277536","reported_seq":547222,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:22.590089+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:20:22.590089+0000","last_peered":"2023-10-14T01:20:22.590089+0000","last_clean":"2023-10-14T01:20:22.590089+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:20:22.590089+0000","last_undegraded":"2023-10-14T01:20:22.590089+0000","last_fullsized":"2023-10-14T01:20:22.590089+0000","mapping_epoch":13,"log_start":"154'267523","ondisk_log_start":"154'267523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3534160576,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":271777,"num_read_kb":1058463,"num_write":266916,"num_write_kb":1067354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"158'275979","reported_seq":547264,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:20:22.581453+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:20:22.581453+0000","last_peered":"2023-10-14T01:20:22.581453+0000","last_clean":"2023-10-14T01:20:22.581453+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:20:22.581453+0000","last_undegraded":"2023-10-14T01:20:22.581453+0000","last_fullsized":"2023-10-14T01:20:22.581453+0000","mapping_epoch":13,"log_start":"155'265920","ondisk_log_start":"155'265920","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1342,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 325s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3551064746,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":273001,"num_read_kb":1066712,"num_write":268800,"num_write_kb":1074949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"158'280393","reported_seq":559331,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:19.059551+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:20:19.059551+0000","last_peered":"2023-10-14T01:20:19.059551+0000","last_clean":"2023-10-14T01:20:19.059551+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:20:19.059551+0000","last_undegraded":"2023-10-14T01:20:19.059551+0000","last_fullsized":"2023-10-14T01:20:19.059551+0000","mapping_epoch":13,"log_start":"154'270323","ondisk_log_start":"154'270323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3621638665,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":281060,"num_read_kb":1086146,"num_write":274208,"num_write_kb":1096353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"158'282302","reported_seq":559660,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:20.820190+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:20:20.820190+0000","last_peered":"2023-10-14T01:20:20.820190+0000","last_clean":"2023-10-14T01:20:20.820190+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:20:20.820190+0000","last_undegraded":"2023-10-14T01:20:20.820190+0000","last_fullsized":"2023-10-14T01:20:20.820190+0000","mapping_epoch":13,"log_start":"154'272212","ondisk_log_start":"154'272212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10090,"log_dups_size":0,"ondisk_log_size":10090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3664761150,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":278925,"num_read_kb":1093026,"num_write":276964,"num_write_kb":1107695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"158'283845","reported_seq":563387,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:20.809552+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:20:20.809552+0000","last_peered":"2023-10-14T01:20:20.809552+0000","last_clean":"2023-10-14T01:20:20.809552+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:20:20.809552+0000","last_undegraded":"2023-10-14T01:20:20.809552+0000","last_fullsized":"2023-10-14T01:20:20.809552+0000","mapping_epoch":13,"log_start":"154'273816","ondisk_log_start":"154'273816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3697447463,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":280907,"num_read_kb":1102220,"num_write":278460,"num_write_kb":1113703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"158'321717","reported_seq":622858,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:20:22.517232+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:20:22.517232+0000","last_peered":"2023-10-14T01:20:22.517232+0000","last_clean":"2023-10-14T01:20:22.517232+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:20:22.517232+0000","last_undegraded":"2023-10-14T01:20:22.517232+0000","last_fullsized":"2023-10-14T01:20:22.517232+0000","mapping_epoch":13,"log_start":"155'311716","ondisk_log_start":"155'311716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":855,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 371s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3857031657,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":303951,"num_read_kb":1164974,"num_write":293348,"num_write_kb":1172737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":337,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:19:40.180775+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:19:40.180775+0000","last_peered":"2023-10-14T01:19:40.180775+0000","last_clean":"2023-10-14T01:19:40.180775+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:19:40.180775+0000","last_undegraded":"2023-10-14T01:19:40.180775+0000","last_fullsized":"2023-10-14T01:19:40.180775+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29248356275,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2257975,"num_read_kb":8768297,"num_write":2210036,"num_write_kb":8837333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18097119232,"data_stored":30669610854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80341,"ondisk_log_size":80341,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739329,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5277852,"kb_used_data":3394644,"kb_used_omap":668,"kb_used_meta":1882531,"kb_avail":89093988,"statfs":{"total":96636764160,"available":91232243712,"internally_reserved":0,"allocated":3476115456,"data_stored":5866032537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1927712038},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.92100000000000004,"15min":0.94499999999999995},"min":{"1min":0.19900000000000001,"5min":0.188,"15min":0.18099999999999999},"max":{"1min":4.3310000000000004,"5min":6.6340000000000003,"15min":8.5800000000000001},"last":0.17399999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.96799999999999997,"15min":0.997},"min":{"1min":0.252,"5min":0.245,"15min":0.215},"max":{"1min":4.4009999999999998,"5min":6.6859999999999999,"15min":8.6140000000000008},"last":0.23699999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.65500000000000003,"15min":0.629},"min":{"1min":0.22700000000000001,"5min":0.20899999999999999,"15min":0.193},"max":{"1min":2.6909999999999998,"5min":6.593,"15min":6.593},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.79100000000000004,"15min":0.92800000000000005},"min":{"1min":0.27700000000000002,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":1.4419999999999999,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.89300000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739314,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10515548,"kb_used_data":8839956,"kb_used_omap":1727,"kb_used_meta":1673856,"kb_avail":83856292,"statfs":{"total":96636764160,"available":85868843008,"internally_reserved":0,"allocated":9052114944,"data_stored":15338060318,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1769453,"internal_metadata":1714028563},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,5,2,2,7,3,4,11],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:19:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.752,"15min":0.91600000000000004},"min":{"1min":0.253,"5min":0.193,"15min":0.154},"max":{"1min":2.9279999999999999,"5min":9.8879999999999999,"15min":12.933},"last":4.7709999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.59199999999999997,"15min":1.1100000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.185},"max":{"1min":2.9039999999999999,"5min":10.029999999999999,"15min":17.196999999999999},"last":0.38200000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:19:35 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.6830000000000001,"15min":1.4610000000000001},"min":{"1min":0.21099999999999999,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":5.7160000000000002,"5min":10.07,"15min":10.07},"last":12.391},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.60099999999999998,"15min":0.63700000000000001},"min":{"1min":0.22900000000000001,"5min":0.222,"15min":0.186},"max":{"1min":0.84899999999999998,"5min":5.0629999999999997,"15min":8.1430000000000007},"last":4.734}]}]},{"osd":0,"up_from":8,"seq":34359739329,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7348952,"kb_used_data":5440976,"kb_used_omap":934,"kb_used_meta":1907033,"kb_avail":87022888,"statfs":{"total":96636764160,"available":89111437312,"internally_reserved":0,"allocated":5571559424,"data_stored":9466754256,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":1952802606},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1,6,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.52800000000000002,"15min":1.056},"min":{"1min":0.25,"5min":0.21299999999999999,"15min":0.17899999999999999},"max":{"1min":3.2919999999999998,"5min":3.4089999999999998,"15min":25.927},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.0840000000000001,"15min":1.363},"min":{"1min":0.22800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":3.4649999999999999,"5min":6.6340000000000003,"15min":26.632999999999999},"last":0.52700000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:19:38 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58399999999999996,"15min":0.77300000000000002},"min":{"1min":0.222,"5min":0.221,"15min":0.214},"max":{"1min":3.5150000000000001,"5min":3.9359999999999999,"15min":8.5559999999999992},"last":2.0680000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":1.01,"15min":0.91000000000000003},"min":{"1min":0.26500000000000001,"5min":0.216,"15min":0.214},"max":{"1min":5.5010000000000003,"5min":8.7360000000000007,"15min":8.7379999999999995},"last":0.27900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5571047424,"data_stored":9466542693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9050890240,"data_stored":15337136051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3475181568,"data_stored":5865932110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:20:24.952 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:24.953 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:24.953 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:24.953 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:24.954 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:24.954 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:20:25.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:25.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:25.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:25.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:25.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:25.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:25.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:25.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:25.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:25.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:25.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:25.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:25.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:25.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:25.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:25.079+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:25.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:25.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:25.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:25.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:26.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:25.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:26.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:25.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:26.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:26.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:26.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:26.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:26.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:26.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:26.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:26.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:26.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:26.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:26.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:26.095+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:26.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:26.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:26.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:26.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:27.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:27.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:27.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:27.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:27.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:27.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:27.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:27.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:27.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:27.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:27.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:27.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:27.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:27.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:27.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:27.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:27.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:27.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:27.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:27.271+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:27.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:27.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:27.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:27.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:28.909 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:20:28.903+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:20:29.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:29.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:29.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:29.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:29.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:29.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:29.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:29.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:29.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:29.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:29.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:29.431+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:29.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:29.455+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:29.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:29.455+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:30.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:30.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:30.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:30.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:30.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:30.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:30.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:30.371+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:30.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:30.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:30.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:30.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:30.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:30.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:30.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:30.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:30.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:30.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:30.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:30.447+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:30.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:30.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:30.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:30.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:31.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:31.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:31.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:31.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:31.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:31.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:31.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:31.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:31.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:31.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:31.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:31.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:31.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:31.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:31.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:31.263+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:31.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:31.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:31.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:31.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:32.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:32.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:32.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:32.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:32.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:32.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:32.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:32.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:32.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:32.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:32.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:32.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:32.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:32.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:32.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:32.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:32.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:32.379+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:32.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:32.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:32.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:32.427+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:33.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:33.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:33.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:33.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:33.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:33.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:33.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:33.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:33.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:33.647+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:33.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:33.647+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:33.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:33.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:33.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:33.671+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:33.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:33.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:33.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:33.683+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:35.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:35.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:35.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:35.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:35.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:35.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:35.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:35.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:35.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:35.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:35.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:35.567+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:35.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:35.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:35.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:35.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:35.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:35.595+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:35.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:35.619+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:35.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:35.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:35.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:35.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:36.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:36.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:36.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:36.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.203+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:36.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:36.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.231+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:36.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:36.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:36.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:20:36.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:36.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:36.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:36.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:36.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:36.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:36.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:36.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:36.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:36.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.835+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:36.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:36.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:36.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:37.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:37.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:37.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:37.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:37.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:37.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:37.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.171+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:37.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:20:37.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:37.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:37.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:37.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:37.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:37.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:37.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.211+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:37.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:37.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:38.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:20:38.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:38.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:20:38.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:38.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:38.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:38.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:38.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:38.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:38.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:38.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:38.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:38.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.327+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:38.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:38.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:38.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:39.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:39.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:39.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:39.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:39.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:39.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:39.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:39.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:39.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:39.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:39.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:39.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:39.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:39.435+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:39.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:39.435+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:39.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:39.435+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:39.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:39.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:39.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:39.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:40.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:40.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:20:40.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:40.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:40.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:40.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:40.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:40.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:40.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:40.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:40.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:40.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.206+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:40.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:40.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:40.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:40.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:40.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:40.742+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:42.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:42.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:42.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:42.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:43.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:43.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:43.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:43.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:43.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:43.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:43.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:43.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:43.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:43.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:43.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:43.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:43.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:43.034+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:43.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:43.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:43.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:43.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:44.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:44.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:44.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:44.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:44.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:44.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:44.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:44.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:44.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:44.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:44.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:44.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:44.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:44.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:44.140 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:44.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:44.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:44.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:44.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:44.138+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:44.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:44.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:44.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:44.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:44.955 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:20:45.853 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:20:45.854 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:20:45.898 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2576,"stamp":"2023-10-14T01:20:45.587312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29281186259,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2266228,"num_read_kb":8800872,"num_write":2218349,"num_write_kb":8871931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80673,"ondisk_log_size":80673,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23551952,"kb_used_data":17743608,"kb_used_omap":3330,"kb_used_meta":5804989,"kb_avail":259563568,"statfs":{"total":289910292480,"available":265793093632,"internally_reserved":0,"allocated":18169454592,"data_stored":30740511879,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3410841,"internal_metadata":5944308839},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1,3,5,18,13,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16265216,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4140,"num_read_kb":16492,"num_write":4138,"num_write_kb":16552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002123"},"pg_stats":[{"pgid":"2.7","version":"158'284993","reported_seq":558686,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:20:43.180267+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:20:43.180267+0000","last_peered":"2023-10-14T01:20:43.180267+0000","last_clean":"2023-10-14T01:20:43.180267+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:20:43.180267+0000","last_undegraded":"2023-10-14T01:20:43.180267+0000","last_fullsized":"2023-10-14T01:20:43.180267+0000","mapping_epoch":13,"log_start":"155'274917","ondisk_log_start":"155'274917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1507,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 396s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3561972248,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":275731,"num_read_kb":1070144,"num_write":268848,"num_write_kb":1075045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"158'299401","reported_seq":590308,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:43.185814+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:20:43.185814+0000","last_peered":"2023-10-14T01:20:43.185814+0000","last_clean":"2023-10-14T01:20:43.185814+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:20:43.185814+0000","last_undegraded":"2023-10-14T01:20:43.185814+0000","last_fullsized":"2023-10-14T01:20:43.185814+0000","mapping_epoch":13,"log_start":"155'289316","ondisk_log_start":"155'289316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3767804122,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":294627,"num_read_kb":1134592,"num_write":284395,"num_write_kb":1137109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"158'278616","reported_seq":549271,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:43.184091+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:20:43.184091+0000","last_peered":"2023-10-14T01:20:43.184091+0000","last_clean":"2023-10-14T01:20:43.184091+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:20:43.184091+0000","last_undegraded":"2023-10-14T01:20:43.184091+0000","last_fullsized":"2023-10-14T01:20:43.184091+0000","mapping_epoch":13,"log_start":"155'268523","ondisk_log_start":"155'268523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3538367168,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":272739,"num_read_kb":1062291,"num_write":267958,"num_write_kb":1071522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"158'277093","reported_seq":549384,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:20:43.160577+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:20:43.160577+0000","last_peered":"2023-10-14T01:20:43.160577+0000","last_clean":"2023-10-14T01:20:43.160577+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:20:43.160577+0000","last_undegraded":"2023-10-14T01:20:43.160577+0000","last_fullsized":"2023-10-14T01:20:43.160577+0000","mapping_epoch":13,"log_start":"155'267020","ondisk_log_start":"155'267020","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1404,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 346s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3555103402,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":273995,"num_read_kb":1070672,"num_write":269847,"num_write_kb":1079137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"158'281588","reported_seq":561667,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:44.338344+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:20:44.338344+0000","last_peered":"2023-10-14T01:20:44.338344+0000","last_clean":"2023-10-14T01:20:44.338344+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:20:44.338344+0000","last_undegraded":"2023-10-14T01:20:44.338344+0000","last_fullsized":"2023-10-14T01:20:44.338344+0000","mapping_epoch":13,"log_start":"155'271523","ondisk_log_start":"155'271523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3626222089,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":282188,"num_read_kb":1090658,"num_write":275388,"num_write_kb":1101073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"158'283290","reported_seq":561632,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:40.990015+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:20:40.990015+0000","last_peered":"2023-10-14T01:20:40.990015+0000","last_clean":"2023-10-14T01:20:40.990015+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:20:40.990015+0000","last_undegraded":"2023-10-14T01:20:40.990015+0000","last_fullsized":"2023-10-14T01:20:40.990015+0000","mapping_epoch":13,"log_start":"155'273212","ondisk_log_start":"155'273212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3668697406,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":279906,"num_read_kb":1096942,"num_write":277944,"num_write_kb":1111615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"158'284802","reported_seq":565382,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:20:40.979499+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:20:40.979499+0000","last_peered":"2023-10-14T01:20:40.979499+0000","last_clean":"2023-10-14T01:20:40.979499+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:20:40.979499+0000","last_undegraded":"2023-10-14T01:20:40.979499+0000","last_fullsized":"2023-10-14T01:20:40.979499+0000","mapping_epoch":13,"log_start":"155'274716","ondisk_log_start":"155'274716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3701240359,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":281944,"num_read_kb":1106348,"num_write":279409,"num_write_kb":1117499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"158'322934","reported_seq":625147,"reported_epoch":158,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:20:43.166083+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:20:43.166083+0000","last_peered":"2023-10-14T01:20:43.166083+0000","last_clean":"2023-10-14T01:20:43.166083+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:20:43.166083+0000","last_undegraded":"2023-10-14T01:20:43.166083+0000","last_fullsized":"2023-10-14T01:20:43.166083+0000","mapping_epoch":13,"log_start":"155'312916","ondisk_log_start":"155'312916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":900,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 392s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3861189097,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":304992,"num_read_kb":1169134,"num_write":294423,"num_write_kb":1177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":337,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:19:40.180775+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:19:40.180775+0000","last_peered":"2023-10-14T01:19:40.180775+0000","last_clean":"2023-10-14T01:19:40.180775+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:19:40.180775+0000","last_undegraded":"2023-10-14T01:19:40.180775+0000","last_fullsized":"2023-10-14T01:19:40.180775+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29280595891,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2266122,"num_read_kb":8800781,"num_write":2218212,"num_write_kb":8870037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18166861824,"data_stored":30739353446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80574,"ondisk_log_size":80574,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739333,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5339836,"kb_used_data":3406644,"kb_used_omap":668,"kb_used_meta":1932515,"kb_avail":89032004,"statfs":{"total":96636764160,"available":91168772096,"internally_reserved":0,"allocated":3488403456,"data_stored":5878320537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1978895654},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.92100000000000004,"15min":0.94499999999999995},"min":{"1min":0.19900000000000001,"5min":0.188,"15min":0.18099999999999999},"max":{"1min":4.3310000000000004,"5min":6.6340000000000003,"15min":8.5800000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.96799999999999997,"15min":0.997},"min":{"1min":0.252,"5min":0.245,"15min":0.215},"max":{"1min":4.4009999999999998,"5min":6.6859999999999999,"15min":8.6140000000000008},"last":0.52900000000000003}]},{"osd":1,"last update":"Sat Oct 14 01:19:51 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.65500000000000003,"15min":0.629},"min":{"1min":0.22700000000000001,"5min":0.20899999999999999,"15min":0.193},"max":{"1min":2.6909999999999998,"5min":6.593,"15min":6.593},"last":0.245},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.79100000000000004,"15min":0.92800000000000005},"min":{"1min":0.27700000000000002,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":1.4419999999999999,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.56299999999999994}]}]},{"osd":1,"up_from":8,"seq":34359739318,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10676800,"kb_used_data":8871096,"kb_used_omap":1727,"kb_used_meta":1803968,"kb_avail":83695040,"statfs":{"total":96636764160,"available":85703720960,"internally_reserved":0,"allocated":9084002304,"data_stored":15369947678,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1769453,"internal_metadata":1847263251},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,1,2,12,8,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.81899999999999995,"15min":0.91900000000000004},"min":{"1min":0.183,"5min":0.183,"15min":0.154},"max":{"1min":4.7709999999999999,"5min":9.8879999999999999,"15min":12.933},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.59699999999999998,"15min":1.042},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":1.5700000000000001,"5min":10.029999999999999,"15min":17.196999999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:20:37 2023","interfaces":[{"interface":"back","average":{"1min":2.6320000000000001,"5min":2.0369999999999999,"15min":1.5580000000000001},"min":{"1min":0.23100000000000001,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":12.391,"5min":12.391,"15min":12.391},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.27000000000000002,"5min":0.222,"15min":0.186},"max":{"1min":4.734,"5min":5.0629999999999997,"15min":8.1430000000000007},"last":0.48499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739334,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7535316,"kb_used_data":5465868,"kb_used_omap":934,"kb_used_meta":2068505,"kb_avail":86836524,"statfs":{"total":96636764160,"available":88920600576,"internally_reserved":0,"allocated":5597048832,"data_stored":9492243664,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":956626,"internal_metadata":2118149934},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,2,4,5,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:20:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":0.68799999999999994,"15min":1.0620000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.17899999999999999},"max":{"1min":4.2489999999999997,"5min":4.2489999999999997,"15min":25.927},"last":5.9400000000000004},{"interface":"front","average":{"1min":0.89300000000000002,"5min":1.105,"15min":1.345},"min":{"1min":0.246,"5min":0.20999999999999999,"15min":0.188},"max":{"1min":4.1820000000000004,"5min":6.6340000000000003,"15min":26.632999999999999},"last":0.373}]},{"osd":2,"last update":"Sat Oct 14 01:20:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":0.77000000000000002,"15min":0.83199999999999996},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.5389999999999997,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":5.984},{"interface":"front","average":{"1min":1.196,"5min":1.1020000000000001,"15min":0.92500000000000004},"min":{"1min":0.26000000000000001,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":6.4980000000000002,"5min":8.7360000000000007,"15min":8.7379999999999995},"last":0.40899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5595852800,"data_stored":9491348069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9083580416,"data_stored":15369826227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3487428608,"data_stored":5878179150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:20:45.900 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:45.900 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:45.901 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:45.901 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:45.902 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:20:45.902 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:20:47.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:47.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:47.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:47.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:48.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:48.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:50.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:50.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:20:50.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:50.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:50.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:50.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:50.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:50.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:50.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.490+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:50.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:50.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.510+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:50.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.570+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:50.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:50.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:50.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:52.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:52.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:52.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:52.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:52.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:52.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:52.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:52.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:52.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.126+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:52.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:52.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:52.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:20:52.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:20:52.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:52.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:52.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:52.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:52.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:52.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:52.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:52.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.966+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:52.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.966+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:52.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.966+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:52.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.966+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:52.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:52.966+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:53.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:53.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:53.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:53.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:53.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:53.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:53.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:53.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:53.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:53.062+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:53.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:53.062+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:53.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:53.062+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:53.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:53.062+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:53.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:53.062+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:54.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:54.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:54.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:54.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:54.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:54.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:54.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:54.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:54.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:54.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:54.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:54.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:54.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:54.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:54.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.914+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:54.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.922+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:54.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:54.942+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:58.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:20:58.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:20:58.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:58.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:58.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:58.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:58.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:58.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:58.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.246+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:58.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.254+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:58.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:58.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:20:58.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:20:58.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:20:58.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:20:58.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:20:58.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:20:58.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:20:58.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:20:58.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:20:58.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:20:58.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:20:58.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:20:58.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.714+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:20:58.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:20:58.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:20:58.714+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:01.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:01.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:01.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:01.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:01.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:01.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:01.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:21:01.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:01.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:01.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:01.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:01.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:01.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:01.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:01.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:01.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:02.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:02.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:02.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:02.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:02.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:02.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:02.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:02.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:02.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:02.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:02.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.462+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:02.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:02.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:02.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:02.790 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:21:02.786+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:21:03.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:03.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:04.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:03.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:04.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:04.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:04.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:04.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:04.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:04.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.074+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:04.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:04.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:04.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:04.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:04.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:04.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:04.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:04.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:04.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:04.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:04.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.330+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:04.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:04.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.330+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:04.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:04.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:04.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:04.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:04.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:04.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:04.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:04.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:04.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:04.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.834+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:04.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:04.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:04.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:05.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:05.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:05.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:05.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:05.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:05.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:05.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:05.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:05.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:05.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:05.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:05.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:05.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:05.778+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:05.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:05.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:05.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:05.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:05.903 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:21:06.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:21:06.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:06.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:06.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:06.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:06.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:06.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:06.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:06.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:06.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.254+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:06.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.270+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:06.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:06.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:06.286+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:06.778 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:21:06.779 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:21:06.841 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2587,"stamp":"2023-10-14T01:21:05.600857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29311287763,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2273778,"num_read_kb":8830980,"num_write":2226058,"num_write_kb":8902767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80352,"ondisk_log_size":80352,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22989084,"kb_used_data":17806084,"kb_used_omap":3442,"kb_used_meta":5179533,"kb_avail":260126436,"statfs":{"total":289910292480,"available":266369470464,"internally_reserved":0,"allocated":18233430016,"data_stored":30804474574,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3525442,"internal_metadata":5303841982},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,6,11,6,15,13,27,12,3],"upper_bound":1024},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14786560,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3714,"num_read_kb":14792,"num_write":3793,"num_write_kb":15172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.419700"},"pg_stats":[{"pgid":"2.7","version":"159'286041","reported_seq":560690,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:21:03.757089+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:21:03.757089+0000","last_peered":"2023-10-14T01:21:03.757089+0000","last_clean":"2023-10-14T01:21:03.757089+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:21:03.757089+0000","last_undegraded":"2023-10-14T01:21:03.757089+0000","last_fullsized":"2023-10-14T01:21:03.757089+0000","mapping_epoch":13,"log_start":"155'276017","ondisk_log_start":"155'276017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1585,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 417s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3565736472,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":276666,"num_read_kb":1073872,"num_write":269797,"num_write_kb":1078841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"159'300477","reported_seq":592369,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:03.697411+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:21:03.697411+0000","last_peered":"2023-10-14T01:21:03.697411+0000","last_clean":"2023-10-14T01:21:03.697411+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:21:03.697411+0000","last_undegraded":"2023-10-14T01:21:03.697411+0000","last_fullsized":"2023-10-14T01:21:03.697411+0000","mapping_epoch":13,"log_start":"155'290416","ondisk_log_start":"155'290416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3771891930,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":295601,"num_read_kb":1138476,"num_write":285432,"num_write_kb":1141257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"159'279545","reported_seq":551082,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:03.687682+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:21:03.687682+0000","last_peered":"2023-10-14T01:21:03.687682+0000","last_clean":"2023-10-14T01:21:03.687682+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:21:03.687682+0000","last_undegraded":"2023-10-14T01:21:03.687682+0000","last_fullsized":"2023-10-14T01:21:03.687682+0000","mapping_epoch":13,"log_start":"155'269523","ondisk_log_start":"155'269523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3541844672,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":273614,"num_read_kb":1065783,"num_write":268861,"num_write_kb":1075134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"159'278138","reported_seq":551386,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:21:03.681809+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:21:03.681809+0000","last_peered":"2023-10-14T01:21:03.681809+0000","last_clean":"2023-10-14T01:21:03.681809+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:21:03.681809+0000","last_undegraded":"2023-10-14T01:21:03.681809+0000","last_fullsized":"2023-10-14T01:21:03.681809+0000","mapping_epoch":13,"log_start":"155'268120","ondisk_log_start":"155'268120","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1483,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 366s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3558892202,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":274939,"num_read_kb":1074424,"num_write":270822,"num_write_kb":1083037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"159'282548","reported_seq":563597,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:04.467092+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:21:04.467092+0000","last_peered":"2023-10-14T01:21:04.467092+0000","last_clean":"2023-10-14T01:21:04.467092+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:21:04.467092+0000","last_undegraded":"2023-10-14T01:21:04.467092+0000","last_fullsized":"2023-10-14T01:21:04.467092+0000","mapping_epoch":13,"log_start":"155'272523","ondisk_log_start":"155'272523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3629896201,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":283143,"num_read_kb":1094470,"num_write":276333,"num_write_kb":1104853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"159'284259","reported_seq":563537,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:01.092459+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:21:01.092459+0000","last_peered":"2023-10-14T01:21:01.092459+0000","last_clean":"2023-10-14T01:21:01.092459+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:21:01.092459+0000","last_undegraded":"2023-10-14T01:21:01.092459+0000","last_fullsized":"2023-10-14T01:21:01.092459+0000","mapping_epoch":13,"log_start":"155'274212","ondisk_log_start":"155'274212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3672494398,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":280834,"num_read_kb":1100646,"num_write":278909,"num_write_kb":1115475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"159'285721","reported_seq":567244,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:01.091396+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:21:01.091396+0000","last_peered":"2023-10-14T01:21:01.091396+0000","last_clean":"2023-10-14T01:21:01.091396+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:21:01.091396+0000","last_undegraded":"2023-10-14T01:21:01.091396+0000","last_fullsized":"2023-10-14T01:21:01.091396+0000","mapping_epoch":13,"log_start":"155'275716","ondisk_log_start":"155'275716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3704857127,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":282879,"num_read_kb":1110068,"num_write":280324,"num_write_kb":1121159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"159'324067","reported_seq":627316,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:21:03.678952+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:21:03.678952+0000","last_peered":"2023-10-14T01:21:03.678952+0000","last_clean":"2023-10-14T01:21:03.678952+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:21:03.678952+0000","last_undegraded":"2023-10-14T01:21:03.678952+0000","last_fullsized":"2023-10-14T01:21:03.678952+0000","mapping_epoch":13,"log_start":"155'314016","ondisk_log_start":"155'314016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":954,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 413s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3865084393,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":305996,"num_read_kb":1173150,"num_write":295443,"num_write_kb":1181117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":338,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:19:56.840894+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:19:56.840894+0000","last_peered":"2023-10-14T01:19:56.840894+0000","last_clean":"2023-10-14T01:19:56.840894+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:19:56.840894+0000","last_undegraded":"2023-10-14T01:19:56.840894+0000","last_fullsized":"2023-10-14T01:19:56.840894+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29310697395,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2273672,"num_read_kb":8830889,"num_write":2225921,"num_write_kb":8900873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18229669888,"data_stored":30802161510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80253,"ondisk_log_size":80253,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739337,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4666816,"kb_used_data":3418616,"kb_used_omap":668,"kb_used_meta":1247523,"kb_avail":89705024,"statfs":{"total":96636764160,"available":91857944576,"internally_reserved":0,"allocated":3500662784,"data_stored":5890575622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1277463846},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,5,0,3,5,1,4,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":4.3159999999999998,"5min":6.6340000000000003,"15min":6.6340000000000003},"last":0.318},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.95199999999999996,"15min":0.95699999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":4.3959999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Oct 14 01:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.67700000000000005,"15min":0.65700000000000003},"min":{"1min":0.22800000000000001,"5min":0.20899999999999999,"15min":0.193},"max":{"1min":6.7889999999999997,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":0.218},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78200000000000003,"15min":0.91800000000000004},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":4.359,"5min":8.3699999999999992,"15min":11.082000000000001},"last":2.278}]}]},{"osd":1,"up_from":8,"seq":34359739322,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10903408,"kb_used_data":8902696,"kb_used_omap":1727,"kb_used_meta":1998976,"kb_avail":83468432,"statfs":{"total":96636764160,"available":85471674368,"internally_reserved":0,"allocated":9116360704,"data_stored":15402301835,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1769453,"internal_metadata":2046951443},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,0,1,1,3,3,14,11,3],"upper_bound":1024},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.81899999999999995,"15min":0.91900000000000004},"min":{"1min":0.183,"5min":0.183,"15min":0.154},"max":{"1min":4.7709999999999999,"5min":9.8879999999999999,"15min":12.933},"last":3.96},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.59699999999999998,"15min":1.042},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":1.5700000000000001,"5min":10.029999999999999,"15min":17.196999999999999},"last":0.252}]},{"osd":2,"last update":"Sat Oct 14 01:20:37 2023","interfaces":[{"interface":"back","average":{"1min":2.6320000000000001,"5min":2.0369999999999999,"15min":1.5580000000000001},"min":{"1min":0.23100000000000001,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":12.391,"5min":12.391,"15min":12.391},"last":5.2110000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.27000000000000002,"5min":0.222,"15min":0.186},"max":{"1min":4.734,"5min":5.0629999999999997,"15min":8.1430000000000007},"last":4.9779999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739338,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7418860,"kb_used_data":5484772,"kb_used_omap":1046,"kb_used_meta":1933033,"kb_avail":86952980,"statfs":{"total":96636764160,"available":89039851520,"internally_reserved":0,"allocated":5616406528,"data_stored":9511597117,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1071227,"internal_metadata":1979426693},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,10,2,7,9,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:20:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":0.68799999999999994,"15min":1.0620000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.17899999999999999},"max":{"1min":4.2489999999999997,"5min":4.2489999999999997,"15min":25.927},"last":0.377},{"interface":"front","average":{"1min":0.89300000000000002,"5min":1.105,"15min":1.345},"min":{"1min":0.246,"5min":0.20999999999999999,"15min":0.188},"max":{"1min":4.1820000000000004,"5min":6.6340000000000003,"15min":26.632999999999999},"last":0.437}]},{"osd":2,"last update":"Sat Oct 14 01:20:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":0.77000000000000002,"15min":0.83199999999999996},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.5389999999999997,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.34399999999999997},{"interface":"front","average":{"1min":1.196,"5min":1.1020000000000001,"15min":0.92500000000000004},"min":{"1min":0.26000000000000001,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":6.4980000000000002,"5min":8.7360000000000007,"15min":8.7379999999999995},"last":0.47599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5615185920,"data_stored":9510681189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9115262976,"data_stored":15401508787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3499220992,"data_stored":5889971534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:21:06.842 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:06.843 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:06.843 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:06.844 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:06.844 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:06.844 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:21:07.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:07.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:07.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:07.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:07.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:07.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:07.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:07.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:07.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:07.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:07.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:07.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:07.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:07.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:07.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:07.682+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:07.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:07.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:07.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:07.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:08.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:08.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:08.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:08.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:08.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.210+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:08.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:08.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:08.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.210+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:08.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:08.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:08.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:08.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:08.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:08.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:08.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:08.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:08.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:08.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:08.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:08.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:08.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.466+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:08.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:08.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:08.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:08.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:08.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:08.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:08.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:08.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:08.694+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:09.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:09.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:09.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:09.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:09.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:09.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:09.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:09.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:09.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:09.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:09.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.206+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:09.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:09.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:09.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:09.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:09.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:09.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:09.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:09.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:09.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:09.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:09.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:09.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:09.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.482+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:09.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:09.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:09.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:10.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:10.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:10.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:10.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:10.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:10.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:10.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:10.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:10.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:10.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:10.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.174+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:10.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:10.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:10.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:11.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:11.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:11.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:11.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:11.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:11.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:11.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:11.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:11.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:11.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:11.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:11.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:11.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:11.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:11.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:11.538+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:11.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:11.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:11.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:11.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:11.544 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:21:11.542+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:21:11.557 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:21:11.554+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:21:13.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:13.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:13.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:13.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:13.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:13.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:13.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:13.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:13.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:13.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.186+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:13.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:13.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:13.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:13.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:13.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:13.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:13.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:13.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:13.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.294+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:13.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:13.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:13.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:13.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:13.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:13.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:13.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:13.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:13.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:13.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:13.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.462+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:13.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:13.462+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:15.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:15.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:15.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:15.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:15.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:15.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:15.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:15.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:15.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:15.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:15.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:15.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:15.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:15.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:16.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:16.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:16.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:16.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:16.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:16.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:16.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:16.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:16.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:16.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:16.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:16.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:16.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:16.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:16.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:16.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:17.041 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:21:17.038+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:21:17.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:21:17.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:17.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:17.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:17.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:17.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:17.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:17.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:17.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:17.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:17.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.386+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:17.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:17.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:17.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:19.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:19.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:19.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:19.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:19.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:19.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:19.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:19.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:19.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:19.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:19.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:19.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:19.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:19.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:19.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:19.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:19.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:19.738+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:19.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:19.746+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:19.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:19.762+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:19.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:19.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:20.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:20.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:20.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:20.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:20.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:20.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:20.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:20.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:21.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:21.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:21.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:21.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.062+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:21.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.074+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:21.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:21.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:21.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:21.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:21.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:21.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:21.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:21.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.602+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:21.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:21.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:21.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:21.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:21.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:21.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:21.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:21.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:21.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:21.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:22.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:22.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:23.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:23.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:23.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:23.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:23.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:23.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:23.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:23.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:23.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:23.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:23.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:23.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:23.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:23.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:23.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:23.050+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:24.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:24.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:24.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:24.742+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:24.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:24.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:24.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:24.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:24.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:24.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:24.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:24.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:24.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:24.818+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:24.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:24.874+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:24.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:24.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:24.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:24.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:25.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:21:25.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:25.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:25.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:25.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:25.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:25.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:25.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:25.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.982+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:25.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:25.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.994+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:25.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:25.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:25.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:26.846 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:21:27.453 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:21:27.454 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:21:27.529 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2597,"stamp":"2023-10-14T01:21:25.604374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29342314963,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2281665,"num_read_kb":8862428,"num_write":2233890,"num_write_kb":8934095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80557,"ondisk_log_size":80557,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23331688,"kb_used_data":17868236,"kb_used_omap":3442,"kb_used_meta":5459981,"kb_avail":259783832,"statfs":{"total":289910292480,"available":266018643968,"internally_reserved":0,"allocated":18297073664,"data_stored":30868118222,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3525442,"internal_metadata":5591020734},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,5,4,11,26,13],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21770240,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5386,"num_read_kb":21476,"num_write":5486,"num_write_kb":21944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002075"},"pg_stats":[{"pgid":"2.7","version":"159'287165","reported_seq":562800,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:21:24.571207+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:21:24.571207+0000","last_peered":"2023-10-14T01:21:24.571207+0000","last_clean":"2023-10-14T01:21:24.571207+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:21:24.571207+0000","last_undegraded":"2023-10-14T01:21:24.571207+0000","last_fullsized":"2023-10-14T01:21:24.571207+0000","mapping_epoch":13,"log_start":"155'277117","ondisk_log_start":"155'277117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1691,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 438s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3569574424,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":277631,"num_read_kb":1077732,"num_write":270764,"num_write_kb":1082709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"159'301536","reported_seq":594557,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:24.563160+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:21:24.563160+0000","last_peered":"2023-10-14T01:21:24.563160+0000","last_clean":"2023-10-14T01:21:24.563160+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:21:24.563160+0000","last_undegraded":"2023-10-14T01:21:24.563160+0000","last_fullsized":"2023-10-14T01:21:24.563160+0000","mapping_epoch":13,"log_start":"155'291516","ondisk_log_start":"155'291516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3775721690,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":296716,"num_read_kb":1142936,"num_write":286419,"num_write_kb":1145205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"159'280583","reported_seq":553049,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:24.543362+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:21:24.543362+0000","last_peered":"2023-10-14T01:21:24.543362+0000","last_clean":"2023-10-14T01:21:24.543362+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:21:24.543362+0000","last_undegraded":"2023-10-14T01:21:24.543362+0000","last_fullsized":"2023-10-14T01:21:24.543362+0000","mapping_epoch":13,"log_start":"155'270523","ondisk_log_start":"155'270523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3545760448,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":274531,"num_read_kb":1069443,"num_write":269851,"num_write_kb":1079094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"159'279172","reported_seq":553357,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:21:24.536987+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:21:24.536987+0000","last_peered":"2023-10-14T01:21:24.536987+0000","last_clean":"2023-10-14T01:21:24.536987+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:21:24.536987+0000","last_undegraded":"2023-10-14T01:21:24.536987+0000","last_fullsized":"2023-10-14T01:21:24.536987+0000","mapping_epoch":13,"log_start":"155'269120","ondisk_log_start":"155'269120","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1583,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 387s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3562566314,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":275863,"num_read_kb":1078108,"num_write":271755,"num_write_kb":1086769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"159'283519","reported_seq":565522,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:24.544914+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:21:24.544914+0000","last_peered":"2023-10-14T01:21:24.544914+0000","last_clean":"2023-10-14T01:21:24.544914+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:21:24.544914+0000","last_undegraded":"2023-10-14T01:21:24.544914+0000","last_fullsized":"2023-10-14T01:21:24.544914+0000","mapping_epoch":13,"log_start":"155'273423","ondisk_log_start":"155'273423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3633738249,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":284084,"num_read_kb":1098210,"num_write":277292,"num_write_kb":1108689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"159'285233","reported_seq":565479,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:21.323861+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:21:21.323861+0000","last_peered":"2023-10-14T01:21:21.323861+0000","last_clean":"2023-10-14T01:21:21.323861+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:21:21.323861+0000","last_undegraded":"2023-10-14T01:21:21.323861+0000","last_fullsized":"2023-10-14T01:21:21.323861+0000","mapping_epoch":13,"log_start":"155'275212","ondisk_log_start":"155'275212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3676315966,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":281798,"num_read_kb":1104478,"num_write":279878,"num_write_kb":1119351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"159'286707","reported_seq":569233,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:21.301513+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:21:21.301513+0000","last_peered":"2023-10-14T01:21:21.301513+0000","last_clean":"2023-10-14T01:21:21.301513+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:21:21.301513+0000","last_undegraded":"2023-10-14T01:21:21.301513+0000","last_fullsized":"2023-10-14T01:21:21.301513+0000","mapping_epoch":13,"log_start":"155'276616","ondisk_log_start":"155'276616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3708809767,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":283878,"num_read_kb":1114056,"num_write":281305,"num_write_kb":1125083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"159'325286","reported_seq":629624,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:21:24.527612+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:21:24.527612+0000","last_peered":"2023-10-14T01:21:24.527612+0000","last_clean":"2023-10-14T01:21:24.527612+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:21:24.527612+0000","last_undegraded":"2023-10-14T01:21:24.527612+0000","last_fullsized":"2023-10-14T01:21:24.527612+0000","mapping_epoch":13,"log_start":"156'315216","ondisk_log_start":"156'315216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":994,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 433s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3869237737,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":307058,"num_read_kb":1177374,"num_write":296489,"num_write_kb":1185301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":338,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:19:56.840894+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:19:56.840894+0000","last_peered":"2023-10-14T01:19:56.840894+0000","last_clean":"2023-10-14T01:19:56.840894+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:19:56.840894+0000","last_undegraded":"2023-10-14T01:19:56.840894+0000","last_fullsized":"2023-10-14T01:19:56.840894+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29341724595,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2281559,"num_read_kb":8862337,"num_write":2233753,"num_write_kb":8932201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18293649408,"data_stored":30866141030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80458,"ondisk_log_size":80458,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739342,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4728504,"kb_used_data":3430320,"kb_used_omap":668,"kb_used_meta":1297507,"kb_avail":89643336,"statfs":{"total":96636764160,"available":91794776064,"internally_reserved":0,"allocated":3512647680,"data_stored":5902560518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1328647462},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,0,1,1,5,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":4.3159999999999998,"5min":6.6340000000000003,"15min":6.6340000000000003},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.95199999999999996,"15min":0.95699999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":4.3959999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.30299999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.67700000000000005,"15min":0.65700000000000003},"min":{"1min":0.22800000000000001,"5min":0.20899999999999999,"15min":0.193},"max":{"1min":6.7889999999999997,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":3.0720000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78200000000000003,"15min":0.91800000000000004},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":4.359,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.27600000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739326,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11089484,"kb_used_data":8934656,"kb_used_omap":1727,"kb_used_meta":2153088,"kb_avail":83282356,"statfs":{"total":96636764160,"available":85281132544,"internally_reserved":0,"allocated":9149087744,"data_stored":15435028875,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1769453,"internal_metadata":2204762131},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,2,8,16,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:20:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.81899999999999995,"15min":0.91900000000000004},"min":{"1min":0.183,"5min":0.183,"15min":0.154},"max":{"1min":4.7709999999999999,"5min":9.8879999999999999,"15min":12.933},"last":0.371},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.59699999999999998,"15min":1.042},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":1.5700000000000001,"5min":10.029999999999999,"15min":17.196999999999999},"last":0.311}]},{"osd":2,"last update":"Sat Oct 14 01:20:37 2023","interfaces":[{"interface":"back","average":{"1min":2.6320000000000001,"5min":2.0369999999999999,"15min":1.5580000000000001},"min":{"1min":0.23100000000000001,"5min":0.20699999999999999,"15min":0.183},"max":{"1min":12.391,"5min":12.391,"15min":12.391},"last":15.07},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65100000000000002,"15min":0.65400000000000003},"min":{"1min":0.27000000000000002,"5min":0.222,"15min":0.186},"max":{"1min":4.734,"5min":5.0629999999999997,"15min":8.1430000000000007},"last":0.33300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739342,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7513700,"kb_used_data":5503260,"kb_used_omap":1046,"kb_used_meta":2009385,"kb_avail":86858140,"statfs":{"total":96636764160,"available":88942735360,"internally_reserved":0,"allocated":5635338240,"data_stored":9530528829,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1071227,"internal_metadata":2057611141},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,1,2,5,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:20:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":0.68799999999999994,"15min":1.0620000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.17899999999999999},"max":{"1min":4.2489999999999997,"5min":4.2489999999999997,"15min":25.927},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.89300000000000002,"5min":1.105,"15min":1.345},"min":{"1min":0.246,"5min":0.20999999999999999,"15min":0.188},"max":{"1min":4.1820000000000004,"5min":6.6340000000000003,"15min":26.632999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Sat Oct 14 01:20:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":0.77000000000000002,"15min":0.83199999999999996},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.5389999999999997,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.314},{"interface":"front","average":{"1min":1.196,"5min":1.1020000000000001,"15min":0.92500000000000004},"min":{"1min":0.26000000000000001,"5min":0.23499999999999999,"15min":0.214},"max":{"1min":6.4980000000000002,"5min":8.7360000000000007,"15min":8.7379999999999995},"last":0.377}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5634461696,"data_stored":9529956965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9147846656,"data_stored":15434092467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3511341056,"data_stored":5902091598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:21:27.531 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:27.531 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:27.532 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:27.532 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:27.532 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:27.533 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T01:21:27.534 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:21:27.526+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:21:28.213 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T01:21:28.273 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:21:29.122 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:21:29.191 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T01:21:30.004 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T01:21:30.076 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T01:21:30.754 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T01:21:30.808 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T01:21:31.803 INFO:teuthology.orchestra.run.smithi191.stderr:2023-10-14T01:21:31.802+0000 7f614f7fe640 0 --2- 172.21.15.191:0/892540875 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6148013e30 0x7f61480a4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-10-14T01:21:31.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:31.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:31.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:31.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:31.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:31.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:31.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:31.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:32.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:32.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:32.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:32.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:32.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:32.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:32.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:32.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:32.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:32.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:32.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:32.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:32.384 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T01:21:32.434 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:21:33.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:33.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:33.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.574+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:33.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:33.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:33.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:33.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:33.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.618+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:33.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:33.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:33.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:33.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:33.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:33.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:33.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:33.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.794+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:33.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.798+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:33.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.814+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:33.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:33.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:34.583 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:21:34.578+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:21:35.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:35.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:35.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:35.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:35.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:35.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:35.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:35.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:35.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:35.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:35.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:35.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:35.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:35.410+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:35.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:35.458+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:35.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:35.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:35.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:35.458+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:37.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:37.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:37.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:37.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:37.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:37.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:37.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:37.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.258+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:37.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:37.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.258+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:37.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:21:37.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:37.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:37.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:37.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.330+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:37.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:37.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:37.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:37.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:37.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.374+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:37.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:37.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:37.374+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:39.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:39.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:39.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:39.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:39.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:39.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:39.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:39.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:39.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:39.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:39.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:39.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:39.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:39.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:39.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:39.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:39.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:39.985+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:40.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:40.009+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:40.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:40.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:40.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:40.013+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:42.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:42.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:42.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:42.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:42.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:42.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:42.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:42.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:42.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:42.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:42.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:42.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:42.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:42.521+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:42.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:42.521+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:44.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:44.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:44.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:44.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:44.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:44.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:44.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:44.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:44.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:44.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:44.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:44.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:44.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:44.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:44.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:44.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:44.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:44.881+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:44.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:44.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:44.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:44.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:45.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:45.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:45.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:45.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:45.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:45.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:45.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:45.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:45.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:45.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.205+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:45.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:45.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:45.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:21:45.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:45.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:45.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:45.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:45.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:45.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:45.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:45.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:45.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:45.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.469+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:45.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:45.497+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:48.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:48.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:48.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:48.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:48.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:48.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:48.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:48.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:48.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:48.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:48.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:48.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:48.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:48.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:48.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:48.089+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:48.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:48.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:50.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:50.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:21:50.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:50.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:50.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:50.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:50.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:50.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:21:50.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:50.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:50.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:50.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:50.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:50.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:50.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:50.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:50.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:50.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:50.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:50.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:50.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:50.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:50.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:50.569+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:52.437 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:21:53.256 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:21:53.257 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:21:53.326 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2610,"stamp":"2023-10-14T01:21:51.617209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29383045587,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2292048,"num_read_kb":8903856,"num_write":2244262,"num_write_kb":8975583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80536,"ondisk_log_size":80536,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22376372,"kb_used_data":17948376,"kb_used_omap":3476,"kb_used_meta":4424491,"kb_avail":260739148,"statfs":{"total":289910292480,"available":266996887552,"internally_reserved":0,"allocated":18379137024,"data_stored":30950181582,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3559642,"internal_metadata":4530679590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,8,5,15,18,15],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":23281664,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5907,"num_read_kb":23580,"num_write":5938,"num_write_kb":23752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005427"},"pg_stats":[{"pgid":"2.7","version":"159'288469","reported_seq":565274,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:21:50.454557+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:21:50.454557+0000","last_peered":"2023-10-14T01:21:50.454557+0000","last_clean":"2023-10-14T01:21:50.454557+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:21:50.454557+0000","last_undegraded":"2023-10-14T01:21:50.454557+0000","last_fullsized":"2023-10-14T01:21:50.454557+0000","mapping_epoch":13,"log_start":"156'278417","ondisk_log_start":"156'278417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1757,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 464s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3574346264,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":278778,"num_read_kb":1082316,"num_write":271973,"num_write_kb":1087545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"159'302899","reported_seq":597236,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:50.453689+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:21:50.453689+0000","last_peered":"2023-10-14T01:21:50.453689+0000","last_clean":"2023-10-14T01:21:50.453689+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:21:50.453689+0000","last_undegraded":"2023-10-14T01:21:50.453689+0000","last_fullsized":"2023-10-14T01:21:50.453689+0000","mapping_epoch":13,"log_start":"156'292816","ondisk_log_start":"156'292816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3780878554,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":298018,"num_read_kb":1148144,"num_write":287739,"num_write_kb":1150485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"159'281854","reported_seq":555500,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:50.430155+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:21:50.430155+0000","last_peered":"2023-10-14T01:21:50.430155+0000","last_clean":"2023-10-14T01:21:50.430155+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:21:50.430155+0000","last_undegraded":"2023-10-14T01:21:50.430155+0000","last_fullsized":"2023-10-14T01:21:50.430155+0000","mapping_epoch":13,"log_start":"156'271823","ondisk_log_start":"156'271823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3550646976,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":275701,"num_read_kb":1074103,"num_write":271092,"num_write_kb":1084058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"159'280471","reported_seq":555880,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:21:50.404374+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:21:50.404374+0000","last_peered":"2023-10-14T01:21:50.404374+0000","last_clean":"2023-10-14T01:21:50.404374+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:21:50.404374+0000","last_undegraded":"2023-10-14T01:21:50.404374+0000","last_fullsized":"2023-10-14T01:21:50.404374+0000","mapping_epoch":13,"log_start":"156'270421","ondisk_log_start":"156'270421","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1691,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 413s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3567264426,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":277063,"num_read_kb":1082896,"num_write":272958,"num_write_kb":1091581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"159'284662","reported_seq":567968,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:49.827920+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:21:49.827920+0000","last_peered":"2023-10-14T01:21:49.827920+0000","last_clean":"2023-10-14T01:21:49.827920+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:21:49.827920+0000","last_undegraded":"2023-10-14T01:21:49.827920+0000","last_fullsized":"2023-10-14T01:21:49.827920+0000","mapping_epoch":13,"log_start":"156'274623","ondisk_log_start":"156'274623","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3638120969,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":285375,"num_read_kb":1103370,"num_write":278423,"num_write_kb":1113213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"159'286687","reported_seq":568442,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:51.552928+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:21:51.552928+0000","last_peered":"2023-10-14T01:21:51.552928+0000","last_clean":"2023-10-14T01:21:51.552928+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:21:51.552928+0000","last_undegraded":"2023-10-14T01:21:51.552928+0000","last_fullsized":"2023-10-14T01:21:51.552928+0000","mapping_epoch":13,"log_start":"156'276612","ondisk_log_start":"156'276612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3682083134,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":283303,"num_read_kb":1110470,"num_write":281323,"num_write_kb":1125131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"159'288203","reported_seq":572173,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:21:51.543675+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:21:51.543675+0000","last_peered":"2023-10-14T01:21:51.543675+0000","last_clean":"2023-10-14T01:21:51.543675+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:21:51.543675+0000","last_undegraded":"2023-10-14T01:21:51.543675+0000","last_fullsized":"2023-10-14T01:21:51.543675+0000","mapping_epoch":13,"log_start":"156'278116","ondisk_log_start":"156'278116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3714740775,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":285316,"num_read_kb":1119792,"num_write":282792,"num_write_kb":1131031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"159'326736","reported_seq":632450,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:21:50.449968+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:21:50.449968+0000","last_peered":"2023-10-14T01:21:50.449968+0000","last_clean":"2023-10-14T01:21:50.449968+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:21:50.449968+0000","last_undegraded":"2023-10-14T01:21:50.449968+0000","last_fullsized":"2023-10-14T01:21:50.449968+0000","mapping_epoch":13,"log_start":"156'316716","ondisk_log_start":"156'316716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1037,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 459s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3874374121,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":308388,"num_read_kb":1182674,"num_write":297825,"num_write_kb":1190645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":338,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-10-14T01:19:56.840894+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:19:56.840894+0000","last_peered":"2023-10-14T01:19:56.840894+0000","last_clean":"2023-10-14T01:19:56.840894+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:19:56.840894+0000","last_undegraded":"2023-10-14T01:19:56.840894+0000","last_fullsized":"2023-10-14T01:19:56.840894+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29382455219,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2291942,"num_read_kb":8903765,"num_write":2244125,"num_write_kb":8973689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18377383936,"data_stored":30949875558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80437,"ondisk_log_size":80437,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739348,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4840720,"kb_used_data":3448200,"kb_used_omap":668,"kb_used_meta":1391843,"kb_avail":89531120,"statfs":{"total":96636764160,"available":91679866880,"internally_reserved":0,"allocated":3530956800,"data_stored":5920869638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1425247526},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,4,4,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":4.3159999999999998,"5min":6.6340000000000003,"15min":6.6340000000000003},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.95199999999999996,"15min":0.95699999999999996},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":4.3959999999999999,"5min":6.6859999999999999,"15min":6.6859999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Sat Oct 14 01:20:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.67700000000000005,"15min":0.65700000000000003},"min":{"1min":0.22800000000000001,"5min":0.20899999999999999,"15min":0.193},"max":{"1min":6.7889999999999997,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.78200000000000003,"15min":0.91800000000000004},"min":{"1min":0.25800000000000001,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":4.359,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.44900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739331,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9911600,"kb_used_data":8973224,"kb_used_omap":1761,"kb_used_meta":936606,"kb_avail":84460240,"statfs":{"total":96636764160,"available":86487285760,"internally_reserved":0,"allocated":9188581376,"data_stored":15474522507,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1803653,"internal_metadata":959085179},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,5,2,8,11,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.92200000000000004,"15min":0.90000000000000002},"min":{"1min":0.20599999999999999,"5min":0.183,"15min":0.154},"max":{"1min":5.8719999999999999,"5min":9.8879999999999999,"15min":12.933},"last":5.9699999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67100000000000004,"15min":0.996},"min":{"1min":0.249,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":3.4079999999999999,"5min":10.029999999999999,"15min":17.196999999999999},"last":5.952}]},{"osd":2,"last update":"Sat Oct 14 01:21:42 2023","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.2730000000000001,"15min":1.6499999999999999},"min":{"1min":0.222,"5min":0.21099999999999999,"15min":0.183},"max":{"1min":15.07,"5min":15.07,"15min":15.07},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.73399999999999999,"15min":0.65900000000000003},"min":{"1min":0.23999999999999999,"5min":0.222,"15min":0.186},"max":{"1min":5.9279999999999999,"5min":5.9279999999999999,"15min":8.1430000000000007},"last":0.40200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739347,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7624052,"kb_used_data":5526952,"kb_used_omap":1046,"kb_used_meta":2096041,"kb_avail":86747788,"statfs":{"total":96636764160,"available":88829734912,"internally_reserved":0,"allocated":5659598848,"data_stored":9554789437,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1071227,"internal_metadata":2146346885},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,3,3,3,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:21:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":0.83699999999999997,"15min":1.0529999999999999},"min":{"1min":0.191,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":7.7839999999999998,"5min":7.7839999999999998,"15min":25.927},"last":0.28999999999999998},{"interface":"front","average":{"1min":1.486,"5min":1.1679999999999999,"15min":1.329},"min":{"1min":0.221,"5min":0.20999999999999999,"15min":0.188},"max":{"1min":7.7409999999999997,"5min":7.7409999999999997,"15min":26.632999999999999},"last":0.27100000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:21:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89600000000000002,"15min":0.82899999999999996},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.984,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":4.734},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.0389999999999999,"15min":0.89600000000000002},"min":{"1min":0.26400000000000001,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":5.7629999999999999,"5min":8.7360000000000007,"15min":8.7360000000000007},"last":4.8159999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5658959872,"data_stored":9554455141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9188646912,"data_stored":15474892723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3529777152,"data_stored":5920527694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:21:53.328 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:53.328 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:53.329 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:53.329 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:53.330 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:21:53.330 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:21:53.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:53.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:53.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:53.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:53.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:53.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:53.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:53.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:53.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:53.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:53.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:53.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:53.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:53.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:53.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:53.793+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:53.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:53.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:53.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:53.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:55.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:55.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:55.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:55.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:55.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:55.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:55.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:55.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:55.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:55.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:55.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:55.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:55.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:55.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:55.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:55.485+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:55.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:55.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:55.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:55.485+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:55.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:55.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:55.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:55.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:56.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:56.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:56.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:56.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:56.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:56.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:56.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.021+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:56.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:56.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:56.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:56.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:56.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:21:56.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:56.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:56.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:56.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:56.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:56.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:56.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.733+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:56.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:56.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:59.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:59.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:59.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:59.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:59.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:59.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:59.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.321+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:59.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.325+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:59.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:59.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:59.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:59.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:59.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:59.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:21:59.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:21:59.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:59.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.589+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:21:59.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:21:59.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:21:59.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:21:59.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:21:59.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:21:59.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:21:59.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:21:59.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.665+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:21:59.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:21:59.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:00.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:00.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:00.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:00.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:00.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:00.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:00.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:00.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:00.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:00.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:00.474 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:00.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:00.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:00.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:00.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:00.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:00.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:00.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:02.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:02.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:02.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:02.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:02.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:02.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:02.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:02.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:02.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:02.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:03.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:03.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:03.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:03.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:03.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:22:03.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:03.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:03.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:03.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:03.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:03.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:03.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:03.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:03.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:03.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:03.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:03.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:03.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:03.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:04.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:04.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:04.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:04.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:04.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:04.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:04.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:04.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:04.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:04.509+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:04.513 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:04.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:04.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:04.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:04.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:04.509+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:04.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:04.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:04.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:04.517+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:06.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:06.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:06.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:06.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:06.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:06.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:06.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:06.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:06.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:06.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:06.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:06.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:06.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:06.609+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:06.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:06.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:06.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:06.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:06.774 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:22:06.769+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:22:06.775 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:22:06.769+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:22:09.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:09.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:09.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:09.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:09.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:09.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:09.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:09.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:09.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:09.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:09.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:09.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:09.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:09.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:09.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:09.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:09.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:09.685+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:09.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:09.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:09.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:09.685+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:11.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:11.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:11.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:11.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:11.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:11.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:11.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:11.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:11.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:11.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:11.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:11.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:11.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:11.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:11.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:11.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:11.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:11.277+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:11.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:11.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:11.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:11.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:12.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:12.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:12.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:12.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:12.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:12.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:12.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:12.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:12.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:12.417+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:12.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:12.417+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:12.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:12.417+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:12.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:12.417+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:12.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:12.417+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:13.331 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:22:13.893 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:22:13.889+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:22:14.169 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:22:14.169 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:22:14.252 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2622,"stamp":"2023-10-14T01:22:13.622423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29414412755,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2300121,"num_read_kb":8936040,"num_write":2252247,"num_write_kb":9007523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80511,"ondisk_log_size":80511,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":20806224,"kb_used_data":18013560,"kb_used_omap":3477,"kb_used_meta":2789162,"kb_avail":262309296,"statfs":{"total":289910292480,"available":268604719104,"internally_reserved":0,"allocated":18445885440,"data_stored":31016917140,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3561322,"internal_metadata":2856102038},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,13,6,12,16,14,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15650816,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4066,"num_read_kb":16220,"num_write":3996,"num_write_kb":15984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003096"},"pg_stats":[{"pgid":"2.7","version":"160'289569","reported_seq":567396,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:22:11.107603+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:22:11.107603+0000","last_peered":"2023-10-14T01:22:11.107603+0000","last_clean":"2023-10-14T01:22:11.107603+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:22:11.107603+0000","last_undegraded":"2023-10-14T01:22:11.107603+0000","last_fullsized":"2023-10-14T01:22:11.107603+0000","mapping_epoch":13,"log_start":"156'279517","ondisk_log_start":"156'279517","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1821,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 484s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3578384920,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":279772,"num_read_kb":1086276,"num_write":272980,"num_write_kb":1091573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'303936","reported_seq":599346,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:11.032719+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:22:11.032719+0000","last_peered":"2023-10-14T01:22:11.032719+0000","last_clean":"2023-10-14T01:22:11.032719+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:22:11.032719+0000","last_undegraded":"2023-10-14T01:22:11.032719+0000","last_fullsized":"2023-10-14T01:22:11.032719+0000","mapping_epoch":13,"log_start":"156'293916","ondisk_log_start":"156'293916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3784810714,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":299076,"num_read_kb":1152372,"num_write":288731,"num_write_kb":1154453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'282880","reported_seq":557540,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:11.072063+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:22:11.072063+0000","last_peered":"2023-10-14T01:22:11.072063+0000","last_clean":"2023-10-14T01:22:11.072063+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:22:11.072063+0000","last_undegraded":"2023-10-14T01:22:11.072063+0000","last_fullsized":"2023-10-14T01:22:11.072063+0000","mapping_epoch":13,"log_start":"156'272823","ondisk_log_start":"156'272823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3554521792,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":276705,"num_read_kb":1078107,"num_write":272087,"num_write_kb":1088038,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'281521","reported_seq":557926,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:22:11.088516+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:22:11.088516+0000","last_peered":"2023-10-14T01:22:11.088516+0000","last_clean":"2023-10-14T01:22:11.088516+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:22:11.088516+0000","last_undegraded":"2023-10-14T01:22:11.088516+0000","last_fullsized":"2023-10-14T01:22:11.088516+0000","mapping_epoch":13,"log_start":"156'271421","ondisk_log_start":"156'271421","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1769,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 434s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3571085994,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":278047,"num_read_kb":1086816,"num_write":273933,"num_write_kb":1095481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"160'285624","reported_seq":569927,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:09.958152+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:22:09.958152+0000","last_peered":"2023-10-14T01:22:09.958152+0000","last_clean":"2023-10-14T01:22:09.958152+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:22:09.958152+0000","last_undegraded":"2023-10-14T01:22:09.958152+0000","last_fullsized":"2023-10-14T01:22:09.958152+0000","mapping_epoch":13,"log_start":"156'275623","ondisk_log_start":"156'275623","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3641852425,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":286357,"num_read_kb":1107278,"num_write":279379,"num_write_kb":1117037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"160'287663","reported_seq":570376,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:11.728159+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:22:11.728159+0000","last_peered":"2023-10-14T01:22:11.728159+0000","last_clean":"2023-10-14T01:22:11.728159+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:22:11.728159+0000","last_undegraded":"2023-10-14T01:22:11.728159+0000","last_fullsized":"2023-10-14T01:22:11.728159+0000","mapping_epoch":13,"log_start":"156'277612","ondisk_log_start":"156'277612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3685929278,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":284257,"num_read_kb":1114274,"num_write":282295,"num_write_kb":1129019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"160'289209","reported_seq":574210,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:11.689112+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:22:11.689112+0000","last_peered":"2023-10-14T01:22:11.689112+0000","last_clean":"2023-10-14T01:22:11.689112+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:22:11.689112+0000","last_undegraded":"2023-10-14T01:22:11.689112+0000","last_fullsized":"2023-10-14T01:22:11.689112+0000","mapping_epoch":13,"log_start":"156'279116","ondisk_log_start":"156'279116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3718668839,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":286341,"num_read_kb":1123876,"num_write":283794,"num_write_kb":1135039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"160'327954","reported_seq":634770,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:22:11.053518+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:22:11.053518+0000","last_peered":"2023-10-14T01:22:11.053518+0000","last_clean":"2023-10-14T01:22:11.053518+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:22:11.053518+0000","last_undegraded":"2023-10-14T01:22:11.053518+0000","last_fullsized":"2023-10-14T01:22:11.053518+0000","mapping_epoch":13,"log_start":"156'317916","ondisk_log_start":"156'317916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1086,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 480s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3878568425,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":309460,"num_read_kb":1186950,"num_write":298911,"num_write_kb":1194989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":340,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:22:00.691314+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:22:00.691314+0000","last_peered":"2023-10-14T01:22:00.691314+0000","last_clean":"2023-10-14T01:22:00.691314+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:22:00.691314+0000","last_undegraded":"2023-10-14T01:22:00.691314+0000","last_fullsized":"2023-10-14T01:22:00.691314+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29413822387,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2300015,"num_read_kb":8935949,"num_write":2252110,"num_write_kb":9005629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18442813440,"data_stored":31015305062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80412,"ondisk_log_size":80412,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739352,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4866668,"kb_used_data":3460260,"kb_used_omap":668,"kb_used_meta":1405731,"kb_avail":89505172,"statfs":{"total":96636764160,"available":91653296128,"internally_reserved":0,"allocated":3543306240,"data_stored":5933214792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1439468838},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,2,4,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:21:53 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":0.91100000000000003,"15min":0.96199999999999997},"min":{"1min":0.19400000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":10.981999999999999,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":1.629,"5min":0.95799999999999996,"15min":1.0149999999999999},"min":{"1min":0.26700000000000002,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":11.039,"5min":11.039,"15min":11.039},"last":0.439}]},{"osd":1,"last update":"Sat Oct 14 01:21:53 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.71499999999999997,"15min":0.70599999999999996},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.193},"max":{"1min":5.7560000000000002,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.28,"5min":0.83599999999999997,"15min":0.94499999999999995},"min":{"1min":0.24399999999999999,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":8.1899999999999995,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.36699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739335,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9698940,"kb_used_data":9006260,"kb_used_omap":1761,"kb_used_meta":690910,"kb_avail":84672900,"statfs":{"total":96636764160,"available":86705049600,"internally_reserved":0,"allocated":9222410240,"data_stored":15508347085,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1803653,"internal_metadata":707492475},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,7,4,10,11,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.92200000000000004,"15min":0.90000000000000002},"min":{"1min":0.20599999999999999,"5min":0.183,"15min":0.154},"max":{"1min":5.8719999999999999,"5min":9.8879999999999999,"15min":12.933},"last":6.673},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67100000000000004,"15min":0.996},"min":{"1min":0.249,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":3.4079999999999999,"5min":10.029999999999999,"15min":17.196999999999999},"last":0.219}]},{"osd":2,"last update":"Sat Oct 14 01:21:42 2023","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.2730000000000001,"15min":1.6499999999999999},"min":{"1min":0.222,"5min":0.21099999999999999,"15min":0.183},"max":{"1min":15.07,"5min":15.07,"15min":15.07},"last":6.5259999999999998},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.73399999999999999,"15min":0.65900000000000003},"min":{"1min":0.23999999999999999,"5min":0.222,"15min":0.186},"max":{"1min":5.9279999999999999,"5min":5.9279999999999999,"15min":8.1430000000000007},"last":2.7730000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739351,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6240616,"kb_used_data":5547040,"kb_used_omap":1047,"kb_used_meta":692520,"kb_avail":88131224,"statfs":{"total":96636764160,"available":90246373376,"internally_reserved":0,"allocated":5680168960,"data_stored":9575355263,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":709140725},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,0,1,4,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:21:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":0.83699999999999997,"15min":1.0529999999999999},"min":{"1min":0.191,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":7.7839999999999998,"5min":7.7839999999999998,"15min":25.927},"last":0.41599999999999998},{"interface":"front","average":{"1min":1.486,"5min":1.1679999999999999,"15min":1.329},"min":{"1min":0.221,"5min":0.20999999999999999,"15min":0.188},"max":{"1min":7.7409999999999997,"5min":7.7409999999999997,"15min":26.632999999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:21:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89600000000000002,"15min":0.82899999999999996},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.984,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.0389999999999999,"15min":0.89600000000000002},"min":{"1min":0.26400000000000001,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":5.7629999999999999,"5min":8.7360000000000007,"15min":8.7360000000000007},"last":0.38100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5678796800,"data_stored":9574292069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9221804032,"data_stored":15508049843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3542212608,"data_stored":5932963150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:22:14.253 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:14.254 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:14.254 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:14.254 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:14.255 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:14.255 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:22:17.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:17.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:17.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:17.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:17.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:17.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:17.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:17.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:17.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:17.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:17.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:17.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:17.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:17.293+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:17.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:17.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:17.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:17.305+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:17.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:17.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:17.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:17.313+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:20.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:20.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:21.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:22:21.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:22:21.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:22:21.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:21.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:21.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:21.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:21.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:21.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:21.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:21.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:21.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:21.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.729+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:21.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:21.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:21.729+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:22.856 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:22:22.853+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:22:23.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:23.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:23.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:23.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:23.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:23.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:23.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:23.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:23.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:23.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:23.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:23.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:23.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:23.653+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:23.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:23.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:24.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:24.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:24.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:24.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:24.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:24.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:24.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:24.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:22:24.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:24.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:24.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:24.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:24.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.173+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:24.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:22:24.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:24.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:24.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:24.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:24.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:24.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:25.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:25.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:25.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:25.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:25.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:25.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:25.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:25.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:25.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:25.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:25.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:25.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:27.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:27.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:27.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:27.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:27.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:27.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:27.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:27.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:27.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:27.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:27.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:27.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:27.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:27.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:27.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:27.597+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:27.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:27.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:27.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:27.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:28.031 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:22:28.029+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:22:30.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:30.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:30.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:30.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:30.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:30.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:30.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:30.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:30.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.189+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:30.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:30.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:30.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:30.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:30.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:30.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:30.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:30.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.461+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:30.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:30.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.477+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:30.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:30.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:30.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:22:30.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:30.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:30.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:30.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:30.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:31.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:31.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:31.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:31.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:31.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.997+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:31.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:31.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:30.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:31.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:31.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:31.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:31.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:31.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:31.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:31.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:31.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:31.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:31.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:31.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:31.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:31.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:31.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:31.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:31.957+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:31.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:31.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:32.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:32.009+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:32.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:32.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:32.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:32.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:32.880 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:22:32.877+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:22:34.257 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:22:34.929 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:22:34.930 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:22:34.966 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2632,"stamp":"2023-10-14T01:22:33.628570+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29445530067,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2307786,"num_read_kb":8966644,"num_write":2260219,"num_write_kb":9039411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80493,"ondisk_log_size":80493,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21143708,"kb_used_data":18076224,"kb_used_omap":3477,"kb_used_meta":3063978,"kb_avail":261971812,"statfs":{"total":289910292480,"available":268259135488,"internally_reserved":0,"allocated":18510053376,"data_stored":31081085076,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3561322,"internal_metadata":3137513622},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,8,4,17,16,6,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17502208,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4314,"num_read_kb":17224,"num_write":4500,"num_write_kb":18000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004752"},"pg_stats":[{"pgid":"2.7","version":"160'290633","reported_seq":569393,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:22:31.505651+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:22:31.505651+0000","last_peered":"2023-10-14T01:22:31.505651+0000","last_clean":"2023-10-14T01:22:31.505651+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:22:31.505651+0000","last_undegraded":"2023-10-14T01:22:31.505651+0000","last_fullsized":"2023-10-14T01:22:31.505651+0000","mapping_epoch":13,"log_start":"156'280617","ondisk_log_start":"156'280617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1893,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 505s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3582210584,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":280685,"num_read_kb":1089920,"num_write":273948,"num_write_kb":1095445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'305014","reported_seq":601443,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:31.465269+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:22:31.465269+0000","last_peered":"2023-10-14T01:22:31.465269+0000","last_clean":"2023-10-14T01:22:31.465269+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:22:31.465269+0000","last_undegraded":"2023-10-14T01:22:31.465269+0000","last_fullsized":"2023-10-14T01:22:31.465269+0000","mapping_epoch":13,"log_start":"156'294916","ondisk_log_start":"156'294916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3788853466,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":300082,"num_read_kb":1156384,"num_write":289766,"num_write_kb":1158593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'283836","reported_seq":559437,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:31.486255+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:22:31.486255+0000","last_peered":"2023-10-14T01:22:31.486255+0000","last_clean":"2023-10-14T01:22:31.486255+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:22:31.486255+0000","last_undegraded":"2023-10-14T01:22:31.486255+0000","last_fullsized":"2023-10-14T01:22:31.486255+0000","mapping_epoch":13,"log_start":"156'273823","ondisk_log_start":"156'273823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3558101696,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":277638,"num_read_kb":1081831,"num_write":273015,"num_write_kb":1091750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'282608","reported_seq":559979,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:22:31.494773+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:22:31.494773+0000","last_peered":"2023-10-14T01:22:31.494773+0000","last_clean":"2023-10-14T01:22:31.494773+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:22:31.494773+0000","last_undegraded":"2023-10-14T01:22:31.494773+0000","last_fullsized":"2023-10-14T01:22:31.494773+0000","mapping_epoch":13,"log_start":"156'272522","ondisk_log_start":"156'272522","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1880,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 454s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3574973098,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":279002,"num_read_kb":1090624,"num_write":274924,"num_write_kb":1099445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"160'286669","reported_seq":571906,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:30.157423+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:22:30.157423+0000","last_peered":"2023-10-14T01:22:30.157423+0000","last_clean":"2023-10-14T01:22:30.157423+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:22:30.157423+0000","last_undegraded":"2023-10-14T01:22:30.157423+0000","last_fullsized":"2023-10-14T01:22:30.157423+0000","mapping_epoch":13,"log_start":"156'276623","ondisk_log_start":"156'276623","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3645809161,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":287281,"num_read_kb":1110966,"num_write":280400,"num_write_kb":1121121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"160'288662","reported_seq":572354,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:31.881552+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:22:31.881552+0000","last_peered":"2023-10-14T01:22:31.881552+0000","last_clean":"2023-10-14T01:22:31.881552+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:22:31.881552+0000","last_undegraded":"2023-10-14T01:22:31.881552+0000","last_fullsized":"2023-10-14T01:22:31.881552+0000","mapping_epoch":13,"log_start":"156'278612","ondisk_log_start":"156'278612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3689787710,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":285229,"num_read_kb":1118162,"num_write":283284,"num_write_kb":1132975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"160'290171","reported_seq":576159,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:31.871999+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:22:31.871999+0000","last_peered":"2023-10-14T01:22:31.871999+0000","last_clean":"2023-10-14T01:22:31.871999+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:22:31.871999+0000","last_undegraded":"2023-10-14T01:22:31.871999+0000","last_fullsized":"2023-10-14T01:22:31.871999+0000","mapping_epoch":13,"log_start":"156'280116","ondisk_log_start":"156'280116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3722478119,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":287324,"num_read_kb":1127804,"num_write":284746,"num_write_kb":1138847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"160'329146","reported_seq":636971,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:22:31.476819+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:22:31.476819+0000","last_peered":"2023-10-14T01:22:31.476819+0000","last_clean":"2023-10-14T01:22:31.476819+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:22:31.476819+0000","last_undegraded":"2023-10-14T01:22:31.476819+0000","last_fullsized":"2023-10-14T01:22:31.476819+0000","mapping_epoch":13,"log_start":"157'319116","ondisk_log_start":"157'319116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1128,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 500s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3882725865,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":310439,"num_read_kb":1190862,"num_write":299999,"num_write_kb":1199341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":340,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:22:00.691314+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:22:00.691314+0000","last_peered":"2023-10-14T01:22:00.691314+0000","last_clean":"2023-10-14T01:22:00.691314+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:22:00.691314+0000","last_undegraded":"2023-10-14T01:22:00.691314+0000","last_fullsized":"2023-10-14T01:22:00.691314+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29444939699,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2307680,"num_read_kb":8966553,"num_write":2260082,"num_write_kb":9037517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18507878400,"data_stored":31080370022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80394,"ondisk_log_size":80394,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739356,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4946688,"kb_used_data":3472312,"kb_used_omap":668,"kb_used_meta":1473699,"kb_avail":89425152,"statfs":{"total":96636764160,"available":91571355648,"internally_reserved":0,"allocated":3555647488,"data_stored":5945556040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1509068070},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:21:53 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":0.91100000000000003,"15min":0.96199999999999997},"min":{"1min":0.19400000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":10.981999999999999,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":1.629,"5min":0.95799999999999996,"15min":1.0149999999999999},"min":{"1min":0.26700000000000002,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":11.039,"5min":11.039,"15min":11.039},"last":0.56000000000000005}]},{"osd":1,"last update":"Sat Oct 14 01:21:53 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.71499999999999997,"15min":0.70599999999999996},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.193},"max":{"1min":5.7560000000000002,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.28,"5min":0.83599999999999997,"15min":0.94499999999999995},"min":{"1min":0.24399999999999999,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":8.1899999999999995,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.75800000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739339,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9882752,"kb_used_data":9037368,"kb_used_omap":1761,"kb_used_meta":843614,"kb_avail":84489088,"statfs":{"total":96636764160,"available":86516826112,"internally_reserved":0,"allocated":9254264832,"data_stored":15540201677,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1803653,"internal_metadata":863861371},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,7,3,13,11,4,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:21:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.92200000000000004,"15min":0.90000000000000002},"min":{"1min":0.20599999999999999,"5min":0.183,"15min":0.154},"max":{"1min":5.8719999999999999,"5min":9.8879999999999999,"15min":12.933},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67100000000000004,"15min":0.996},"min":{"1min":0.249,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":3.4079999999999999,"5min":10.029999999999999,"15min":17.196999999999999},"last":0.27000000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:21:42 2023","interfaces":[{"interface":"back","average":{"1min":2.9390000000000001,"5min":2.2730000000000001,"15min":1.6499999999999999},"min":{"1min":0.222,"5min":0.21099999999999999,"15min":0.183},"max":{"1min":15.07,"5min":15.07,"15min":15.07},"last":0.307},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.73399999999999999,"15min":0.65900000000000003},"min":{"1min":0.23999999999999999,"5min":0.222,"15min":0.186},"max":{"1min":5.9279999999999999,"5min":5.9279999999999999,"15min":8.1430000000000007},"last":0.25}]}]},{"osd":0,"up_from":8,"seq":34359739356,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6314268,"kb_used_data":5566544,"kb_used_omap":1047,"kb_used_meta":746664,"kb_avail":88057572,"statfs":{"total":96636764160,"available":90170953728,"internally_reserved":0,"allocated":5700141056,"data_stored":9595327359,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":764584181},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2,5,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:21:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":0.83699999999999997,"15min":1.0529999999999999},"min":{"1min":0.191,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":7.7839999999999998,"5min":7.7839999999999998,"15min":25.927},"last":0.52000000000000002},{"interface":"front","average":{"1min":1.486,"5min":1.1679999999999999,"15min":1.329},"min":{"1min":0.221,"5min":0.20999999999999999,"15min":0.188},"max":{"1min":7.7409999999999997,"5min":7.7409999999999997,"15min":26.632999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:21:45 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.89600000000000002,"15min":0.82899999999999996},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.984,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":1.0389999999999999,"15min":0.89600000000000002},"min":{"1min":0.26400000000000001,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":5.7629999999999999,"5min":8.7360000000000007,"15min":8.7360000000000007},"last":0.55100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5698863104,"data_stored":9594358373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9254481920,"data_stored":15540727731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3554533376,"data_stored":5945283918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:22:34.968 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:34.968 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:34.969 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:34.969 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:34.969 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:34.970 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:22:35.309 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:22:35.305+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:22:36.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:36.672+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:36.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:36.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:36.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:36.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:36.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:36.756+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:37.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:37.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:37.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:37.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:37.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:37.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.080+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:37.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:22:37.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:37.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:37.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:37.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:37.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:37.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:37.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:37.896+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:38.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:38.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:38.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:38.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:38.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:38.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:38.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:38.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:38.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:38.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:38.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:38.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:39.609 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:22:39.604+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:22:41.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:41.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:41.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:41.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:41.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:41.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:41.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:41.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:41.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:41.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:41.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:41.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:41.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:41.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:41.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:41.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:41.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:41.128+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:41.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:41.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:41.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:41.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:42.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:42.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:42.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:42.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:42.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:42.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:42.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:42.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:42.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:42.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:42.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:42.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:43.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:43.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:43.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:43.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:43.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:43.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:43.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:43.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:43.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:43.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:43.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:43.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:43.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:43.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:43.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:43.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:43.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:43.228+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:43.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:43.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:43.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:43.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:45.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:22:45.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:22:45.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:45.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:45.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:45.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:45.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:45.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:45.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:45.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:45.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.564+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:45.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:45.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:45.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:46.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:22:46.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:46.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:46.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:46.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:46.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:46.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:46.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:46.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:46.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:46.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.364+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:46.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:46.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:46.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:22:46.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:22:46.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:22:46.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:46.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:46.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:46.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:47.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:47.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:47.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:47.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:47.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:47.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:47.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:47.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:47.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:47.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:47.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:47.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:47.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:47.012+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:47.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:47.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:47.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:47.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:47.864 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:22:47.860+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:22:49.328 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:22:49.328+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:22:49.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:49.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:49.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:49.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:49.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:49.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:49.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:49.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:49.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:49.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:49.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:49.480+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:49.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:49.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:49.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:49.492+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:49.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:49.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:49.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:49.492+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:49.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:49.504+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:50.166 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:22:50.164+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:22:51.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:51.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:51.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:51.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:51.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:51.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:51.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:51.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:51.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:51.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:51.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:51.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:51.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:51.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:51.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:51.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:51.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:51.404+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:52.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:52.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:52.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:52.508+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:52.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:52.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:52.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:52.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:52.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:52.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:52.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:52.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:52.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:52.588+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:52.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:52.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:52.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:52.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:54.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:54.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:54.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:54.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:54.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:54.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:54.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:54.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:54.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:54.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:54.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:54.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:54.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:54.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:54.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:54.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:54.971 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:22:55.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:22:55.864 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:22:55.865 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:22:55.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:22:55.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:55.934 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2643,"stamp":"2023-10-14T01:22:55.649224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29477650899,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2315948,"num_read_kb":8999192,"num_write":2268406,"num_write_kb":9072159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80546,"ondisk_log_size":80546,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21519724,"kb_used_data":18145044,"kb_used_omap":3477,"kb_used_meta":3371178,"kb_avail":261595796,"statfs":{"total":289910292480,"available":267874095104,"internally_reserved":0,"allocated":18580525056,"data_stored":31151556756,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3561322,"internal_metadata":3452086422},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,6,3,11,2,10,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16744448,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4302,"num_read_kb":17136,"num_write":4278,"num_write_kb":17112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.011399"},"pg_stats":[{"pgid":"2.7","version":"160'291637","reported_seq":571456,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:22:51.964478+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:22:51.964478+0000","last_peered":"2023-10-14T01:22:51.964478+0000","last_clean":"2023-10-14T01:22:51.964478+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:22:51.964478+0000","last_undegraded":"2023-10-14T01:22:51.964478+0000","last_fullsized":"2023-10-14T01:22:51.964478+0000","mapping_epoch":13,"log_start":"157'281617","ondisk_log_start":"157'281617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1951,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 525s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3585864216,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":281726,"num_read_kb":1094076,"num_write":274869,"num_write_kb":1099129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'306078","reported_seq":603568,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:51.964904+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:22:51.964904+0000","last_peered":"2023-10-14T01:22:51.964904+0000","last_clean":"2023-10-14T01:22:51.964904+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:22:51.964904+0000","last_undegraded":"2023-10-14T01:22:51.964904+0000","last_fullsized":"2023-10-14T01:22:51.964904+0000","mapping_epoch":13,"log_start":"157'296016","ondisk_log_start":"157'296016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3792871642,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":301130,"num_read_kb":1160568,"num_write":290791,"num_write_kb":1162693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'284829","reported_seq":561367,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:51.967945+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:22:51.967945+0000","last_peered":"2023-10-14T01:22:51.967945+0000","last_clean":"2023-10-14T01:22:51.967945+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:22:51.967945+0000","last_undegraded":"2023-10-14T01:22:51.967945+0000","last_fullsized":"2023-10-14T01:22:51.967945+0000","mapping_epoch":13,"log_start":"157'274823","ondisk_log_start":"157'274823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3561865920,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":278571,"num_read_kb":1085559,"num_write":273981,"num_write_kb":1095614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'283694","reported_seq":561993,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:22:51.901436+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:22:51.901436+0000","last_peered":"2023-10-14T01:22:51.901436+0000","last_clean":"2023-10-14T01:22:51.901436+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:22:51.901436+0000","last_undegraded":"2023-10-14T01:22:51.901436+0000","last_fullsized":"2023-10-14T01:22:51.901436+0000","mapping_epoch":13,"log_start":"157'273622","ondisk_log_start":"157'273622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1960,"log_size":10072,"log_dups_size":0,"ondisk_log_size":10072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 474s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3578888874,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":279912,"num_read_kb":1094244,"num_write":275934,"num_write_kb":1103485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"160'287901","reported_seq":574334,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:55.542043+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:22:55.542043+0000","last_peered":"2023-10-14T01:22:55.542043+0000","last_clean":"2023-10-14T01:22:55.542043+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:22:55.542043+0000","last_undegraded":"2023-10-14T01:22:55.542043+0000","last_fullsized":"2023-10-14T01:22:55.542043+0000","mapping_epoch":13,"log_start":"157'277823","ondisk_log_start":"157'277823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3650585097,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":288463,"num_read_kb":1115674,"num_write":281623,"num_write_kb":1126013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"160'289700","reported_seq":574385,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:52.024321+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:22:52.024321+0000","last_peered":"2023-10-14T01:22:52.024321+0000","last_clean":"2023-10-14T01:22:52.024321+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:22:52.024321+0000","last_undegraded":"2023-10-14T01:22:52.024321+0000","last_fullsized":"2023-10-14T01:22:52.024321+0000","mapping_epoch":13,"log_start":"157'279612","ondisk_log_start":"157'279612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3693912382,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":286222,"num_read_kb":1122110,"num_write":284312,"num_write_kb":1137087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"160'291154","reported_seq":578157,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:51.993303+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:22:51.993303+0000","last_peered":"2023-10-14T01:22:51.993303+0000","last_clean":"2023-10-14T01:22:51.993303+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:22:51.993303+0000","last_undegraded":"2023-10-14T01:22:51.993303+0000","last_fullsized":"2023-10-14T01:22:51.993303+0000","mapping_epoch":13,"log_start":"157'281116","ondisk_log_start":"157'281116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3726340647,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":288339,"num_read_kb":1131856,"num_write":285719,"num_write_kb":1142739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"160'330299","reported_seq":639194,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:22:51.942106+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:22:51.942106+0000","last_peered":"2023-10-14T01:22:51.942106+0000","last_clean":"2023-10-14T01:22:51.942106+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:22:51.942106+0000","last_undegraded":"2023-10-14T01:22:51.942106+0000","last_fullsized":"2023-10-14T01:22:51.942106+0000","mapping_epoch":13,"log_start":"158'320216","ondisk_log_start":"158'320216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1173,"log_size":10083,"log_dups_size":0,"ondisk_log_size":10083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 521s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3886731753,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":311479,"num_read_kb":1195014,"num_write":301040,"num_write_kb":1203505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":340,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:22:00.691314+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:22:00.691314+0000","last_peered":"2023-10-14T01:22:00.691314+0000","last_clean":"2023-10-14T01:22:00.691314+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:22:00.691314+0000","last_undegraded":"2023-10-14T01:22:00.691314+0000","last_fullsized":"2023-10-14T01:22:00.691314+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29477060531,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2315842,"num_read_kb":8999101,"num_write":2268269,"num_write_kb":9070265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18577870848,"data_stored":31150362470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80447,"ondisk_log_size":80447,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739360,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5049716,"kb_used_data":3484332,"kb_used_omap":668,"kb_used_meta":1564707,"kb_avail":89322124,"statfs":{"total":96636764160,"available":91465854976,"internally_reserved":0,"allocated":3567955968,"data_stored":5957864520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1602260262},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,3,0,3,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:21:53 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":0.91100000000000003,"15min":0.96199999999999997},"min":{"1min":0.19400000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":10.981999999999999,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":1.629,"5min":0.95799999999999996,"15min":1.0149999999999999},"min":{"1min":0.26700000000000002,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":11.039,"5min":11.039,"15min":11.039},"last":0.33800000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:21:53 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":0.71499999999999997,"15min":0.70599999999999996},"min":{"1min":0.218,"5min":0.20899999999999999,"15min":0.193},"max":{"1min":5.7560000000000002,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":1.28,"5min":0.83599999999999997,"15min":0.94499999999999995},"min":{"1min":0.24399999999999999,"5min":0.23300000000000001,"15min":0.23100000000000001},"max":{"1min":8.1899999999999995,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.30299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739343,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10051756,"kb_used_data":9070308,"kb_used_omap":1761,"kb_used_meta":979678,"kb_avail":84320084,"statfs":{"total":96636764160,"available":86343766016,"internally_reserved":0,"allocated":9287995392,"data_stored":15573932237,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1803653,"internal_metadata":1003190907},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,2,6,2,7,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:22:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.046,"15min":0.96499999999999997},"min":{"1min":0.19600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":6.673,"5min":9.8879999999999999,"15min":12.933},"last":0.32100000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":0.77600000000000002,"15min":1.0029999999999999},"min":{"1min":0.219,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":7.1120000000000001,"5min":10.029999999999999,"15min":17.196999999999999},"last":0.33800000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:22:44 2023","interfaces":[{"interface":"back","average":{"1min":2.125,"5min":2.1779999999999999,"15min":1.758},"min":{"1min":0.252,"5min":0.21099999999999999,"15min":0.183},"max":{"1min":9.8339999999999996,"5min":15.07,"15min":15.07},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.74099999999999999,"15min":0.67300000000000004},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.186},"max":{"1min":2.7730000000000001,"5min":5.9279999999999999,"15min":8.1430000000000007},"last":0.23899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739361,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6418252,"kb_used_data":5590404,"kb_used_omap":1047,"kb_used_meta":826792,"kb_avail":87953588,"statfs":{"total":96636764160,"available":90064474112,"internally_reserved":0,"allocated":5724573696,"data_stored":9619759999,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":846635253},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:22:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.91900000000000004,"15min":1.0960000000000001},"min":{"1min":0.19900000000000001,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":5.3300000000000001,"5min":7.7839999999999998,"15min":25.927},"last":0.378},{"interface":"front","average":{"1min":0.65800000000000003,"5min":1.0409999999999999,"15min":1.3280000000000001},"min":{"1min":0.222,"5min":0.221,"15min":0.188},"max":{"1min":3.1680000000000001,"5min":7.7409999999999997,"15min":26.632999999999999},"last":0.438}]},{"osd":2,"last update":"Sat Oct 14 01:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.93999999999999995,"15min":0.85599999999999998},"min":{"1min":0.255,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.298,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.39800000000000002},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.0920000000000001,"15min":0.92900000000000005},"min":{"1min":0.27700000000000002,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":5.3760000000000003,"5min":8.7360000000000007,"15min":8.7360000000000007},"last":0.41799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5723705344,"data_stored":9619200613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9287229440,"data_stored":15573475251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3566936064,"data_stored":5957686606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:22:55.936 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:55.936 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:55.936 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:55.937 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:55.938 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:22:55.938 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:22:55.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:55.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:55.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:55.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:55.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:55.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:55.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:55.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:55.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.976+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:55.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:55.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:55.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:57.805 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:22:57.800+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:22:57.806 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:22:57.804+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:22:58.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:58.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:22:58.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:58.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:22:58.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:58.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:58.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:58.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:58.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:58.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:58.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:58.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:22:58.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:58.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:58.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:58.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:58.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:58.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:59.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:58.996+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:59.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:59.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.028+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:59.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:22:59.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:22:59.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:22:59.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:22:59.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:22:59.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:22:59.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:22:59.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:22:59.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:22:59.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:22:59.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.180+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:22:59.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:22:59.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:01.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:01.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:01.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:01.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:01.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:01.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:01.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:01.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:01.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:01.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:01.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:01.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:01.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:01.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:01.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:01.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:01.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:01.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:01.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:01.068+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:01.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:01.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:01.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:01.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:02.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:23:02.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:02.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:23:02.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:02.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:02.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:02.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:02.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:02.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:02.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:02.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.464+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:02.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:02.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.468+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:02.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:02.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:02.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:02.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:02.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:02.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:02.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:02.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:02.984+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:03.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:03.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:03.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:03.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:03.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:03.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:03.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:03.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:03.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:03.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.212+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:03.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.216+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:03.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:03.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:03.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:06.012 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:23:06.012+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:23:06.043 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:23:06.044+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:23:06.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:06.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:06.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:06.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:06.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:06.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:06.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:06.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:06.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:06.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:06.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:06.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:06.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:06.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:06.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:06.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:06.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:06.604+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:06.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:06.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:06.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:06.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:07.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:23:07.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:07.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:23:07.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:07.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:07.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:07.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:07.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:07.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:07.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:07.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.604+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:07.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:07.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.640+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:07.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:07.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:07.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:07.888 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:23:07.888+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:23:08.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:08.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:08.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:08.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:08.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:08.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:08.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:08.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:08.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:08.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:08.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:08.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:08.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:08.516+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:08.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:08.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:08.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:08.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:08.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:08.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:23:09.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:09.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:23:09.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:09.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:09.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:09.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:09.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:09.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:09.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:09.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:09.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:09.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:09.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:09.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:09.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:09.112+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:09.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:09.112+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:09.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:09.112+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:09.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:09.112+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:09.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:09.112+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:13.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:13.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:13.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:13.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:13.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:13.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:13.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:13.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:13.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.744+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:13.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:13.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:13.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:13.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:13.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:13.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:13.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:13.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:13.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:13.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:13.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:14.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.008+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:14.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:14.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:14.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:14.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:14.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:14.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:14.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:14.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:14.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:14.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:14.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.488+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:14.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:14.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:14.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:15.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:15.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:15.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:15.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:15.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:15.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:15.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:15.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:15.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:15.216+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:15.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:15.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:15.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:15.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:15.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:15.216+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:15.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:15.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:15.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:15.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:15.939 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:23:16.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:16.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:23:16.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:16.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:16.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:16.650 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:16.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:16.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:16.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:16.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:16.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:16.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.744+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:16.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:16.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:16.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:16.885 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:23:16.886 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:23:16.931 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2654,"stamp":"2023-10-14T01:23:15.652505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29507695059,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2323531,"num_read_kb":9029456,"num_write":2276118,"num_write_kb":9103007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80436,"ondisk_log_size":80436,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":21801860,"kb_used_data":18202660,"kb_used_omap":3477,"kb_used_meta":3595690,"kb_avail":261313660,"statfs":{"total":289910292480,"available":267585187840,"internally_reserved":0,"allocated":18639523840,"data_stored":31210555540,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3561322,"internal_metadata":3681986710},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,6,6,8,13,14,10,6],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14376960,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3613,"num_read_kb":14416,"num_write":3710,"num_write_kb":14840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001562"},"pg_stats":[{"pgid":"2.7","version":"160'292721","reported_seq":573509,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:23:12.658962+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:23:12.658962+0000","last_peered":"2023-10-14T01:23:12.658962+0000","last_clean":"2023-10-14T01:23:12.658962+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:23:12.658962+0000","last_undegraded":"2023-10-14T01:23:12.658962+0000","last_fullsized":"2023-10-14T01:23:12.658962+0000","mapping_epoch":13,"log_start":"158'282717","ondisk_log_start":"158'282717","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2033,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 546s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3589747224,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":282667,"num_read_kb":1097840,"num_write":275855,"num_write_kb":1103073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'307141","reported_seq":605652,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:23:12.620013+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:23:12.620013+0000","last_peered":"2023-10-14T01:23:12.620013+0000","last_clean":"2023-10-14T01:23:12.620013+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:23:12.620013+0000","last_undegraded":"2023-10-14T01:23:12.620013+0000","last_fullsized":"2023-10-14T01:23:12.620013+0000","mapping_epoch":13,"log_start":"158'297116","ondisk_log_start":"158'297116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3796873434,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":302138,"num_read_kb":1164588,"num_write":291815,"num_write_kb":1166789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'285818","reported_seq":563316,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:23:12.633461+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:23:12.633461+0000","last_peered":"2023-10-14T01:23:12.633461+0000","last_clean":"2023-10-14T01:23:12.633461+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:23:12.633461+0000","last_undegraded":"2023-10-14T01:23:12.633461+0000","last_fullsized":"2023-10-14T01:23:12.633461+0000","mapping_epoch":13,"log_start":"158'275723","ondisk_log_start":"158'275723","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3565593280,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":279517,"num_read_kb":1089335,"num_write":274944,"num_write_kb":1099466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'284733","reported_seq":564034,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:23:12.633921+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:23:12.633921+0000","last_peered":"2023-10-14T01:23:12.633921+0000","last_clean":"2023-10-14T01:23:12.633921+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:23:12.633921+0000","last_undegraded":"2023-10-14T01:23:12.633921+0000","last_fullsized":"2023-10-14T01:23:12.633921+0000","mapping_epoch":13,"log_start":"158'274722","ondisk_log_start":"158'274722","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2053,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 495s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3582558890,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":280901,"num_read_kb":1098192,"num_write":276891,"num_write_kb":1107313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"160'288655","reported_seq":575817,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:23:10.665840+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:23:10.665840+0000","last_peered":"2023-10-14T01:23:10.665840+0000","last_clean":"2023-10-14T01:23:10.665840+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:23:10.665840+0000","last_undegraded":"2023-10-14T01:23:10.665840+0000","last_fullsized":"2023-10-14T01:23:10.665840+0000","mapping_epoch":13,"log_start":"158'278623","ondisk_log_start":"158'278623","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3653526025,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":289182,"num_read_kb":1118542,"num_write":282368,"num_write_kb":1128993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"160'290680","reported_seq":576322,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:23:12.095907+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:23:12.095907+0000","last_peered":"2023-10-14T01:23:12.095907+0000","last_clean":"2023-10-14T01:23:12.095907+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:23:12.095907+0000","last_undegraded":"2023-10-14T01:23:12.095907+0000","last_fullsized":"2023-10-14T01:23:12.095907+0000","mapping_epoch":13,"log_start":"158'280612","ondisk_log_start":"158'280612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3697709374,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":287176,"num_read_kb":1125910,"num_write":285286,"num_write_kb":1140983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"160'292196","reported_seq":580175,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:23:12.109637+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:23:12.109637+0000","last_peered":"2023-10-14T01:23:12.109637+0000","last_clean":"2023-10-14T01:23:12.109637+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:23:12.109637+0000","last_undegraded":"2023-10-14T01:23:12.109637+0000","last_fullsized":"2023-10-14T01:23:12.109637+0000","mapping_epoch":13,"log_start":"158'282116","ondisk_log_start":"158'282116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3730395687,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":289308,"num_read_kb":1135732,"num_write":286755,"num_write_kb":1146883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"160'331438","reported_seq":641430,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:23:12.621468+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:23:12.621468+0000","last_peered":"2023-10-14T01:23:12.621468+0000","last_clean":"2023-10-14T01:23:12.621468+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:23:12.621468+0000","last_undegraded":"2023-10-14T01:23:12.621468+0000","last_fullsized":"2023-10-14T01:23:12.621468+0000","mapping_epoch":13,"log_start":"158'321416","ondisk_log_start":"158'321416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1221,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 541s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3890700777,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":312536,"num_read_kb":1199226,"num_write":302067,"num_write_kb":1207613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":340,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-10-14T01:22:00.691314+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:22:00.691314+0000","last_peered":"2023-10-14T01:22:00.691314+0000","last_clean":"2023-10-14T01:22:00.691314+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:22:00.691314+0000","last_undegraded":"2023-10-14T01:22:00.691314+0000","last_fullsized":"2023-10-14T01:22:00.691314+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29507104691,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2323425,"num_read_kb":9029365,"num_write":2275981,"num_write_kb":9101113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18638045184,"data_stored":31210536806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80337,"ondisk_log_size":80337,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739364,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5093564,"kb_used_data":3496244,"kb_used_omap":668,"kb_used_meta":1596643,"kb_avail":89278276,"statfs":{"total":96636764160,"available":91420954624,"internally_reserved":0,"allocated":3580153856,"data_stored":5970062408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1634962726},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1,0,3,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:22:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.88,"15min":0.91500000000000004},"min":{"1min":0.26200000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":2.5569999999999999,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.93300000000000005,"15min":0.96599999999999997},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":2.581,"5min":11.039,"15min":11.039},"last":0.434}]},{"osd":1,"last update":"Sat Oct 14 01:22:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.73399999999999999,"15min":0.68999999999999995},"min":{"1min":0.223,"5min":0.218,"15min":0.193},"max":{"1min":1.3420000000000001,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":4.7199999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.77600000000000002,"15min":0.87},"min":{"1min":0.25900000000000001,"5min":0.24399999999999999,"15min":0.23100000000000001},"max":{"1min":0.75800000000000001,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.47099999999999997}]}]},{"osd":1,"up_from":8,"seq":34359739347,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10243636,"kb_used_data":9101544,"kb_used_omap":1761,"kb_used_meta":1140318,"kb_avail":84128204,"statfs":{"total":96636764160,"available":86147280896,"internally_reserved":0,"allocated":9319981056,"data_stored":15605917901,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1803653,"internal_metadata":1167686267},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,5,4,12,7,7,6],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:22:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.046,"15min":0.96499999999999997},"min":{"1min":0.19600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":6.673,"5min":9.8879999999999999,"15min":12.933},"last":0.44},{"interface":"front","average":{"1min":1.2450000000000001,"5min":0.77600000000000002,"15min":1.0029999999999999},"min":{"1min":0.219,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":7.1120000000000001,"5min":10.029999999999999,"15min":17.196999999999999},"last":1.333}]},{"osd":2,"last update":"Sat Oct 14 01:22:44 2023","interfaces":[{"interface":"back","average":{"1min":2.125,"5min":2.1779999999999999,"15min":1.758},"min":{"1min":0.252,"5min":0.21099999999999999,"15min":0.183},"max":{"1min":9.8339999999999996,"5min":15.07,"15min":15.07},"last":1.3560000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.74099999999999999,"15min":0.67300000000000004},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.186},"max":{"1min":2.7730000000000001,"5min":5.9279999999999999,"15min":8.1430000000000007},"last":1.234}]}]},{"osd":0,"up_from":8,"seq":34359739364,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6464660,"kb_used_data":5604872,"kb_used_omap":1047,"kb_used_meta":858728,"kb_avail":87907180,"statfs":{"total":96636764160,"available":90016952320,"internally_reserved":0,"allocated":5739388928,"data_stored":9634575231,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":879337717},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,3,1,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:22:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.91900000000000004,"15min":1.0960000000000001},"min":{"1min":0.19900000000000001,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":5.3300000000000001,"5min":7.7839999999999998,"15min":25.927},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":1.0409999999999999,"15min":1.3280000000000001},"min":{"1min":0.222,"5min":0.221,"15min":0.188},"max":{"1min":3.1680000000000001,"5min":7.7409999999999997,"15min":26.632999999999999},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Oct 14 01:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.93999999999999995,"15min":0.85599999999999998},"min":{"1min":0.255,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.298,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.23100000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.0920000000000001,"15min":0.92900000000000005},"min":{"1min":0.27700000000000002,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":5.3760000000000003,"5min":8.7360000000000007,"15min":8.7360000000000007},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5738655744,"data_stored":9634151013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9320120320,"data_stored":15606366131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3579269120,"data_stored":5970019662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:23:16.932 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:23:16.933 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:23:16.933 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:23:16.934 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:23:16.934 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:23:16.935 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:23:23.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:23.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:23.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:23.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:23.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:23.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:23.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:23.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:23.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:23.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:23.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:23.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:23.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:23.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:23.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:23.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:23.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:23.784+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:23.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:23.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:23.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:23.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:26.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:26.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:26.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:26.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:26.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:26.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:26.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:26.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:26.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.188+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:26.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:26.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:26.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:26.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:26.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:26.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:26.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:26.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:26.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:26.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.424+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:26.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:26.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:26.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:26.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:26.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:26.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:26.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:26.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:26.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:26.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:26.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:26.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:26.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.924+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:26.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:26.924+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:27.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:27.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:27.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:27.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:27.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:27.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:23:27.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:27.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:27.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:27.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:27.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:27.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:27.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.204+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:23:27.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:27.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:27.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:27.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:27.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:27.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:27.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:27.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:27.537 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:27.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.544+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:27.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:27.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:27.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:27.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:27.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:27.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.624+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:27.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.624+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:27.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:27.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:27.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:27.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:27.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:27.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:27.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:27.804+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:29.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:29.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:29.137 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:29.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:29.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:29.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:29.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:29.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:32.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:32.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:32.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:32.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:32.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:32.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:32.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:32.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:32.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:32.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:32.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:32.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:32.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:32.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:32.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:32.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:32.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:32.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:32.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:32.912+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:32.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:32.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:32.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:32.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:33.199 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:23:33.196+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:23:33.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:33.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:33.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:33.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:33.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:33.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:33.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:33.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:33.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:33.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:36.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:36.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:36.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:36.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:36.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:36.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.419+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:36.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:36.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:36.527 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:23:36.523+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:23:36.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:36.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:36.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:36.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.851+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:36.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.863+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:36.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:36.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.883+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:36.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.895+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:36.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:36.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.911+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:36.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:36.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:36.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:36.936 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:23:37.897 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:23:37.898 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:23:37.928 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2665,"stamp":"2023-10-14T01:23:37.664850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29541757395,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2332196,"num_read_kb":9064036,"num_write":2284797,"num_write_kb":9137723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80434,"ondisk_log_size":80434,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22209424,"kb_used_data":18275892,"kb_used_omap":3477,"kb_used_meta":3930026,"kb_avail":260906096,"statfs":{"total":289910292480,"available":267167842304,"internally_reserved":0,"allocated":18714513408,"data_stored":31285532121,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3561322,"internal_metadata":4024346774},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,5,6,11,17,12,8],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18169856,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4656,"num_read_kb":18592,"num_write":4620,"num_write_kb":18480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006832"},"pg_stats":[{"pgid":"2.7","version":"161'293772","reported_seq":575555,"reported_epoch":161,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:23:33.192742+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:23:33.192742+0000","last_peered":"2023-10-14T01:23:33.192742+0000","last_clean":"2023-10-14T01:23:33.192742+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:23:33.192742+0000","last_undegraded":"2023-10-14T01:23:33.192742+0000","last_fullsized":"2023-10-14T01:23:33.192742+0000","mapping_epoch":13,"log_start":"158'283717","ondisk_log_start":"158'283717","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2137,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 566s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3593486872,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":283639,"num_read_kb":1101720,"num_write":276782,"num_write_kb":1106781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"161'308219","reported_seq":607744,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:23:33.188998+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:23:33.188998+0000","last_peered":"2023-10-14T01:23:33.188998+0000","last_clean":"2023-10-14T01:23:33.188998+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:23:33.188998+0000","last_undegraded":"2023-10-14T01:23:33.188998+0000","last_fullsized":"2023-10-14T01:23:33.188998+0000","mapping_epoch":13,"log_start":"158'298216","ondisk_log_start":"158'298216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3800940762,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":303136,"num_read_kb":1168572,"num_write":292845,"num_write_kb":1170909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"161'286827","reported_seq":565278,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:23:33.177212+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:23:33.177212+0000","last_peered":"2023-10-14T01:23:33.177212+0000","last_clean":"2023-10-14T01:23:33.177212+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:23:33.177212+0000","last_undegraded":"2023-10-14T01:23:33.177212+0000","last_fullsized":"2023-10-14T01:23:33.177212+0000","mapping_epoch":13,"log_start":"158'276823","ondisk_log_start":"158'276823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3569369792,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":280461,"num_read_kb":1093099,"num_write":275921,"num_write_kb":1103374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"161'285823","reported_seq":566097,"reported_epoch":161,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:23:33.193969+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:23:33.193969+0000","last_peered":"2023-10-14T01:23:33.193969+0000","last_clean":"2023-10-14T01:23:33.193969+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:23:33.193969+0000","last_undegraded":"2023-10-14T01:23:33.193969+0000","last_fullsized":"2023-10-14T01:23:33.193969+0000","mapping_epoch":13,"log_start":"158'275822","ondisk_log_start":"158'275822","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2147,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 516s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3586470570,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":281858,"num_read_kb":1102004,"num_write":277895,"num_write_kb":1111329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"161'289884","reported_seq":578323,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:23:35.996539+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:23:35.996539+0000","last_peered":"2023-10-14T01:23:35.996539+0000","last_clean":"2023-10-14T01:23:35.996539+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:23:35.996539+0000","last_undegraded":"2023-10-14T01:23:35.996539+0000","last_fullsized":"2023-10-14T01:23:35.996539+0000","mapping_epoch":13,"log_start":"158'279823","ondisk_log_start":"158'279823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3658314249,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":290444,"num_read_kb":1123590,"num_write":283594,"num_write_kb":1133897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"161'291887","reported_seq":578711,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:23:37.220577+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:23:37.220577+0000","last_peered":"2023-10-14T01:23:37.220577+0000","last_clean":"2023-10-14T01:23:37.220577+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:23:37.220577+0000","last_undegraded":"2023-10-14T01:23:37.220577+0000","last_fullsized":"2023-10-14T01:23:37.220577+0000","mapping_epoch":13,"log_start":"158'281812","ondisk_log_start":"158'281812","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3702427966,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":288347,"num_read_kb":1130586,"num_write":286488,"num_write_kb":1145791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"161'293412","reported_seq":582632,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:23:37.225436+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:23:37.225436+0000","last_peered":"2023-10-14T01:23:37.225436+0000","last_clean":"2023-10-14T01:23:37.225436+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:23:37.225436+0000","last_undegraded":"2023-10-14T01:23:37.225436+0000","last_fullsized":"2023-10-14T01:23:37.225436+0000","mapping_epoch":13,"log_start":"158'283316","ondisk_log_start":"158'283316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3735171623,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":290544,"num_read_kb":1140664,"num_write":287966,"num_write_kb":1151727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"161'332656","reported_seq":643803,"reported_epoch":161,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:23:33.162540+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:23:33.162540+0000","last_peered":"2023-10-14T01:23:33.162540+0000","last_clean":"2023-10-14T01:23:33.162540+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:23:33.162540+0000","last_undegraded":"2023-10-14T01:23:33.162540+0000","last_fullsized":"2023-10-14T01:23:33.162540+0000","mapping_epoch":13,"log_start":"158'322616","ondisk_log_start":"158'322616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1262,"log_size":10040,"log_dups_size":0,"ondisk_log_size":10040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 562s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3894985193,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":313661,"num_read_kb":1203710,"num_write":303169,"num_write_kb":1212021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":341,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:05.233726+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:22:05.233726+0000","last_peered":"2023-10-14T01:22:05.233726+0000","last_clean":"2023-10-14T01:22:05.233726+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:22:05.233726+0000","last_undegraded":"2023-10-14T01:22:05.233726+0000","last_fullsized":"2023-10-14T01:22:05.233726+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29541167027,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2332090,"num_read_kb":9063945,"num_write":2284660,"num_write_kb":9135829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18711384064,"data_stored":31283875686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80335,"ondisk_log_size":80335,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739369,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5183528,"kb_used_data":3511840,"kb_used_omap":668,"kb_used_meta":1671011,"kb_avail":89188312,"statfs":{"total":96636764160,"available":91328831488,"internally_reserved":0,"allocated":3596124160,"data_stored":5986028383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1711115558},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,3,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:22:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.88,"15min":0.91500000000000004},"min":{"1min":0.26200000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":2.5569999999999999,"5min":10.981999999999999,"15min":10.981999999999999},"last":2.0569999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.93300000000000005,"15min":0.96599999999999997},"min":{"1min":0.32000000000000001,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":2.581,"5min":11.039,"15min":11.039},"last":2.0990000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:22:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.73399999999999999,"15min":0.68999999999999995},"min":{"1min":0.223,"5min":0.218,"15min":0.193},"max":{"1min":1.3420000000000001,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.77600000000000002,"15min":0.87},"min":{"1min":0.25900000000000001,"5min":0.24399999999999999,"15min":0.23100000000000001},"max":{"1min":0.75800000000000001,"5min":8.3699999999999992,"15min":11.082000000000001},"last":0.29099999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739351,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10436996,"kb_used_data":9134908,"kb_used_omap":1761,"kb_used_meta":1300318,"kb_avail":83934844,"statfs":{"total":96636764160,"available":85949280256,"internally_reserved":0,"allocated":9354145792,"data_stored":15640078308,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1803653,"internal_metadata":1331526267},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,1,5,6,7,8,8],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:22:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.046,"15min":0.96499999999999997},"min":{"1min":0.19600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":6.673,"5min":9.8879999999999999,"15min":12.933},"last":0.56100000000000005},{"interface":"front","average":{"1min":1.2450000000000001,"5min":0.77600000000000002,"15min":1.0029999999999999},"min":{"1min":0.219,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":7.1120000000000001,"5min":10.029999999999999,"15min":17.196999999999999},"last":0.51700000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:22:44 2023","interfaces":[{"interface":"back","average":{"1min":2.125,"5min":2.1779999999999999,"15min":1.758},"min":{"1min":0.252,"5min":0.21099999999999999,"15min":0.183},"max":{"1min":9.8339999999999996,"5min":15.07,"15min":15.07},"last":4.8799999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.74099999999999999,"15min":0.67300000000000004},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.186},"max":{"1min":2.7730000000000001,"5min":5.9279999999999999,"15min":8.1430000000000007},"last":0.58999999999999997}]}]},{"osd":0,"up_from":8,"seq":34359739369,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6588900,"kb_used_data":5629144,"kb_used_omap":1047,"kb_used_meta":958696,"kb_avail":87782940,"statfs":{"total":96636764160,"available":89889730560,"internally_reserved":0,"allocated":5764243456,"data_stored":9659425430,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":981704949},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,0,2,4,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:22:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.91900000000000004,"15min":1.0960000000000001},"min":{"1min":0.19900000000000001,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":5.3300000000000001,"5min":7.7839999999999998,"15min":25.927},"last":2.7599999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":1.0409999999999999,"15min":1.3280000000000001},"min":{"1min":0.222,"5min":0.221,"15min":0.188},"max":{"1min":3.1680000000000001,"5min":7.7409999999999997,"15min":26.632999999999999},"last":2.637}]},{"osd":2,"last update":"Sat Oct 14 01:22:45 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.93999999999999995,"15min":0.85599999999999998},"min":{"1min":0.255,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":5.298,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.30499999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.0920000000000001,"15min":0.92900000000000005},"min":{"1min":0.27700000000000002,"5min":0.23499999999999999,"15min":0.216},"max":{"1min":5.3760000000000003,"5min":8.7360000000000007,"15min":8.7360000000000007},"last":0.49299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5763710976,"data_stored":9659206245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9352994816,"data_stored":15639240627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3594678272,"data_stored":5985428814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:23:37.929 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:23:37.929 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:23:37.930 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:23:37.930 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:23:37.931 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:23:37.931 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-10-14T01:23:38.217 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:23:38.215+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:23:38.278 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:23:38.275+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:23:38.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:38.560 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-10-14T01:23:38.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:23:38.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:38.612 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:23:38.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:38.673 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:38.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:38.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:38.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:38.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:38.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:38.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.711+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:38.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.719+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:38.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:38.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:38.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:39.434 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:23:39.513 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T01:23:40.363 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T01:23:40.405 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-10-14T01:23:40.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:40.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:40.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:40.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:40.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:40.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:40.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:40.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:40.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:40.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:40.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:40.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:40.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:40.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:40.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:40.499+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:40.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:40.503+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:40.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:40.503+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:40.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:40.503+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:41.199 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-10-14T01:23:41.243 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T01:23:42.152 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T01:23:42.205 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:23:43.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:23:43.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:43.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:23:43.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:43.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:43.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:43.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:43.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:43.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:43.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:43.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:43.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.811+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:43.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:43.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:43.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:45.012 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:23:45.011+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:23:46.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:46.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:46.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:46.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:46.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:46.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:46.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:46.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:46.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:46.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:46.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.695+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:46.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:46.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:46.695+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:49.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:49.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:49.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:49.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:49.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:49.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:49.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:49.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:49.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:49.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:49.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:49.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:49.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:49.143+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:49.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:49.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:49.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:49.143+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:51.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:51.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:51.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:51.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:51.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:51.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:51.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.271+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:51.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.271+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:51.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:23:51.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:51.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:51.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:51.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:51.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:51.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:51.339+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:51.738 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:23:51.735+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:23:52.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:52.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:23:52.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:52.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:52.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:52.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:52.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:52.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:52.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:52.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:52.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:52.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:52.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:52.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:52.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:52.227+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:52.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:52.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:52.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:52.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:53.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:23:53.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:53.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:53.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:53.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:53.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:53.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:53.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:53.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:53.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:53.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:53.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:53.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:53.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:55.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:55.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:23:55.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:55.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:23:55.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:55.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:23:55.938 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:23:55.935+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:23:55.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:55.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:23:55.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:55.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:55.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:55.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:55.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:55.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:55.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:55.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:55.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:55.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:55.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:55.967+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:55.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:55.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:55.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:55.967+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:23:58.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:58.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:23:58.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:58.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:23:58.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:58.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:23:58.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:58.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:23:58.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:58.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:23:58.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:58.451+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:23:58.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:58.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:23:58.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:23:58.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:00.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:00.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:00.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:00.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:00.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:00.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:00.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:00.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:00.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:00.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:00.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:00.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:00.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:00.839+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:00.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:00.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:00.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:00.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:01.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:01.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:24:01.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:01.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:01.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:01.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:01.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:01.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:01.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:01.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:02.206 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:24:02.986 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:24:02.987 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:24:03.062 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2677,"stamp":"2023-10-14T01:24:01.674841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29578740179,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2341169,"num_read_kb":9099812,"num_write":2294333,"num_write_kb":9175867,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80570,"ondisk_log_size":80570,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22659976,"kb_used_data":18352356,"kb_used_omap":3477,"kb_used_meta":4304106,"kb_avail":260455544,"statfs":{"total":289910292480,"available":266706477056,"internally_reserved":0,"allocated":18792812544,"data_stored":31363831257,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3561322,"internal_metadata":4407404694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3,7,15,9,14,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16740352,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4078,"num_read_kb":16268,"num_write":4324,"num_write_kb":17296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001986"},"pg_stats":[{"pgid":"2.7","version":"161'295136","reported_seq":578060,"reported_epoch":161,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:23:58.913726+0000","last_change":"2023-10-14T01:14:06.405667+0000","last_active":"2023-10-14T01:23:58.913726+0000","last_peered":"2023-10-14T01:23:58.913726+0000","last_clean":"2023-10-14T01:23:58.913726+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:23:58.913726+0000","last_undegraded":"2023-10-14T01:23:58.913726+0000","last_fullsized":"2023-10-14T01:23:58.913726+0000","mapping_epoch":13,"log_start":"158'285117","ondisk_log_start":"158'285117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2231,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 592s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3598451224,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":284758,"num_read_kb":1106172,"num_write":278033,"num_write_kb":1111785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"161'309547","reported_seq":610296,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:23:58.958049+0000","last_change":"2023-10-14T00:36:03.651649+0000","last_active":"2023-10-14T01:23:58.958049+0000","last_peered":"2023-10-14T01:23:58.958049+0000","last_clean":"2023-10-14T01:23:58.958049+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:23:58.958049+0000","last_undegraded":"2023-10-14T01:23:58.958049+0000","last_fullsized":"2023-10-14T01:23:58.958049+0000","mapping_epoch":13,"log_start":"158'299516","ondisk_log_start":"158'299516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3805966554,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":304348,"num_read_kb":1173412,"num_write":294134,"num_write_kb":1176065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"161'288104","reported_seq":567776,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:23:58.921421+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:23:58.921421+0000","last_peered":"2023-10-14T01:23:58.921421+0000","last_clean":"2023-10-14T01:23:58.921421+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:23:58.921421+0000","last_undegraded":"2023-10-14T01:23:58.921421+0000","last_fullsized":"2023-10-14T01:23:58.921421+0000","mapping_epoch":13,"log_start":"158'278023","ondisk_log_start":"158'278023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3574186688,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":281672,"num_read_kb":1097923,"num_write":277170,"num_write_kb":1108370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"161'287190","reported_seq":568601,"reported_epoch":161,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:23:58.960393+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:23:58.960393+0000","last_peered":"2023-10-14T01:23:58.960393+0000","last_clean":"2023-10-14T01:23:58.960393+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:23:58.960393+0000","last_undegraded":"2023-10-14T01:23:58.960393+0000","last_fullsized":"2023-10-14T01:23:58.960393+0000","mapping_epoch":13,"log_start":"158'277122","ondisk_log_start":"158'277122","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2234,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 541s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3591377578,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":282981,"num_read_kb":1106480,"num_write":279183,"num_write_kb":1116481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"161'291103","reported_seq":580746,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:24:01.252723+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:24:01.252723+0000","last_peered":"2023-10-14T01:24:01.252723+0000","last_clean":"2023-10-14T01:24:01.252723+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:24:01.252723+0000","last_undegraded":"2023-10-14T01:24:01.252723+0000","last_fullsized":"2023-10-14T01:24:01.252723+0000","mapping_epoch":13,"log_start":"158'281023","ondisk_log_start":"158'281023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3663045129,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":291633,"num_read_kb":1128342,"num_write":284807,"num_write_kb":1138749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"161'292861","reported_seq":580615,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:23:57.479391+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:23:57.479391+0000","last_peered":"2023-10-14T01:23:57.479391+0000","last_clean":"2023-10-14T01:23:57.479391+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:23:57.479391+0000","last_undegraded":"2023-10-14T01:23:57.479391+0000","last_fullsized":"2023-10-14T01:23:57.479391+0000","mapping_epoch":13,"log_start":"158'282812","ondisk_log_start":"158'282812","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3706151230,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":289275,"num_read_kb":1134282,"num_write":287451,"num_write_kb":1149643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"161'294407","reported_seq":584561,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:23:57.435809+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:23:57.435809+0000","last_peered":"2023-10-14T01:23:57.435809+0000","last_clean":"2023-10-14T01:23:57.435809+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:23:57.435809+0000","last_undegraded":"2023-10-14T01:23:57.435809+0000","last_fullsized":"2023-10-14T01:23:57.435809+0000","mapping_epoch":13,"log_start":"158'284316","ondisk_log_start":"158'284316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3739038247,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":291476,"num_read_kb":1144372,"num_write":288950,"num_write_kb":1155663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"161'334068","reported_seq":646511,"reported_epoch":161,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:23:58.904302+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:23:58.904302+0000","last_peered":"2023-10-14T01:23:58.904302+0000","last_clean":"2023-10-14T01:23:58.904302+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:23:58.904302+0000","last_undegraded":"2023-10-14T01:23:58.904302+0000","last_fullsized":"2023-10-14T01:23:58.904302+0000","mapping_epoch":13,"log_start":"159'324016","ondisk_log_start":"159'324016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1306,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 588s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3899933161,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":314920,"num_read_kb":1208738,"num_write":304468,"num_write_kb":1217217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":341,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-10-14T01:22:05.233726+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:22:05.233726+0000","last_peered":"2023-10-14T01:22:05.233726+0000","last_clean":"2023-10-14T01:22:05.233726+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:22:05.233726+0000","last_undegraded":"2023-10-14T01:22:05.233726+0000","last_fullsized":"2023-10-14T01:22:05.233726+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29578149811,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2341063,"num_read_kb":9099721,"num_write":2294196,"num_write_kb":9173973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6069,"num_omap_keys":80,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18789826560,"data_stored":31362318182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80471,"ondisk_log_size":80471,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739373,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5263340,"kb_used_data":3523620,"kb_used_omap":668,"kb_used_meta":1739043,"kb_avail":89108500,"statfs":{"total":96636764160,"available":91247104000,"internally_reserved":0,"allocated":3608186880,"data_stored":5998091103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1780780326},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,3,0,2,3,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.84999999999999998,"15min":0.872},"min":{"1min":0.21199999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":2.0569999999999999,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.90400000000000003,"15min":0.92200000000000004},"min":{"1min":0.28899999999999998,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":2.0990000000000002,"5min":11.039,"15min":11.039},"last":0.45300000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77200000000000002,"15min":0.72299999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":4.7199999999999998,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":1.02},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.68500000000000005,"15min":0.83299999999999996},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.23100000000000001},"max":{"1min":2.5059999999999998,"5min":8.1899999999999995,"15min":11.082000000000001},"last":0.371}]}]},{"osd":1,"up_from":8,"seq":34359739356,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10656860,"kb_used_data":9174280,"kb_used_omap":1761,"kb_used_meta":1480798,"kb_avail":83714980,"statfs":{"total":96636764160,"available":85724139520,"internally_reserved":0,"allocated":9394462720,"data_stored":15680395236,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1803653,"internal_metadata":1516337787},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,4,15,4,9,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.78900000000000003,"15min":0.93200000000000005},"min":{"1min":0.28199999999999997,"5min":0.183,"15min":0.183},"max":{"1min":0.56399999999999995,"5min":6.673,"15min":12.933},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71399999999999997,"15min":0.94799999999999995},"min":{"1min":0.219,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":4.8630000000000004,"5min":7.1120000000000001,"15min":17.196999999999999},"last":0.40899999999999997}]},{"osd":2,"last update":"Sat Oct 14 01:23:45 2023","interfaces":[{"interface":"back","average":{"1min":1.9870000000000001,"5min":2.2149999999999999,"15min":1.8129999999999999},"min":{"1min":0.23999999999999999,"5min":0.21099999999999999,"15min":0.20699999999999999},"max":{"1min":17.547999999999998,"5min":17.547999999999998,"15min":17.547999999999998},"last":0.34000000000000002},{"interface":"front","average":{"1min":1.04,"5min":0.70299999999999996,"15min":0.71199999999999997},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.186},"max":{"1min":11.323,"5min":11.323,"15min":11.323},"last":0.44900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6739776,"kb_used_data":5654456,"kb_used_omap":1047,"kb_used_meta":1084264,"kb_avail":87632064,"statfs":{"total":96636764160,"available":89735233536,"internally_reserved":0,"allocated":5790162944,"data_stored":9685344918,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":1110286581},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,3,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:23:47 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.083,"15min":1.1419999999999999},"min":{"1min":0.27400000000000002,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":6.7160000000000002,"5min":7.7839999999999998,"15min":25.927},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94899999999999995,"15min":1.302},"min":{"1min":0.246,"5min":0.221,"15min":0.188},"max":{"1min":6.6280000000000001,"5min":7.7409999999999997,"15min":26.632999999999999},"last":0.34100000000000003}]},{"osd":2,"last update":"Sat Oct 14 01:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.92600000000000005,"15min":0.85899999999999999},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.1879999999999997,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.38300000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.028,"15min":0.94699999999999995},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.216},"max":{"1min":9.4649999999999999,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.32400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5788798976,"data_stored":9684294245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9394216960,"data_stored":15680462771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3606810624,"data_stored":5997561166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:24:03.064 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:24:03.064 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:24:03.065 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:24:03.065 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:24:03.066 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:24:03.066 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:24:03.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:03.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:24:03.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:03.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:03.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:03.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:03.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:03.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:03.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:03.695+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:03.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:03.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:03.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:03.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:03.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:03.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:03.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:03.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:03.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:03.719+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:03.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:03.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:03.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:03.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:05.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:05.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:24:05.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:05.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:05.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:05.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:05.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:05.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:05.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:05.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:05.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:05.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:05.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:05.323+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:05.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:05.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:05.542 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:24:05.539+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:24:06.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:06.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:06.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:06.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:06.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:06.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:06.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:06.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:06.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:06.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:06.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:06.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:06.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:06.279+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:06.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:06.287+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:06.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:06.291+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:06.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:06.291+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:11.983 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:24:11.979+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:24:14.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:14.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:24:14.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:14.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:24:14.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:14.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:14.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:14.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:14.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:14.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:14.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:14.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:14.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:14.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:14.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:14.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:14.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:14.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:14.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:14.147+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:14.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:14.159+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:14.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:14.159+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:17.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:17.786 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:17.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:17.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:17.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:17.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:17.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:17.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:17.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.851+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:17.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:17.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:17.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:17.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:17.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:17.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:18.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:18.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:18.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:18.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:24:18.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:18.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:18.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:18.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:18.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:18.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:18.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:19.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.999+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:19.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:19.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:18.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:22.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:22.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:22.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:22.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:22.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:22.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:22.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:22.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:22.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:22.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:22.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:22.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:22.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:22.551+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:23.067 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:24:23.905 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:24:23.906 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:24:23.973 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2688,"stamp":"2023-10-14T01:24:23.678453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29612421587,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2349700,"num_read_kb":9133832,"num_write":2302935,"num_write_kb":9210275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8460,"num_omap_keys":114,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80385,"ondisk_log_size":80385,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22960024,"kb_used_data":18420992,"kb_used_omap":3477,"kb_used_meta":4535530,"kb_avail":260155496,"statfs":{"total":289910292480,"available":266399227904,"internally_reserved":0,"allocated":18863095808,"data_stored":31434114521,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3561322,"internal_metadata":4644382870},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,4,6,13,12,14,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17899520,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4468,"num_read_kb":17812,"num_write":4588,"num_write_kb":18352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001993"},"pg_stats":[{"pgid":"2.7","version":"161'296151","reported_seq":580107,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:24:19.512929+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:24:19.512929+0000","last_peered":"2023-10-14T01:24:19.512929+0000","last_clean":"2023-10-14T01:24:19.512929+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:24:19.512929+0000","last_undegraded":"2023-10-14T01:24:19.512929+0000","last_fullsized":"2023-10-14T01:24:19.512929+0000","mapping_epoch":13,"log_start":"159'286117","ondisk_log_start":"159'286117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3602186776,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":285762,"num_read_kb":1110176,"num_write":278967,"num_write_kb":1115521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"161'310621","reported_seq":612426,"reported_epoch":161,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:24:19.515516+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:24:19.515516+0000","last_peered":"2023-10-14T01:24:19.515516+0000","last_clean":"2023-10-14T01:24:19.515516+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:24:19.515516+0000","last_undegraded":"2023-10-14T01:24:19.515516+0000","last_fullsized":"2023-10-14T01:24:19.515516+0000","mapping_epoch":13,"log_start":"159'300616","ondisk_log_start":"159'300616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":17,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 5s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3810037978,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":305389,"num_read_kb":1177560,"num_write":295169,"num_write_kb":1180205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"161'289072","reported_seq":569736,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:24:19.521114+0000","last_change":"2023-10-14T00:36:03.649769+0000","last_active":"2023-10-14T01:24:19.521114+0000","last_peered":"2023-10-14T01:24:19.521114+0000","last_clean":"2023-10-14T01:24:19.521114+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:24:19.521114+0000","last_undegraded":"2023-10-14T01:24:19.521114+0000","last_fullsized":"2023-10-14T01:24:19.521114+0000","mapping_epoch":13,"log_start":"158'279023","ondisk_log_start":"158'279023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":0,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3577938624,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":282656,"num_read_kb":1101851,"num_write":278120,"num_write_kb":1112170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"161'288280","reported_seq":570690,"reported_epoch":161,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:24:19.522190+0000","last_change":"2023-10-14T01:14:57.005703+0000","last_active":"2023-10-14T01:24:19.522190+0000","last_peered":"2023-10-14T01:24:19.522190+0000","last_clean":"2023-10-14T01:24:19.522190+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:24:19.522190+0000","last_undegraded":"2023-10-14T01:24:19.522190+0000","last_fullsized":"2023-10-14T01:24:19.522190+0000","mapping_epoch":13,"log_start":"159'278222","ondisk_log_start":"159'278222","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2310,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 562s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3595313834,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":283969,"num_read_kb":1110428,"num_write":280205,"num_write_kb":1120569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"161'292135","reported_seq":582773,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:24:21.416320+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:24:21.416320+0000","last_peered":"2023-10-14T01:24:21.416320+0000","last_clean":"2023-10-14T01:24:21.416320+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:24:21.416320+0000","last_undegraded":"2023-10-14T01:24:21.416320+0000","last_fullsized":"2023-10-14T01:24:21.416320+0000","mapping_epoch":13,"log_start":"159'282123","ondisk_log_start":"159'282123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10012,"log_dups_size":0,"ondisk_log_size":10012,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3667046921,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":292616,"num_read_kb":1132274,"num_write":285830,"num_write_kb":1142841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"161'294157","reported_seq":583102,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:24:22.707985+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:24:22.707985+0000","last_peered":"2023-10-14T01:24:22.707985+0000","last_clean":"2023-10-14T01:24:22.707985+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:24:22.707985+0000","last_undegraded":"2023-10-14T01:24:22.707985+0000","last_fullsized":"2023-10-14T01:24:22.707985+0000","mapping_epoch":13,"log_start":"159'284112","ondisk_log_start":"159'284112","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3711209790,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":290461,"num_read_kb":1138998,"num_write":288739,"num_write_kb":1154795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"161'295652","reported_seq":587076,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:24:22.676136+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:24:22.676136+0000","last_peered":"2023-10-14T01:24:22.676136+0000","last_clean":"2023-10-14T01:24:22.676136+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:24:22.676136+0000","last_undegraded":"2023-10-14T01:24:22.676136+0000","last_fullsized":"2023-10-14T01:24:22.676136+0000","mapping_epoch":13,"log_start":"159'285616","ondisk_log_start":"159'285616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3743892007,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":292740,"num_read_kb":1149404,"num_write":290187,"num_write_kb":1160611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"161'335263","reported_seq":648819,"reported_epoch":161,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:24:19.493668+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:24:19.493668+0000","last_peered":"2023-10-14T01:24:19.493668+0000","last_clean":"2023-10-14T01:24:19.493668+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:24:19.493668+0000","last_undegraded":"2023-10-14T01:24:19.493668+0000","last_fullsized":"2023-10-14T01:24:19.493668+0000","mapping_epoch":13,"log_start":"159'325216","ondisk_log_start":"159'325216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1345,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 608s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3904205289,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":316001,"num_read_kb":1213050,"num_write":305581,"num_write_kb":1221669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":342,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:23:15.255658+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:23:15.255658+0000","last_peered":"2023-10-14T01:23:15.255658+0000","last_clean":"2023-10-14T01:23:15.255658+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:23:15.255658+0000","last_undegraded":"2023-10-14T01:23:15.255658+0000","last_fullsized":"2023-10-14T01:23:15.255658+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29611831219,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2349594,"num_read_kb":9133741,"num_write":2302798,"num_write_kb":9208381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8460,"num_omap_keys":114,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18859020288,"data_stored":31431511910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80286,"ondisk_log_size":80286,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739378,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5321256,"kb_used_data":3538912,"kb_used_omap":668,"kb_used_meta":1781667,"kb_avail":89050584,"statfs":{"total":96636764160,"available":91187798016,"internally_reserved":0,"allocated":3623845888,"data_stored":6013750111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1824427302},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,8,3,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.84999999999999998,"15min":0.872},"min":{"1min":0.21199999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":2.0569999999999999,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.90400000000000003,"15min":0.92200000000000004},"min":{"1min":0.28899999999999998,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":2.0990000000000002,"5min":11.039,"15min":11.039},"last":0.56999999999999995}]},{"osd":1,"last update":"Sat Oct 14 01:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77200000000000002,"15min":0.72299999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":4.7199999999999998,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.68500000000000005,"15min":0.83299999999999996},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.23100000000000001},"max":{"1min":2.5059999999999998,"5min":8.1899999999999995,"15min":11.082000000000001},"last":0.497}]}]},{"osd":1,"up_from":8,"seq":34359739360,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10807072,"kb_used_data":9207896,"kb_used_omap":1761,"kb_used_meta":1597406,"kb_avail":83564768,"statfs":{"total":96636764160,"available":85570322432,"internally_reserved":0,"allocated":9428885504,"data_stored":15714818020,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1803653,"internal_metadata":1635744379},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,3,4,8,9,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.78900000000000003,"15min":0.93200000000000005},"min":{"1min":0.28199999999999997,"5min":0.183,"15min":0.183},"max":{"1min":0.56399999999999995,"5min":6.673,"15min":12.933},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71399999999999997,"15min":0.94799999999999995},"min":{"1min":0.219,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":4.8630000000000004,"5min":7.1120000000000001,"15min":17.196999999999999},"last":0.436}]},{"osd":2,"last update":"Sat Oct 14 01:23:45 2023","interfaces":[{"interface":"back","average":{"1min":1.9870000000000001,"5min":2.2149999999999999,"15min":1.8129999999999999},"min":{"1min":0.23999999999999999,"5min":0.21099999999999999,"15min":0.20699999999999999},"max":{"1min":17.547999999999998,"5min":17.547999999999998,"15min":17.547999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":1.04,"5min":0.70299999999999996,"15min":0.71199999999999997},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.186},"max":{"1min":11.323,"5min":11.323,"15min":11.323},"last":0.26000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739378,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6831696,"kb_used_data":5674184,"kb_used_omap":1047,"kb_used_meta":1156456,"kb_avail":87540144,"statfs":{"total":96636764160,"available":89641107456,"internally_reserved":0,"allocated":5810364416,"data_stored":9705546390,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":1184211189},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,1,1,1,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:23:47 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.083,"15min":1.1419999999999999},"min":{"1min":0.27400000000000002,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":6.7160000000000002,"5min":7.7839999999999998,"15min":25.927},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94899999999999995,"15min":1.302},"min":{"1min":0.246,"5min":0.221,"15min":0.188},"max":{"1min":6.6280000000000001,"5min":7.7409999999999997,"15min":26.632999999999999},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.92600000000000005,"15min":0.85899999999999999},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.1879999999999997,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.26100000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.028,"15min":0.94699999999999995},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.216},"max":{"1min":9.4649999999999999,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.34899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5808861184,"data_stored":9704356453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9427546112,"data_stored":15713791923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3622612992,"data_stored":6013363534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:24:23.975 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:24:23.975 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:24:23.976 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:24:23.976 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:24:23.977 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:24:26.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:26.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:24:26.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:26.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:26.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:26.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:26.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:26.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:26.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:26.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:26.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:26.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:26.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:26.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:26.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:26.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:26.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:26.859+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:26.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:26.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:26.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:26.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:27.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:27.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:27.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:27.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:27.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:27.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:27.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:27.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:27.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:27.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:27.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:27.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:27.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:27.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:27.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:27.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:27.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:27.739+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:27.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:27.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:27.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:27.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:28.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:24:28.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:24:28.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:28.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:28.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:28.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:28.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:28.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:28.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.551+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:28.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:28.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.575+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:28.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:28.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:28.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:28.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.731+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:28.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.743+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:28.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.811+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:28.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:28.831+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:29.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:29.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:29.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:29.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:29.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:29.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:29.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:29.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:29.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:29.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:29.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:29.499+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:29.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:29.511+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:29.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:29.511+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:29.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:29.511+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:30.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:30.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:30.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:30.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:30.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:30.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:30.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:30.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:30.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:30.783+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:30.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:30.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:30.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:30.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:30.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:30.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:30.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:30.843+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:30.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:30.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:30.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:30.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:31.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:31.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:24:31.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:31.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:31.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:31.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:31.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:31.635+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:31.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:31.639+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:31.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:31.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:31.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:31.655+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:31.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:31.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:31.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:31.671+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:31.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:31.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:31.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:31.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:32.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:24:32.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:32.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.155+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:32.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:32.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:32.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:32.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:32.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:32.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.191+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:32.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.215+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:32.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:32.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:32.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:32.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:32.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:33.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.003+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:33.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:33.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.035+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:33.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:33.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.063+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:33.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:33.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:33.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.859+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:24:33.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:33.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:33.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:33.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:33.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:33.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.935+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:33.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:33.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.979+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:33.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:33.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:33.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:34.218 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:24:34.215+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:24:36.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:36.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:36.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:36.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:36.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:36.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:36.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:36.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.134+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:36.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:36.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:36.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:24:36.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:36.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:36.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:36.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:36.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:36.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:36.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:36.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.830+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:36.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:36.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:36.830+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:37.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:37.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:37.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:37.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:37.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:37.882+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:37.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:37.902+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:37.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:37.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:37.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:37.918+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:37.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:37.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:37.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:37.950+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:37.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:37.950+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:37.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:37.950+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:38.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:38.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:38.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:38.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:38.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:38.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:38.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:38.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:38.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:38.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:38.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:38.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:38.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:38.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:38.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:38.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:38.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:38.210+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:38.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:38.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:38.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:38.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:39.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:39.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:39.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:39.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:39.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:39.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:24:39.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:39.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:39.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:39.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.774+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:39.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.774+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:39.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.810+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:39.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.822+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:39.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:39.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:39.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:41.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:41.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:41.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:41.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:41.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:41.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:41.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:41.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:41.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:41.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:41.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:41.662+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:41.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:41.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:41.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:41.678+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:41.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:41.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:41.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:41.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:43.978 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:24:44.567 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:24:44.562+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:24:44.568 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:24:44.562+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:24:44.803 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:24:44.804 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:24:44.852 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2699,"stamp":"2023-10-14T01:24:43.681756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29642138067,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2357201,"num_read_kb":9163756,"num_write":2310576,"num_write_kb":9240839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80362,"ondisk_log_size":80362,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23356456,"kb_used_data":18480912,"kb_used_omap":3477,"kb_used_meta":4872042,"kb_avail":259759064,"statfs":{"total":289910292480,"available":265993281536,"internally_reserved":0,"allocated":18924453888,"data_stored":31495459485,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3561322,"internal_metadata":4988971158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,1,2,3,3,24,23,10,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17465344,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4337,"num_read_kb":17300,"num_write":4496,"num_write_kb":17984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001967"},"pg_stats":[{"pgid":"2.7","version":"162'297131","reported_seq":582002,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-14T01:24:39.955741+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:24:39.955741+0000","last_peered":"2023-10-14T01:24:39.955741+0000","last_clean":"2023-10-14T01:24:39.955741+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:24:39.955741+0000","last_undegraded":"2023-10-14T01:24:39.955741+0000","last_fullsized":"2023-10-14T01:24:39.955741+0000","mapping_epoch":13,"log_start":"159'287117","ondisk_log_start":"159'287117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3605873176,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":286664,"num_read_kb":1113776,"num_write":279896,"num_write_kb":1119237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"162'311743","reported_seq":614571,"reported_epoch":162,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:24:39.962570+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:24:39.962570+0000","last_peered":"2023-10-14T01:24:39.962570+0000","last_clean":"2023-10-14T01:24:39.962570+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:24:39.962570+0000","last_undegraded":"2023-10-14T01:24:39.962570+0000","last_fullsized":"2023-10-14T01:24:39.962570+0000","mapping_epoch":13,"log_start":"159'301716","ondisk_log_start":"159'301716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":102,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 25s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3813974234,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":306396,"num_read_kb":1181568,"num_write":296177,"num_write_kb":1184237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"162'290077","reported_seq":571683,"reported_epoch":162,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:24:39.917314+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:24:39.917314+0000","last_peered":"2023-10-14T01:24:39.917314+0000","last_clean":"2023-10-14T01:24:39.917314+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:24:39.917314+0000","last_undegraded":"2023-10-14T01:24:39.917314+0000","last_fullsized":"2023-10-14T01:24:39.917314+0000","mapping_epoch":13,"log_start":"159'280023","ondisk_log_start":"159'280023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":16,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 14s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3581657792,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":283588,"num_read_kb":1105575,"num_write":279079,"num_write_kb":1116006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"162'289261","reported_seq":572669,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-14T01:24:39.928953+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:24:39.928953+0000","last_peered":"2023-10-14T01:24:39.928953+0000","last_clean":"2023-10-14T01:24:39.928953+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:24:39.928953+0000","last_undegraded":"2023-10-14T01:24:39.928953+0000","last_fullsized":"2023-10-14T01:24:39.928953+0000","mapping_epoch":13,"log_start":"159'279222","ondisk_log_start":"159'279222","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3598996138,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":284955,"num_read_kb":1114364,"num_write":281157,"num_write_kb":1124377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"162'293047","reported_seq":584597,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-14T01:24:41.580025+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:24:41.580025+0000","last_peered":"2023-10-14T01:24:41.580025+0000","last_clean":"2023-10-14T01:24:41.580025+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:24:41.580025+0000","last_undegraded":"2023-10-14T01:24:41.580025+0000","last_fullsized":"2023-10-14T01:24:41.580025+0000","mapping_epoch":13,"log_start":"159'283023","ondisk_log_start":"159'283023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3670573577,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":293513,"num_read_kb":1135854,"num_write":286739,"num_write_kb":1146477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"162'295098","reported_seq":584952,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-14T01:24:42.850657+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:24:42.850657+0000","last_peered":"2023-10-14T01:24:42.850657+0000","last_clean":"2023-10-14T01:24:42.850657+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:24:42.850657+0000","last_undegraded":"2023-10-14T01:24:42.850657+0000","last_fullsized":"2023-10-14T01:24:42.850657+0000","mapping_epoch":13,"log_start":"159'285012","ondisk_log_start":"159'285012","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3714859326,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":291362,"num_read_kb":1142594,"num_write":289675,"num_write_kb":1158539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"162'296624","reported_seq":588961,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-14T01:24:42.846055+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:24:42.846055+0000","last_peered":"2023-10-14T01:24:42.846055+0000","last_clean":"2023-10-14T01:24:42.846055+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:24:42.846055+0000","last_undegraded":"2023-10-14T01:24:42.846055+0000","last_fullsized":"2023-10-14T01:24:42.846055+0000","mapping_epoch":13,"log_start":"159'286616","ondisk_log_start":"159'286616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3747668519,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":293646,"num_read_kb":1153012,"num_write":291154,"num_write_kb":1164479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"162'336427","reported_seq":650977,"reported_epoch":162,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:24:39.915421+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:24:39.915421+0000","last_peered":"2023-10-14T01:24:39.915421+0000","last_clean":"2023-10-14T01:24:39.915421+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:24:39.915421+0000","last_undegraded":"2023-10-14T01:24:39.915421+0000","last_fullsized":"2023-10-14T01:24:39.915421+0000","mapping_epoch":13,"log_start":"159'326416","ondisk_log_start":"159'326416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1451,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 629s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3907944937,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":316971,"num_read_kb":1216922,"num_write":306562,"num_write_kb":1225593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":343,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-14T01:24:04.035345+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:24:04.035345+0000","last_peered":"2023-10-14T01:24:04.035345+0000","last_clean":"2023-10-14T01:24:04.035345+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:24:04.035345+0000","last_undegraded":"2023-10-14T01:24:04.035345+0000","last_fullsized":"2023-10-14T01:24:04.035345+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29641547699,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2357095,"num_read_kb":9163665,"num_write":2310439,"num_write_kb":9238945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18921570304,"data_stored":31494061926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80263,"ondisk_log_size":80263,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739382,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5400716,"kb_used_data":3550404,"kb_used_omap":668,"kb_used_meta":1849635,"kb_avail":88971124,"statfs":{"total":96636764160,"available":91106430976,"internally_reserved":0,"allocated":3635613696,"data_stored":6025513547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1894026534},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,1,0,8,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.84999999999999998,"15min":0.872},"min":{"1min":0.21199999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":2.0569999999999999,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.90400000000000003,"15min":0.92200000000000004},"min":{"1min":0.28899999999999998,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":2.0990000000000002,"5min":11.039,"15min":11.039},"last":0.41299999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77200000000000002,"15min":0.72299999999999998},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":4.7199999999999998,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":1.387},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.68500000000000005,"15min":0.83299999999999996},"min":{"1min":0.29099999999999998,"5min":0.24399999999999999,"15min":0.23100000000000001},"max":{"1min":2.5059999999999998,"5min":8.1899999999999995,"15min":11.082000000000001},"last":1.345}]}]},{"osd":1,"up_from":8,"seq":34359739364,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10993176,"kb_used_data":9237904,"kb_used_omap":1761,"kb_used_meta":1753502,"kb_avail":83378664,"statfs":{"total":96636764160,"available":85379751936,"internally_reserved":0,"allocated":9459613696,"data_stored":15745541840,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1803653,"internal_metadata":1795586683},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6,0,0,0,2,9,14,6,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:23:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.78900000000000003,"15min":0.93200000000000005},"min":{"1min":0.28199999999999997,"5min":0.183,"15min":0.183},"max":{"1min":0.56399999999999995,"5min":6.673,"15min":12.933},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71399999999999997,"15min":0.94799999999999995},"min":{"1min":0.219,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":4.8630000000000004,"5min":7.1120000000000001,"15min":17.196999999999999},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:23:45 2023","interfaces":[{"interface":"back","average":{"1min":1.9870000000000001,"5min":2.2149999999999999,"15min":1.8129999999999999},"min":{"1min":0.23999999999999999,"5min":0.21099999999999999,"15min":0.20699999999999999},"max":{"1min":17.547999999999998,"5min":17.547999999999998,"15min":17.547999999999998},"last":0.19900000000000001},{"interface":"front","average":{"1min":1.04,"5min":0.70299999999999996,"15min":0.71199999999999997},"min":{"1min":0.23499999999999999,"5min":0.21199999999999999,"15min":0.186},"max":{"1min":11.323,"5min":11.323,"15min":11.323},"last":0.58099999999999996}]}]},{"osd":0,"up_from":8,"seq":34359739382,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6962564,"kb_used_data":5692604,"kb_used_omap":1047,"kb_used_meta":1268904,"kb_avail":87409276,"statfs":{"total":96636764160,"available":89507098624,"internally_reserved":0,"allocated":5829226496,"data_stored":9724404098,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":1299357941},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,1,7,5,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:23:47 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.083,"15min":1.1419999999999999},"min":{"1min":0.27400000000000002,"5min":0.191,"15min":0.17899999999999999},"max":{"1min":6.7160000000000002,"5min":7.7839999999999998,"15min":25.927},"last":2.3900000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.94899999999999995,"15min":1.302},"min":{"1min":0.246,"5min":0.221,"15min":0.188},"max":{"1min":6.6280000000000001,"5min":7.7409999999999997,"15min":26.632999999999999},"last":0.32500000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:23:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.92600000000000005,"15min":0.85899999999999999},"min":{"1min":0.23100000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":6.1879999999999997,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.47999999999999998},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.028,"15min":0.94699999999999995},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.216},"max":{"1min":9.4649999999999999,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":2.4870000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5828112384,"data_stored":9723607653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9459060736,"data_stored":15745306547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3634397184,"data_stored":6025147726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:24:44.854 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:24:44.854 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:24:44.855 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:24:44.855 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:24:45.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:45.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:45.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:45.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:45.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:45.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:45.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:45.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:45.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:45.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:45.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:45.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:45.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:45.502+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:45.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:45.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:45.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:45.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:45.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:45.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:45.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:45.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:45.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:45.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:46.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:46.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:46.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:46.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:46.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:46.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:46.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:46.054+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:46.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:46.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:46.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:46.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:48.212 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:24:48.210+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:24:48.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:48.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:48.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:48.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:48.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:48.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:48.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:48.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:48.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:48.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:48.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:48.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:48.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:48.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:48.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:48.906+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:48.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:48.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:50.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:50.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:50.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:50.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.746+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:50.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.766+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:50.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.786+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:50.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:50.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:50.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.894+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:24:50.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:50.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:50.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:50.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:50.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:50.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:50.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.946+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:50.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.958+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:50.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:50.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:50.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:51.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:51.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:51.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:51.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:51.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:51.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:51.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:51.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:51.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:51.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:51.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:51.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:52.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:52.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.002+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:52.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:52.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:52.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:52.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:52.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:52.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:52.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:52.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:52.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:52.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.826+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:52.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:24:52.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:52.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:54.590 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:24:54.586+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:24:55.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:55.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:55.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:55.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:55.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.190+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:55.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:55.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:55.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:55.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:55.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:55.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:55.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:55.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:55.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:55.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.414+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:55.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:55.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:55.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:55.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:55.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:56.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:56.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:55.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:56.008 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:56.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:56.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:56.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:58.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:58.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:24:58.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:58.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:24:58.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:58.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:24:58.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:58.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:24:58.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:58.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:24:58.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:58.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:24:58.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:58.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:24:58.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:58.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:24:58.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:58.950+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:24:59.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:59.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:24:59.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:59.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:24:59.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:24:59.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:24:59.771 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:24:59.766+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:25:00.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:00.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:00.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:00.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:00.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:00.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:00.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:00.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:00.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:00.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:00.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:00.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:00.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:00.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:00.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:00.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:00.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:00.598+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:00.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:00.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:00.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:00.598+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:04.799 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:25:04.794+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:25:04.857 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:25:05.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:05.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:05.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:05.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:05.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:05.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:05.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:05.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:05.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.414+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:05.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:05.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:05.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.546+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:25:05.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:05.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:05.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:05.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:05.669 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:25:05.670 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:25:05.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:05.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.670+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:05.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:05.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.686+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:05.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:05.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.690+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:05.712 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2710,"stamp":"2023-10-14T01:25:03.695203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29673378259,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2364958,"num_read_kb":9194724,"num_write":2318562,"num_write_kb":9272783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80438,"ondisk_log_size":80438,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23777172,"kb_used_data":18544060,"kb_used_omap":3477,"kb_used_meta":5229610,"kb_avail":259338348,"statfs":{"total":289910292480,"available":265562468352,"internally_reserved":0,"allocated":18989117440,"data_stored":31560109792,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3561322,"internal_metadata":5355120790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,7,6,14,14,12],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18489344,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4639,"num_read_kb":18524,"num_write":4714,"num_write_kb":18856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.012206"},"pg_stats":[{"pgid":"2.7","version":"163'298147","reported_seq":583990,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:00.655541+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:25:00.655541+0000","last_peered":"2023-10-14T01:25:00.655541+0000","last_clean":"2023-10-14T01:25:00.655541+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:25:00.655541+0000","last_undegraded":"2023-10-14T01:25:00.655541+0000","last_fullsized":"2023-10-14T01:25:00.655541+0000","mapping_epoch":13,"log_start":"159'288117","ondisk_log_start":"159'288117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3609756184,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":287624,"num_read_kb":1117608,"num_write":280872,"num_write_kb":1123141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'312826","reported_seq":616668,"reported_epoch":163,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:25:00.632691+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:25:00.632691+0000","last_peered":"2023-10-14T01:25:00.632691+0000","last_clean":"2023-10-14T01:25:00.632691+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:25:00.632691+0000","last_undegraded":"2023-10-14T01:25:00.632691+0000","last_fullsized":"2023-10-14T01:25:00.632691+0000","mapping_epoch":13,"log_start":"159'302816","ondisk_log_start":"159'302816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":200,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 46s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3817758938,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":307383,"num_read_kb":1185508,"num_write":297147,"num_write_kb":1188117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'291171","reported_seq":573739,"reported_epoch":163,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:25:00.654010+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:25:00.654010+0000","last_peered":"2023-10-14T01:25:00.654010+0000","last_clean":"2023-10-14T01:25:00.654010+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:25:00.654010+0000","last_undegraded":"2023-10-14T01:25:00.654010+0000","last_fullsized":"2023-10-14T01:25:00.654010+0000","mapping_epoch":13,"log_start":"159'281123","ondisk_log_start":"159'281123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":92,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 35s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3585606336,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":284532,"num_read_kb":1109347,"num_write":280088,"num_write_kb":1120042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'290245","reported_seq":574607,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:00.630059+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:25:00.630059+0000","last_peered":"2023-10-14T01:25:00.630059+0000","last_clean":"2023-10-14T01:25:00.630059+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:25:00.630059+0000","last_undegraded":"2023-10-14T01:25:00.630059+0000","last_fullsized":"2023-10-14T01:25:00.630059+0000","mapping_epoch":13,"log_start":"159'280222","ondisk_log_start":"159'280222","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3602711210,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":285904,"num_read_kb":1118156,"num_write":282128,"num_write_kb":1128261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"163'294046","reported_seq":586520,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:01.859824+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:25:01.859824+0000","last_peered":"2023-10-14T01:25:01.859824+0000","last_clean":"2023-10-14T01:25:01.859824+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:25:01.859824+0000","last_undegraded":"2023-10-14T01:25:01.859824+0000","last_fullsized":"2023-10-14T01:25:01.859824+0000","mapping_epoch":13,"log_start":"159'284023","ondisk_log_start":"159'284023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3674468873,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":294426,"num_read_kb":1139502,"num_write":287732,"num_write_kb":1150449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"163'296090","reported_seq":586932,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:02.909330+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:25:02.909330+0000","last_peered":"2023-10-14T01:25:02.909330+0000","last_clean":"2023-10-14T01:25:02.909330+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:25:02.909330+0000","last_undegraded":"2023-10-14T01:25:02.909330+0000","last_fullsized":"2023-10-14T01:25:02.909330+0000","mapping_epoch":13,"log_start":"159'286012","ondisk_log_start":"159'286012","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3718725950,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":292345,"num_read_kb":1146518,"num_write":290658,"num_write_kb":1162471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"163'297644","reported_seq":590955,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:02.899312+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:25:02.899312+0000","last_peered":"2023-10-14T01:25:02.899312+0000","last_clean":"2023-10-14T01:25:02.899312+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:25:02.899312+0000","last_undegraded":"2023-10-14T01:25:02.899312+0000","last_fullsized":"2023-10-14T01:25:02.899312+0000","mapping_epoch":13,"log_start":"159'287616","ondisk_log_start":"159'287616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3751641639,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":294615,"num_read_kb":1156880,"num_write":292165,"num_write_kb":1168523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"163'337615","reported_seq":653254,"reported_epoch":163,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:25:00.608246+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:25:00.608246+0000","last_peered":"2023-10-14T01:25:00.608246+0000","last_clean":"2023-10-14T01:25:00.608246+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:25:00.608246+0000","last_undegraded":"2023-10-14T01:25:00.608246+0000","last_fullsized":"2023-10-14T01:25:00.608246+0000","mapping_epoch":13,"log_start":"159'327516","ondisk_log_start":"159'327516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1497,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 649s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3912118761,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":318023,"num_read_kb":1221114,"num_write":307635,"num_write_kb":1229885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":344,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-14T01:24:30.265640+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:24:30.265640+0000","last_peered":"2023-10-14T01:24:30.265640+0000","last_clean":"2023-10-14T01:24:30.265640+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:24:30.265640+0000","last_undegraded":"2023-10-14T01:24:30.265640+0000","last_fullsized":"2023-10-14T01:24:30.265640+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29672787891,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2364852,"num_read_kb":9194633,"num_write":2318425,"num_write_kb":9270889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":18987126784,"data_stored":31559618406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80339,"ondisk_log_size":80339,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739386,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5461532,"kb_used_data":3562708,"kb_used_omap":668,"kb_used_meta":1898147,"kb_avail":88910308,"statfs":{"total":96636764160,"available":91044155392,"internally_reserved":0,"allocated":3648212992,"data_stored":6038108428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":1943702822},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,3,2,2,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83599999999999997,"15min":0.83499999999999996},"min":{"1min":0.26500000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":5.8970000000000002,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.314},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.88900000000000001,"15min":0.88400000000000001},"min":{"1min":0.30299999999999999,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":5.9420000000000002,"5min":11.039,"15min":11.039},"last":0.35299999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.84399999999999997,"15min":0.74199999999999999},"min":{"1min":0.20799999999999999,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":3.032,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.28999999999999998,"5min":0.24399999999999999,"15min":0.23100000000000001},"max":{"1min":4.9379999999999997,"5min":8.1899999999999995,"15min":8.3699999999999992},"last":0.93999999999999995}]}]},{"osd":1,"up_from":8,"seq":34359739368,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11225788,"kb_used_data":9269556,"kb_used_omap":1761,"kb_used_meta":1954462,"kb_avail":83146052,"statfs":{"total":96636764160,"available":85141557248,"internally_reserved":0,"allocated":9492025344,"data_stored":15777949073,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1803653,"internal_metadata":2001369723},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,2,2,10,10,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.89900000000000002},"min":{"1min":0.22,"5min":0.183,"15min":0.183},"max":{"1min":5.9459999999999997,"5min":6.673,"15min":12.076000000000001},"last":5.1539999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.68799999999999994,"15min":0.86199999999999999},"min":{"1min":0.255,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":1.0169999999999999,"5min":7.1120000000000001,"15min":17.196999999999999},"last":5.1379999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.9430000000000001,"5min":2.3250000000000002,"15min":1.861},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":9.9600000000000009,"5min":17.547999999999998,"15min":17.547999999999998},"last":0.375},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.85399999999999998,"15min":0.75900000000000001},"min":{"1min":0.253,"5min":0.21199999999999999,"15min":0.20699999999999999},"max":{"1min":5.9889999999999999,"5min":11.323,"15min":11.323},"last":0.25800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739386,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7089852,"kb_used_data":5711796,"kb_used_omap":1047,"kb_used_meta":1377000,"kb_avail":87281988,"statfs":{"total":96636764160,"available":89376755712,"internally_reserved":0,"allocated":5848879104,"data_stored":9744052291,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":1410048245},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,1,2,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":1.1060000000000001,"15min":1.1040000000000001},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":2.3900000000000001,"5min":7.7839999999999998,"15min":25.927},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.86099999999999999,"15min":1.234},"min":{"1min":0.22,"5min":0.22,"15min":0.188},"max":{"1min":0.66000000000000003,"5min":7.7409999999999997,"15min":26.632999999999999},"last":0.26900000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.90000000000000002,"15min":0.84299999999999997},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.798,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.30599999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.075,"15min":0.95099999999999996},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":5.9409999999999998,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.54000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5847998464,"data_stored":9743493733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9492250624,"data_stored":15778496435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3646877696,"data_stored":6037628238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:25:05.713 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:25:05.714 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:25:05.714 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:25:05.714 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:25:05.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:05.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:06.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:06.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:06.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:06.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.302+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:06.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.310+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:06.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:06.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:06.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:25:06.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:25:06.549 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.542+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:25:06.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:06.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:06.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:06.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:06.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:06.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:06.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:06.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:06.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.642+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:06.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:06.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.642+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:06.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:06.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:06.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:06.835 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:25:06.834+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:25:06.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:06.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:06.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.882+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:06.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.882+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:06.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:06.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.890+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:06.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:06.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:06.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:25:06.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:25:06.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:06.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:06.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:06.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:06.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:06.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:06.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:07.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:07.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:07.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:07.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:08.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:08.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:08.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:08.590+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:08.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:08.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:08.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:08.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:08.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:08.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:08.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:08.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:08.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:08.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:08.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:08.786+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:08.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:08.786+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:10.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:10.918+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:25:10.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:10.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:25:10.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:10.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:10.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:10.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:10.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:10.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:10.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:10.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:10.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:10.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:11.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:11.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:11.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:11.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.054+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:11.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:11.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:11.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:11.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:11.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:11.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:11.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:11.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.426+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:11.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.450+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:11.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:11.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:11.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:11.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:11.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:11.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:11.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:11.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:11.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.718+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:11.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.718+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:11.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.730+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:11.737 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.730+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:11.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:11.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:13.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:25:13.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:13.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:13.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:13.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:13.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:13.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:13.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:13.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:13.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.198+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:13.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:13.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:13.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:25:13.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:25:13.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:13.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:25:14.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:14.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:14.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:14.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:14.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:14.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:14.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:14.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:14.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:14.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:14.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:14.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:14.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:14.062+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:14.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:14.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:14.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:14.090+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:14.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:14.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:14.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:14.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:15.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:15.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:15.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:15.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:15.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:15.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:15.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:15.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:15.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:15.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:15.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:15.338+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:15.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:15.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:17.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:17.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:17.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:17.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:17.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:17.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:17.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:17.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:17.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.322+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:17.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:17.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:17.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:17.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:17.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:17.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.726+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:17.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:17.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:17.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:17.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.802+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:17.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:17.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:17.802+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:20.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:20.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:21.393 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:25:21.386+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:25:21.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:21.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:21.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:21.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:21.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:21.914+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:21.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:21.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:21.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:21.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:21.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:21.974+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:21.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:21.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:21.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:21.998+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:22.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:21.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:22.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:22.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:22.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:22.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:22.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:22.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:22.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:22.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:22.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:22.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:22.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:22.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:22.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:22.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:22.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:22.174+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:22.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:22.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:22.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:22.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:24.266 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:25:24.262+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:25:24.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:24.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:24.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:24.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:24.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:24.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:24.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:24.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:24.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:24.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:24.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:24.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:24.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:24.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:24.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:24.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:24.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:24.406+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:24.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:24.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:24.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:24.406+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:25.715 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:25:25.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:25.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:25.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:25.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:25.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:25.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:25.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:25.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.858+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:25.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.866+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:25.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.890+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:25.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.906+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:25.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:25.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:25.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:26.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:26.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:26.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:26.050+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:26.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:26.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:26.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:26.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:26.586 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:25:26.587 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:25:26.639 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2721,"stamp":"2023-10-14T01:25:25.705899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29703279059,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2372659,"num_read_kb":9225452,"num_write":2326271,"num_write_kb":9303619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80478,"ondisk_log_size":80478,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24121280,"kb_used_data":18607708,"kb_used_omap":3477,"kb_used_meta":5510058,"kb_avail":258994240,"statfs":{"total":289910292480,"available":265210101760,"internally_reserved":0,"allocated":19054292992,"data_stored":31625285344,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3561322,"internal_metadata":5642299542},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,5,4,9,10,20,14,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14749696,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3694,"num_read_kb":14740,"num_write":3801,"num_write_kb":15204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005040"},"pg_stats":[{"pgid":"2.7","version":"163'299145","reported_seq":585986,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:21.418653+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:25:21.418653+0000","last_peered":"2023-10-14T01:25:21.418653+0000","last_clean":"2023-10-14T01:25:21.418653+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:25:21.418653+0000","last_undegraded":"2023-10-14T01:25:21.418653+0000","last_fullsized":"2023-10-14T01:25:21.418653+0000","mapping_epoch":13,"log_start":"159'289117","ondisk_log_start":"159'289117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3613454872,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":288612,"num_read_kb":1121548,"num_write":281816,"num_write_kb":1126917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'313936","reported_seq":618794,"reported_epoch":163,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:25:21.370681+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:25:21.370681+0000","last_peered":"2023-10-14T01:25:21.370681+0000","last_clean":"2023-10-14T01:25:21.370681+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:25:21.370681+0000","last_undegraded":"2023-10-14T01:25:21.370681+0000","last_fullsized":"2023-10-14T01:25:21.370681+0000","mapping_epoch":13,"log_start":"160'303916","ondisk_log_start":"160'303916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":261,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 66s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3821715674,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":308377,"num_read_kb":1189476,"num_write":298159,"num_write_kb":1192165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'292181","reported_seq":575687,"reported_epoch":163,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:25:21.323173+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:25:21.323173+0000","last_peered":"2023-10-14T01:25:21.323173+0000","last_clean":"2023-10-14T01:25:21.323173+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:25:21.323173+0000","last_undegraded":"2023-10-14T01:25:21.323173+0000","last_fullsized":"2023-10-14T01:25:21.323173+0000","mapping_epoch":13,"log_start":"159'282123","ondisk_log_start":"159'282123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":184,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 55s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3589157568,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":285452,"num_read_kb":1113019,"num_write":280992,"num_write_kb":1123658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'291202","reported_seq":576506,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:21.322731+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:25:21.322731+0000","last_peered":"2023-10-14T01:25:21.322731+0000","last_clean":"2023-10-14T01:25:21.322731+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:25:21.322731+0000","last_undegraded":"2023-10-14T01:25:21.322731+0000","last_fullsized":"2023-10-14T01:25:21.322731+0000","mapping_epoch":13,"log_start":"159'281122","ondisk_log_start":"159'281122","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3606274730,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":286841,"num_read_kb":1121900,"num_write":283066,"num_write_kb":1132013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"163'295000","reported_seq":588445,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:22.089845+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:25:22.089845+0000","last_peered":"2023-10-14T01:25:22.089845+0000","last_clean":"2023-10-14T01:25:22.089845+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:25:22.089845+0000","last_undegraded":"2023-10-14T01:25:22.089845+0000","last_fullsized":"2023-10-14T01:25:22.089845+0000","mapping_epoch":13,"log_start":"159'284923","ondisk_log_start":"159'284923","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10077,"log_dups_size":0,"ondisk_log_size":10077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3678171657,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":295382,"num_read_kb":1143322,"num_write":288686,"num_write_kb":1154265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"163'297026","reported_seq":588838,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:23.022090+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:25:23.022090+0000","last_peered":"2023-10-14T01:25:23.022090+0000","last_clean":"2023-10-14T01:25:23.022090+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:25:23.022090+0000","last_undegraded":"2023-10-14T01:25:23.022090+0000","last_fullsized":"2023-10-14T01:25:23.022090+0000","mapping_epoch":13,"log_start":"159'287012","ondisk_log_start":"159'287012","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3722301758,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":293312,"num_read_kb":1150374,"num_write":291587,"num_write_kb":1166187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"163'298659","reported_seq":592914,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:23.034366+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:25:23.034366+0000","last_peered":"2023-10-14T01:25:23.034366+0000","last_clean":"2023-10-14T01:25:23.034366+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:25:23.034366+0000","last_undegraded":"2023-10-14T01:25:23.034366+0000","last_fullsized":"2023-10-14T01:25:23.034366+0000","mapping_epoch":13,"log_start":"159'288616","ondisk_log_start":"159'288616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3755586087,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":295556,"num_read_kb":1160632,"num_write":293173,"num_write_kb":1172555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"163'338775","reported_seq":655443,"reported_epoch":163,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:25:21.333239+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:25:21.333239+0000","last_peered":"2023-10-14T01:25:21.333239+0000","last_clean":"2023-10-14T01:25:21.333239+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:25:21.333239+0000","last_undegraded":"2023-10-14T01:25:21.333239+0000","last_fullsized":"2023-10-14T01:25:21.333239+0000","mapping_epoch":13,"log_start":"160'328716","ondisk_log_start":"160'328716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1543,"log_size":10059,"log_dups_size":0,"ondisk_log_size":10059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 670s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3916026345,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":319021,"num_read_kb":1225090,"num_write":308655,"num_write_kb":1233965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":344,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-14T01:24:30.265640+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:24:30.265640+0000","last_peered":"2023-10-14T01:24:30.265640+0000","last_clean":"2023-10-14T01:24:30.265640+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:24:30.265640+0000","last_undegraded":"2023-10-14T01:24:30.265640+0000","last_fullsized":"2023-10-14T01:24:30.265640+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29702688691,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2372553,"num_read_kb":9225361,"num_write":2326134,"num_write_kb":9301725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19050115072,"data_stored":31622606694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80379,"ondisk_log_size":80379,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739390,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5541192,"kb_used_data":3574332,"kb_used_omap":668,"kb_used_meta":1966179,"kb_avail":88830648,"statfs":{"total":96636764160,"available":90962583552,"internally_reserved":0,"allocated":3660115968,"data_stored":6050011404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":2013367590},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,2,8,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83599999999999997,"15min":0.83499999999999996},"min":{"1min":0.26500000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":5.8970000000000002,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.253},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.88900000000000001,"15min":0.88400000000000001},"min":{"1min":0.30299999999999999,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":5.9420000000000002,"5min":11.039,"15min":11.039},"last":0.313}]},{"osd":1,"last update":"Sat Oct 14 01:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.84399999999999997,"15min":0.74199999999999999},"min":{"1min":0.20799999999999999,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":3.032,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.28999999999999998,"5min":0.24399999999999999,"15min":0.23100000000000001},"max":{"1min":4.9379999999999997,"5min":8.1899999999999995,"15min":8.3699999999999992},"last":0.95699999999999996}]}]},{"osd":1,"up_from":8,"seq":34359739372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11394684,"kb_used_data":9302380,"kb_used_omap":1761,"kb_used_meta":2090526,"kb_avail":82977156,"statfs":{"total":96636764160,"available":84968607744,"internally_reserved":0,"allocated":9525637120,"data_stored":15811560849,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1803653,"internal_metadata":2140699259},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,5,1,7,7,12,13,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.89900000000000002},"min":{"1min":0.22,"5min":0.183,"15min":0.183},"max":{"1min":5.9459999999999997,"5min":6.673,"15min":12.076000000000001},"last":0.432},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.68799999999999994,"15min":0.86199999999999999},"min":{"1min":0.255,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":1.0169999999999999,"5min":7.1120000000000001,"15min":17.196999999999999},"last":0.32900000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.9430000000000001,"5min":2.3250000000000002,"15min":1.861},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":9.9600000000000009,"5min":17.547999999999998,"15min":17.547999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.85399999999999998,"15min":0.75900000000000001},"min":{"1min":0.253,"5min":0.21199999999999999,"15min":0.20699999999999999},"max":{"1min":5.9889999999999999,"5min":11.323,"15min":11.323},"last":0.45700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739390,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7185404,"kb_used_data":5730996,"kb_used_omap":1047,"kb_used_meta":1453352,"kb_avail":87186436,"statfs":{"total":96636764160,"available":89278910464,"internally_reserved":0,"allocated":5868539904,"data_stored":9763713091,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":1488232693},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":1.1060000000000001,"15min":1.1040000000000001},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":2.3900000000000001,"5min":7.7839999999999998,"15min":25.927},"last":0.437},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.86099999999999999,"15min":1.234},"min":{"1min":0.22,"5min":0.22,"15min":0.188},"max":{"1min":0.66000000000000003,"5min":7.7409999999999997,"15min":26.632999999999999},"last":0.32300000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.90000000000000002,"15min":0.84299999999999997},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.798,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.28699999999999998},{"interface":"front","average":{"1min":1.048,"5min":1.075,"15min":0.95099999999999996},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":5.9409999999999998,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.46899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5867040768,"data_stored":9762536037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9524293632,"data_stored":15810539443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3658780672,"data_stored":6049531214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:25:26.641 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:25:26.641 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:25:26.642 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:25:26.642 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:25:28.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:28.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:28.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:28.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:28.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:28.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:28.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:28.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:28.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:28.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:28.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:28.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:28.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:28.922+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:28.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:28.922+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:28.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:28.922+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:28.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:28.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:31.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:31.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:31.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:31.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:31.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:31.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:31.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:31.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:31.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:31.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:31.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:31.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:31.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:31.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:31.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:31.902+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:31.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:31.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:31.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:31.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:32.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:32.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:32.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:32.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:32.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:32.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:32.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:32.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:32.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:32.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:32.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:32.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:32.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:32.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:32.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:32.202+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:32.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:32.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:32.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:32.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:32.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:32.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:32.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:32.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:33.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:33.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:33.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:33.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:33.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:33.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:33.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:33.102+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:33.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:33.110+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:33.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:33.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:33.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:33.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:34.287 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:25:34.274+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:25:36.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:36.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:36.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:36.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:36.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:36.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:36.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:36.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:25:36.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:36.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:37.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:37.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:25:37.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:37.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:37.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:37.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:37.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:37.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:37.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:37.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:37.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:37.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:37.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:37.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:38.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:38.505+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:38.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:38.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:38.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:38.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:38.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:38.557+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:38.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:38.557+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:38.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:38.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:38.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:38.585+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:38.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:38.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:38.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:38.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:40.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:40.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:40.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:40.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:41.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.001+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:41.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:41.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.013+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:41.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:41.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:41.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:41.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.037+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:41.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:41.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:41.058 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:25:41.053+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:25:41.066 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:25:41.061+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:25:41.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.065+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:25:41.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:41.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:41.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:41.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:41.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:41.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:41.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:41.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.229+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:41.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.241+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:41.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:41.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:41.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:42.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:25:42.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:25:42.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:25:42.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:42.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:42.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:42.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:42.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:42.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:42.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:42.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:42.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.929+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:42.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.929+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:42.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:42.933+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:43.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:25:43.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:43.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:43.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:43.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:43.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:43.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:43.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.261+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:43.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:43.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:43.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:25:43.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:25:43.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:43.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:43.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:43.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:43.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:43.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:43.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.365+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:43.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:43.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:43.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:45.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:45.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:45.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:45.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:45.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:45.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:45.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:45.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:45.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:45.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:45.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:45.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:45.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:45.509+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:45.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:45.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:45.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:45.529+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:45.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:45.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:45.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:45.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:46.643 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:25:47.540 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:25:47.541 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:25:47.584 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2731,"stamp":"2023-10-14T01:25:45.709303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29734207955,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2380700,"num_read_kb":9257504,"num_write":2334237,"num_write_kb":9335483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80427,"ondisk_log_size":80427,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24435824,"kb_used_data":18669972,"kb_used_omap":3477,"kb_used_meta":5762346,"kb_avail":258679696,"statfs":{"total":289910292480,"available":264888008704,"internally_reserved":0,"allocated":19118051328,"data_stored":31689043680,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3561322,"internal_metadata":5900642454},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,4,3,11,7,20,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15314944,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3963,"num_read_kb":15804,"num_write":3950,"num_write_kb":15800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001916"},"pg_stats":[{"pgid":"2.7","version":"163'300231","reported_seq":588075,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:42.034989+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:25:42.034989+0000","last_peered":"2023-10-14T01:25:42.034989+0000","last_clean":"2023-10-14T01:25:42.034989+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:25:42.034989+0000","last_undegraded":"2023-10-14T01:25:42.034989+0000","last_fullsized":"2023-10-14T01:25:42.034989+0000","mapping_epoch":13,"log_start":"160'290217","ondisk_log_start":"160'290217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3617518104,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":289601,"num_read_kb":1125468,"num_write":282858,"num_write_kb":1131085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"163'315048","reported_seq":620986,"reported_epoch":163,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:25:42.055014+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:25:42.055014+0000","last_peered":"2023-10-14T01:25:42.055014+0000","last_clean":"2023-10-14T01:25:42.055014+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:25:42.055014+0000","last_undegraded":"2023-10-14T01:25:42.055014+0000","last_fullsized":"2023-10-14T01:25:42.055014+0000","mapping_epoch":13,"log_start":"160'305017","ondisk_log_start":"160'305017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":331,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 87s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3825664218,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":309437,"num_read_kb":1193704,"num_write":299180,"num_write_kb":1196249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"163'293223","reported_seq":577700,"reported_epoch":163,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:25:42.018382+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:25:42.018382+0000","last_peered":"2023-10-14T01:25:42.018382+0000","last_clean":"2023-10-14T01:25:42.018382+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:25:42.018382+0000","last_undegraded":"2023-10-14T01:25:42.018382+0000","last_fullsized":"2023-10-14T01:25:42.018382+0000","mapping_epoch":13,"log_start":"160'283123","ondisk_log_start":"160'283123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":253,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 76s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3592917696,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":286407,"num_read_kb":1116827,"num_write":281955,"num_write_kb":1127510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"163'292200","reported_seq":578450,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:42.035190+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:25:42.035190+0000","last_peered":"2023-10-14T01:25:42.035190+0000","last_clean":"2023-10-14T01:25:42.035190+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:25:42.035190+0000","last_undegraded":"2023-10-14T01:25:42.035190+0000","last_fullsized":"2023-10-14T01:25:42.035190+0000","mapping_epoch":13,"log_start":"160'282122","ondisk_log_start":"160'282122","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3610030762,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":287783,"num_read_kb":1125664,"num_write":284049,"num_write_kb":1135945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"163'295975","reported_seq":590438,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:42.300216+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:25:42.300216+0000","last_peered":"2023-10-14T01:25:42.300216+0000","last_clean":"2023-10-14T01:25:42.300216+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:25:42.300216+0000","last_undegraded":"2023-10-14T01:25:42.300216+0000","last_fullsized":"2023-10-14T01:25:42.300216+0000","mapping_epoch":13,"log_start":"160'285923","ondisk_log_start":"160'285923","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3681874441,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":296389,"num_read_kb":1147346,"num_write":289643,"num_write_kb":1158093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"163'298021","reported_seq":590834,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:43.158231+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:25:43.158231+0000","last_peered":"2023-10-14T01:25:43.158231+0000","last_clean":"2023-10-14T01:25:43.158231+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:25:43.158231+0000","last_undegraded":"2023-10-14T01:25:43.158231+0000","last_fullsized":"2023-10-14T01:25:43.158231+0000","mapping_epoch":13,"log_start":"160'288012","ondisk_log_start":"160'288012","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3726164286,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":294308,"num_read_kb":1154342,"num_write":292574,"num_write_kb":1170135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"163'299624","reported_seq":594893,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:25:43.163579+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:25:43.163579+0000","last_peered":"2023-10-14T01:25:43.163579+0000","last_clean":"2023-10-14T01:25:43.163579+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:25:43.163579+0000","last_undegraded":"2023-10-14T01:25:43.163579+0000","last_fullsized":"2023-10-14T01:25:43.163579+0000","mapping_epoch":13,"log_start":"160'289616","ondisk_log_start":"160'289616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3759395367,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":296564,"num_read_kb":1164660,"num_write":294131,"num_write_kb":1176387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"163'339952","reported_seq":657736,"reported_epoch":163,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:25:42.035026+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:25:42.035026+0000","last_peered":"2023-10-14T01:25:42.035026+0000","last_clean":"2023-10-14T01:25:42.035026+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:25:42.035026+0000","last_undegraded":"2023-10-14T01:25:42.035026+0000","last_fullsized":"2023-10-14T01:25:42.035026+0000","mapping_epoch":13,"log_start":"160'329916","ondisk_log_start":"160'329916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1596,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 691s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3920052713,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":320105,"num_read_kb":1229402,"num_write":309710,"num_write_kb":1238185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":344,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-14T01:24:30.265640+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:24:30.265640+0000","last_peered":"2023-10-14T01:24:30.265640+0000","last_clean":"2023-10-14T01:24:30.265640+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:24:30.265640+0000","last_undegraded":"2023-10-14T01:24:30.265640+0000","last_fullsized":"2023-10-14T01:24:30.265640+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29733617587,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2380594,"num_read_kb":9257413,"num_write":2334100,"num_write_kb":9333589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19115036672,"data_stored":31687528294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":57343,"internal_metadata":0},"log_size":80328,"ondisk_log_size":80328,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739394,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5620968,"kb_used_data":3586144,"kb_used_omap":668,"kb_used_meta":2034147,"kb_avail":88750872,"statfs":{"total":96636764160,"available":90880892928,"internally_reserved":0,"allocated":3672211456,"data_stored":6062106892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":2082966822},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1,4,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.83599999999999997,"15min":0.83499999999999996},"min":{"1min":0.26500000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":5.8970000000000002,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.188},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.88900000000000001,"15min":0.88400000000000001},"min":{"1min":0.30299999999999999,"5min":0.23699999999999999,"15min":0.215},"max":{"1min":5.9420000000000002,"5min":11.039,"15min":11.039},"last":0.27500000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:24:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.84399999999999997,"15min":0.74199999999999999},"min":{"1min":0.20799999999999999,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":3.032,"5min":6.7889999999999997,"15min":6.7889999999999997},"last":0.217},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.28999999999999998,"5min":0.24399999999999999,"15min":0.23100000000000001},"max":{"1min":4.9379999999999997,"5min":8.1899999999999995,"15min":8.3699999999999992},"last":0.246}]}]},{"osd":1,"up_from":8,"seq":34359739376,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11554504,"kb_used_data":9333440,"kb_used_omap":1761,"kb_used_meta":2219294,"kb_avail":82817336,"statfs":{"total":96636764160,"available":84804952064,"internally_reserved":0,"allocated":9557442560,"data_stored":15843366289,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1803653,"internal_metadata":2272557691},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,1,6,4,15,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85199999999999998,"15min":0.89900000000000002},"min":{"1min":0.22,"5min":0.183,"15min":0.183},"max":{"1min":5.9459999999999997,"5min":6.673,"15min":12.076000000000001},"last":0.25},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.68799999999999994,"15min":0.86199999999999999},"min":{"1min":0.255,"5min":0.21099999999999999,"15min":0.185},"max":{"1min":1.0169999999999999,"5min":7.1120000000000001,"15min":17.196999999999999},"last":4.7640000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:24:47 2023","interfaces":[{"interface":"back","average":{"1min":1.9430000000000001,"5min":2.3250000000000002,"15min":1.861},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":9.9600000000000009,"5min":17.547999999999998,"15min":17.547999999999998},"last":0.21199999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.85399999999999998,"15min":0.75900000000000001},"min":{"1min":0.253,"5min":0.21199999999999999,"15min":0.20699999999999999},"max":{"1min":5.9889999999999999,"5min":11.323,"15min":11.323},"last":0.27800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739394,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7260352,"kb_used_data":5750388,"kb_used_omap":1047,"kb_used_meta":1508904,"kb_avail":87111488,"statfs":{"total":96636764160,"available":89202163712,"internally_reserved":0,"allocated":5888397312,"data_stored":9783570499,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":1545117941},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,2,4,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":1.1060000000000001,"15min":1.1040000000000001},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":2.3900000000000001,"5min":7.7839999999999998,"15min":25.927},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.86099999999999999,"15min":1.234},"min":{"1min":0.22,"5min":0.22,"15min":0.188},"max":{"1min":0.66000000000000003,"5min":7.7409999999999997,"15min":26.632999999999999},"last":0.55400000000000005}]},{"osd":2,"last update":"Sat Oct 14 01:24:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.90000000000000002,"15min":0.84299999999999997},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.798,"5min":6.5389999999999997,"15min":8.5559999999999992},"last":0.25700000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.075,"15min":0.95099999999999996},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":5.9409999999999998,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.187}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5887008768,"data_stored":9782504037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9557078016,"data_stored":15843323827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25745,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3670949888,"data_stored":6061700430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:25:47.587 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:25:47.587 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:25:47.588 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:25:47.588 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:25:48.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:48.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:48.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:48.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:48.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:48.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:48.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.205+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:48.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.217+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:48.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:48.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:48.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:48.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:48.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:48.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:48.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:48.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:48.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.649+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:48.657 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:48.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:50.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:50.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:50.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:50.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:50.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:50.681+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:50.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:50.681+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:50.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:50.681+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:50.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:50.681+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:53.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:53.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:53.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:53.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:53.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:53.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:53.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:53.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:53.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:53.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:53.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:53.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:53.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:53.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:53.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:53.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:53.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:53.921+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:53.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:53.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:53.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:53.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:55.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:55.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:25:55.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:55.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:55.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:55.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:55.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:55.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:55.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:55.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:55.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:55.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:55.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:55.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:55.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:55.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:55.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:55.961+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:55.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:55.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:55.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:55.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:25:57.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.805+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:25:57.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:25:57.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:25:57.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:25:57.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:25:57.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:25:57.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:25:57.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:25:57.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:25:57.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:25:57.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.885+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:25:57.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:25:57.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:25:57.885+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:01.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:01.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:01.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:01.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:01.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:01.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:01.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:01.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:01.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:01.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:01.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:01.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:01.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:01.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:01.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:01.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:01.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:01.297+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:01.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:01.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:01.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:01.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:03.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:03.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:03.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:03.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:03.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:03.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:03.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:03.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:03.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:03.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:03.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:03.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:03.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:03.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:03.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:03.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:03.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:03.365+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:03.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:03.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:04.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:04.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:04.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:04.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:04.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:04.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:04.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:04.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:04.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:04.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:04.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:04.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:04.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:04.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:04.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:04.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:04.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:04.993+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:04.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:04.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:04.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:04.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:06.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:06.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:06.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:06.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:06.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:06.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:06.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:06.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:06.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:06.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:06.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:06.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:06.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:06.293+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:06.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:06.349+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:06.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:06.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:06.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:06.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:07.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:07.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:07.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:07.534 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:07.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:07.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.533+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:07.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.581+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:07.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:07.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:07.589 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:26:07.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:07.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:07.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:07.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.729+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:07.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:07.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:07.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:07.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.801+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:07.806 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:07.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:07.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:08.478 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:26:08.479 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:26:08.569 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2743,"stamp":"2023-10-14T01:26:07.724721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29765280211,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2388570,"num_read_kb":9288876,"num_write":2342243,"num_write_kb":9367507,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80544,"ondisk_log_size":80544,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23054256,"kb_used_data":18737688,"kb_used_omap":2786,"kb_used_meta":4313757,"kb_avail":260061264,"statfs":{"total":289910292480,"available":266302734336,"internally_reserved":0,"allocated":19187392512,"data_stored":31758371490,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2853872,"internal_metadata":4417287184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,4,12,11,10,12,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15732736,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4016,"num_read_kb":16008,"num_write":4048,"num_write_kb":16192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007833"},"pg_stats":[{"pgid":"2.7","version":"164'301209","reported_seq":589966,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:02.667774+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:26:02.667774+0000","last_peered":"2023-10-14T01:26:02.667774+0000","last_clean":"2023-10-14T01:26:02.667774+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:26:02.667774+0000","last_undegraded":"2023-10-14T01:26:02.667774+0000","last_fullsized":"2023-10-14T01:26:02.667774+0000","mapping_epoch":13,"log_start":"160'291117","ondisk_log_start":"160'291117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3621224984,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":290501,"num_read_kb":1129060,"num_write":283803,"num_write_kb":1134865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'316154","reported_seq":623104,"reported_epoch":164,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:26:02.699171+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:26:02.699171+0000","last_peered":"2023-10-14T01:26:02.699171+0000","last_clean":"2023-10-14T01:26:02.699171+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:26:02.699171+0000","last_undegraded":"2023-10-14T01:26:02.699171+0000","last_fullsized":"2023-10-14T01:26:02.699171+0000","mapping_epoch":13,"log_start":"160'306117","ondisk_log_start":"160'306117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":396,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 108s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3829592282,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":310426,"num_read_kb":1197648,"num_write":300204,"num_write_kb":1200345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'294210","reported_seq":579640,"reported_epoch":164,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:26:02.691975+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:26:02.691975+0000","last_peered":"2023-10-14T01:26:02.691975+0000","last_clean":"2023-10-14T01:26:02.691975+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:26:02.691975+0000","last_undegraded":"2023-10-14T01:26:02.691975+0000","last_fullsized":"2023-10-14T01:26:02.691975+0000","mapping_epoch":13,"log_start":"160'284123","ondisk_log_start":"160'284123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":338,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 97s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3596456640,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":287346,"num_read_kb":1120555,"num_write":282858,"num_write_kb":1131122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'293216","reported_seq":580416,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:02.683217+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:26:02.683217+0000","last_peered":"2023-10-14T01:26:02.683217+0000","last_clean":"2023-10-14T01:26:02.683217+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:26:02.683217+0000","last_undegraded":"2023-10-14T01:26:02.683217+0000","last_fullsized":"2023-10-14T01:26:02.683217+0000","mapping_epoch":13,"log_start":"160'283122","ondisk_log_start":"160'283122","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3613864618,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":288730,"num_read_kb":1129448,"num_write":285054,"num_write_kb":1139965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"164'297156","reported_seq":592770,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:07.546015+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:26:07.546015+0000","last_peered":"2023-10-14T01:26:07.546015+0000","last_clean":"2023-10-14T01:26:07.546015+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:26:07.546015+0000","last_undegraded":"2023-10-14T01:26:07.546015+0000","last_fullsized":"2023-10-14T01:26:07.546015+0000","mapping_epoch":13,"log_start":"160'287123","ondisk_log_start":"160'287123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3686457865,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":297524,"num_read_kb":1151874,"num_write":290818,"num_write_kb":1162793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"164'298988","reported_seq":592803,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:03.311007+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:26:03.311007+0000","last_peered":"2023-10-14T01:26:03.311007+0000","last_clean":"2023-10-14T01:26:03.311007+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:26:03.311007+0000","last_undegraded":"2023-10-14T01:26:03.311007+0000","last_fullsized":"2023-10-14T01:26:03.311007+0000","mapping_epoch":13,"log_start":"160'288912","ondisk_log_start":"160'288912","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3729899838,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":295312,"num_read_kb":1158338,"num_write":293538,"num_write_kb":1173991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"164'300531","reported_seq":596757,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:03.312678+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:26:03.312678+0000","last_peered":"2023-10-14T01:26:03.312678+0000","last_clean":"2023-10-14T01:26:03.312678+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:26:03.312678+0000","last_undegraded":"2023-10-14T01:26:03.312678+0000","last_fullsized":"2023-10-14T01:26:03.312678+0000","mapping_epoch":13,"log_start":"160'290516","ondisk_log_start":"160'290516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3762999847,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":297516,"num_read_kb":1168456,"num_write":295035,"num_write_kb":1180003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"164'341127","reported_seq":659947,"reported_epoch":164,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:26:02.636884+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:26:02.636884+0000","last_peered":"2023-10-14T01:26:02.636884+0000","last_clean":"2023-10-14T01:26:02.636884+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:26:02.636884+0000","last_undegraded":"2023-10-14T01:26:02.636884+0000","last_fullsized":"2023-10-14T01:26:02.636884+0000","mapping_epoch":13,"log_start":"160'331116","ondisk_log_start":"160'331116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1628,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 711s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3924193769,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":321109,"num_read_kb":1233406,"num_write":310796,"num_write_kb":1242529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":345,"reported_epoch":163,"state":"active+clean","last_fresh":"2023-10-14T01:24:45.311822+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:24:45.311822+0000","last_peered":"2023-10-14T01:24:45.311822+0000","last_clean":"2023-10-14T01:24:45.311822+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:24:45.311822+0000","last_undegraded":"2023-10-14T01:24:45.311822+0000","last_fullsized":"2023-10-14T01:24:45.311822+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29764689843,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2388464,"num_read_kb":9288785,"num_write":2342106,"num_write_kb":9365613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19183386624,"data_stored":31755878246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53766,"internal_metadata":0},"log_size":80445,"ondisk_log_size":80445,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739398,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5646492,"kb_used_data":3597780,"kb_used_omap":668,"kb_used_meta":2048035,"kb_avail":88725348,"statfs":{"total":96636764160,"available":90854756352,"internally_reserved":0,"allocated":3684126720,"data_stored":6074017698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":684762,"internal_metadata":2097188134},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,3,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:25:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.80600000000000005,"15min":0.84799999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.17399999999999999},"max":{"1min":3.2650000000000001,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.85799999999999998,"15min":0.89700000000000002},"min":{"1min":0.27500000000000002,"5min":0.26700000000000002,"15min":0.215},"max":{"1min":3.2999999999999998,"5min":11.039,"15min":11.039},"last":0.309}]},{"osd":1,"last update":"Sat Oct 14 01:25:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.74399999999999999,"15min":0.72399999999999998},"min":{"1min":0.217,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":1.55,"5min":5.7560000000000002,"15min":6.7889999999999997},"last":0.439},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.72999999999999998,"15min":0.78500000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":2.5979999999999999,"5min":8.1899999999999995,"15min":8.3699999999999992},"last":0.24199999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739380,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10016192,"kb_used_data":9365880,"kb_used_omap":1070,"kb_used_meta":649233,"kb_avail":84355648,"statfs":{"total":96636764160,"available":86380183552,"internally_reserved":0,"allocated":9590661120,"data_stored":15876580391,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":664815093},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,1,6,4,3,12,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.22500000000000001,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":5.3330000000000002,"5min":6.673,"15min":12.076000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.81399999999999995,"15min":0.878},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.185},"max":{"1min":5.1379999999999999,"5min":7.1120000000000001,"15min":17.196999999999999},"last":0.76500000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.9770000000000001,"15min":1.851},"min":{"1min":0.21199999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":5.4569999999999999,"5min":17.547999999999998,"15min":17.547999999999998},"last":0.49299999999999999},{"interface":"front","average":{"1min":1.073,"5min":0.94799999999999995,"15min":0.79400000000000004},"min":{"1min":0.247,"5min":0.21199999999999999,"15min":0.20699999999999999},"max":{"1min":5.3710000000000004,"5min":11.323,"15min":11.323},"last":0.37}]}]},{"osd":0,"up_from":8,"seq":34359739399,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7391572,"kb_used_data":5774028,"kb_used_omap":1047,"kb_used_meta":1616488,"kb_avail":86980268,"statfs":{"total":96636764160,"available":89067794432,"internally_reserved":0,"allocated":5912604672,"data_stored":9807773401,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":1655283957},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,5,4,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.0329999999999999,"15min":0.96199999999999997},"min":{"1min":0.158,"5min":0.158,"15min":0.158},"max":{"1min":5.2519999999999998,"5min":7.7839999999999998,"15min":7.8899999999999997},"last":0.314},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.88100000000000001,"15min":1.097},"min":{"1min":0.249,"5min":0.22,"15min":0.188},"max":{"1min":5.2750000000000004,"5min":7.7409999999999997,"15min":13.903},"last":0.33700000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.78000000000000003,"15min":0.82799999999999996},"min":{"1min":0.25700000000000001,"5min":0.23100000000000001,"15min":0.21199999999999999},"max":{"1min":3.9020000000000001,"5min":6.1879999999999997,"15min":8.5559999999999992},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.02,"15min":0.95899999999999996},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":4.3019999999999996,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.39500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5911277568,"data_stored":9806772837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9589182464,"data_stored":15875428275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3682926592,"data_stored":6073677134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:26:08.571 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:26:08.571 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:26:08.572 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:26:08.572 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:26:10.151 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:26:10.141+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:26:12.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:12.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:12.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:12.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:12.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:12.741+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:13.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:13.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:26:13.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:13.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:13.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:13.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:13.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:13.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:13.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:13.813+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:13.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:13.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:13.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:13.869+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:13.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:13.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:13.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:13.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:13.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:13.913+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:13.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:13.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:13.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:13.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:14.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:14.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:14.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:14.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:14.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:14.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:14.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:14.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:14.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:14.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:14.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:14.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:14.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:14.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:14.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:14.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:14.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:14.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:14.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:14.433+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:14.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:14.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:14.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:14.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:15.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:15.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:15.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:15.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:15.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:15.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:15.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:15.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:16.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:16.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:16.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:16.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:16.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:16.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:16.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:16.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:16.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:16.121+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:16.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:16.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:16.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:16.121+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:17.390 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:26:17.385+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T01:26:17.391 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:26:17.385+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:26:17.391 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:26:17.385+0000 7f30478aa640 -1 reset not still connected to 0x55c894ab09c0 2023-10-14T01:26:21.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:21.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:21.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:21.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:21.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:21.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:21.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:21.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:21.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:21.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:21.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:21.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:21.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:21.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:21.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:21.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:21.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:21.397+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:21.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:21.397+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:21.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:21.397+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:23.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:23.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:23.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:23.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:23.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:23.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:23.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:23.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:23.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:23.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:23.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:23.773+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:23.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:23.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:23.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:23.797+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:24.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:26:24.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:24.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:24.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:24.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:24.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:24.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:24.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:24.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:26:24.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:24.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:24.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.621+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:24.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:24.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.657+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:24.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:24.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.657+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:24.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:24.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:24.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:24.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:24.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:24.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:24.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:24.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.785+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:24.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.805+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:24.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:24.805+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:25.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:25.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:26:25.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:25.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:25.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:25.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:25.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:25.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:25.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:25.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:25.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:25.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:25.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:25.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:25.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:25.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:25.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:25.985+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:25.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:25.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:26.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:26.021+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:26.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:26.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:26.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:26.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:26.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:26.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:26.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:26.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:26.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:26.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:26.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:26.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:26.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:26.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:26.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:26.405+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:26.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:26.433+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:26.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:26.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:26.443 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:26.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:27.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:27.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:27.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:27.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:27.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:27.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:27.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:27.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:27.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:27.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:27.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:27.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:27.453 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:26:27.449+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:26:27.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:27.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:27.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:27.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:27.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:27.849+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:27.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:27.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:27.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:27.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:28.573 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:26:29.420 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:26:29.421 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:26:29.463 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2753,"stamp":"2023-10-14T01:26:27.730167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29796372947,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2396379,"num_read_kb":9320044,"num_write":2350209,"num_write_kb":9399371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80531,"ondisk_log_size":80531,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":22852884,"kb_used_data":18800568,"kb_used_omap":2788,"kb_used_meta":4049499,"kb_avail":260262636,"statfs":{"total":289910292480,"available":266508939264,"internally_reserved":0,"allocated":19251781632,"data_stored":31822760610,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2855552,"internal_metadata":4146687360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,7,6,40,14,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16785408,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4188,"num_read_kb":16712,"num_write":4293,"num_write_kb":17172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004044"},"pg_stats":[{"pgid":"2.7","version":"164'302181","reported_seq":591950,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:23.199155+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:26:23.199155+0000","last_peered":"2023-10-14T01:26:23.199155+0000","last_clean":"2023-10-14T01:26:23.199155+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:26:23.199155+0000","last_undegraded":"2023-10-14T01:26:23.199155+0000","last_fullsized":"2023-10-14T01:26:23.199155+0000","mapping_epoch":13,"log_start":"160'292117","ondisk_log_start":"160'292117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3624931864,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":291499,"num_read_kb":1133044,"num_write":284745,"num_write_kb":1138633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'317262","reported_seq":625229,"reported_epoch":164,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:26:23.189065+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:26:23.189065+0000","last_peered":"2023-10-14T01:26:23.189065+0000","last_clean":"2023-10-14T01:26:23.189065+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:26:23.189065+0000","last_undegraded":"2023-10-14T01:26:23.189065+0000","last_fullsized":"2023-10-14T01:26:23.189065+0000","mapping_epoch":13,"log_start":"160'307217","ondisk_log_start":"160'307217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":451,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 128s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3833635034,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":311422,"num_read_kb":1201620,"num_write":301241,"num_write_kb":1204493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'295255","reported_seq":581685,"reported_epoch":164,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:26:23.182217+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:26:23.182217+0000","last_peered":"2023-10-14T01:26:23.182217+0000","last_clean":"2023-10-14T01:26:23.182217+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:26:23.182217+0000","last_undegraded":"2023-10-14T01:26:23.182217+0000","last_fullsized":"2023-10-14T01:26:23.182217+0000","mapping_epoch":13,"log_start":"160'285224","ondisk_log_start":"160'285224","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":403,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 117s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3600282304,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":288321,"num_read_kb":1124451,"num_write":283833,"num_write_kb":1135022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'294214","reported_seq":582395,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:23.157717+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:26:23.157717+0000","last_peered":"2023-10-14T01:26:23.157717+0000","last_clean":"2023-10-14T01:26:23.157717+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:26:23.157717+0000","last_undegraded":"2023-10-14T01:26:23.157717+0000","last_fullsized":"2023-10-14T01:26:23.157717+0000","mapping_epoch":13,"log_start":"160'284122","ondisk_log_start":"160'284122","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3617718954,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":289706,"num_read_kb":1133344,"num_write":286041,"num_write_kb":1143913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"164'298196","reported_seq":594810,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:27.651684+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:26:27.651684+0000","last_peered":"2023-10-14T01:26:27.651684+0000","last_clean":"2023-10-14T01:26:27.651684+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:26:27.651684+0000","last_undegraded":"2023-10-14T01:26:27.651684+0000","last_fullsized":"2023-10-14T01:26:27.651684+0000","mapping_epoch":13,"log_start":"160'288123","ondisk_log_start":"160'288123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3690451465,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":298512,"num_read_kb":1155818,"num_write":291843,"num_write_kb":1166893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"164'299951","reported_seq":594727,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:23.511486+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:26:23.511486+0000","last_peered":"2023-10-14T01:26:23.511486+0000","last_clean":"2023-10-14T01:26:23.511486+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:26:23.511486+0000","last_undegraded":"2023-10-14T01:26:23.511486+0000","last_fullsized":"2023-10-14T01:26:23.511486+0000","mapping_epoch":13,"log_start":"160'289912","ondisk_log_start":"160'289912","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3733668158,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":296262,"num_read_kb":1162134,"num_write":294500,"num_write_kb":1177839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"164'301559","reported_seq":598718,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:23.489898+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:26:23.489898+0000","last_peered":"2023-10-14T01:26:23.489898+0000","last_clean":"2023-10-14T01:26:23.489898+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:26:23.489898+0000","last_undegraded":"2023-10-14T01:26:23.489898+0000","last_fullsized":"2023-10-14T01:26:23.489898+0000","mapping_epoch":13,"log_start":"160'291516","ondisk_log_start":"160'291516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3767079463,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":298446,"num_read_kb":1172160,"num_write":296062,"num_write_kb":1184111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"164'342261","reported_seq":662110,"reported_epoch":164,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:26:23.142865+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:26:23.142865+0000","last_peered":"2023-10-14T01:26:23.142865+0000","last_clean":"2023-10-14T01:26:23.142865+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:26:23.142865+0000","last_undegraded":"2023-10-14T01:26:23.142865+0000","last_fullsized":"2023-10-14T01:26:23.142865+0000","mapping_epoch":13,"log_start":"161'332216","ondisk_log_start":"161'332216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1711,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 732s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3928015337,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":322105,"num_read_kb":1237382,"num_write":311807,"num_write_kb":1246573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":346,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:25:55.287560+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:25:55.287560+0000","last_peered":"2023-10-14T01:25:55.287560+0000","last_clean":"2023-10-14T01:25:55.287560+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:25:55.287560+0000","last_undegraded":"2023-10-14T01:25:55.287560+0000","last_fullsized":"2023-10-14T01:25:55.287560+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29795782579,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2396273,"num_read_kb":9319953,"num_write":2350072,"num_write_kb":9397477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19248578560,"data_stored":31821070182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53766,"internal_metadata":0},"log_size":80432,"ondisk_log_size":80432,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739402,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5208096,"kb_used_data":3609688,"kb_used_omap":670,"kb_used_meta":1597729,"kb_avail":89163744,"statfs":{"total":96636764160,"available":91303673856,"internally_reserved":0,"allocated":3696320512,"data_stored":6086211490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":686442,"internal_metadata":1636075158},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,4,5,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:25:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.80600000000000005,"15min":0.84799999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.17399999999999999},"max":{"1min":3.2650000000000001,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.85799999999999998,"15min":0.89700000000000002},"min":{"1min":0.27500000000000002,"5min":0.26700000000000002,"15min":0.215},"max":{"1min":3.2999999999999998,"5min":11.039,"15min":11.039},"last":0.33500000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:25:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.74399999999999999,"15min":0.72399999999999998},"min":{"1min":0.217,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":1.55,"5min":5.7560000000000002,"15min":6.7889999999999997},"last":0.318},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.72999999999999998,"15min":0.78500000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":2.5979999999999999,"5min":8.1899999999999995,"15min":8.3699999999999992},"last":0.377}]}]},{"osd":1,"up_from":8,"seq":34359739384,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10143428,"kb_used_data":9397304,"kb_used_omap":1070,"kb_used_meta":745041,"kb_avail":84228412,"statfs":{"total":96636764160,"available":86249893888,"internally_reserved":0,"allocated":9622839296,"data_stored":15908758567,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":762922485},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,6,3,33,8,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.22500000000000001,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":5.3330000000000002,"5min":6.673,"15min":12.076000000000001},"last":0.33300000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.81399999999999995,"15min":0.878},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.185},"max":{"1min":5.1379999999999999,"5min":7.1120000000000001,"15min":17.196999999999999},"last":0.34200000000000003}]},{"osd":2,"last update":"Sat Oct 14 01:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.9770000000000001,"15min":1.851},"min":{"1min":0.21199999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":5.4569999999999999,"5min":17.547999999999998,"15min":17.547999999999998},"last":0.217},{"interface":"front","average":{"1min":1.073,"5min":0.94799999999999995,"15min":0.79400000000000004},"min":{"1min":0.247,"5min":0.21199999999999999,"15min":0.20699999999999999},"max":{"1min":5.3710000000000004,"5min":11.323,"15min":11.323},"last":0.29699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739403,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7501360,"kb_used_data":5793576,"kb_used_omap":1047,"kb_used_meta":1706728,"kb_avail":86870480,"statfs":{"total":96636764160,"available":88955371520,"internally_reserved":0,"allocated":5932621824,"data_stored":9827790553,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":1747689717},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,3,1,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.0329999999999999,"15min":0.96199999999999997},"min":{"1min":0.158,"5min":0.158,"15min":0.158},"max":{"1min":5.2519999999999998,"5min":7.7839999999999998,"15min":7.8899999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.88100000000000001,"15min":1.097},"min":{"1min":0.249,"5min":0.22,"15min":0.188},"max":{"1min":5.2750000000000004,"5min":7.7409999999999997,"15min":13.903},"last":0.317}]},{"osd":2,"last update":"Sat Oct 14 01:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.78000000000000003,"15min":0.82799999999999996},"min":{"1min":0.25700000000000001,"5min":0.23100000000000001,"15min":0.21199999999999999},"max":{"1min":3.9020000000000001,"5min":6.1879999999999997,"15min":8.5559999999999992},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.02,"15min":0.95899999999999996},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":4.3019999999999996,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5931327488,"data_stored":9826822757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9622040576,"data_stored":15908286387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3695210496,"data_stored":6085961038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:26:29.465 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:26:29.465 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:26:29.465 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:26:29.466 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:26:32.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:32.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:32.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:32.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:32.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:32.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:32.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:32.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:32.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:32.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:32.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:32.273+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:32.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:32.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:32.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:32.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:33.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:33.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:33.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:33.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:33.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:33.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:33.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:33.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:33.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.249+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:33.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.257+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:33.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:33.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:33.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:33.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:33.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:33.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:33.317 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:26:33.313+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:26:33.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:33.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:33.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:33.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.413+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:33.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.413+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:33.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:33.413+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:35.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:35.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:35.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:35.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:35.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:35.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:35.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.565+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:35.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:35.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:35.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:35.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:35.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:35.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:35.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:35.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:35.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.949+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:35.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:35.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.981+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:35.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:35.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:35.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:36.283 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:26:36.277+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:26:39.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:39.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:39.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:39.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:39.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:39.072+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:39.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:39.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:39.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:39.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:39.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:39.136+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:40.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:40.016+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:40.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:40.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:40.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:40.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:40.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:40.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:40.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:40.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:40.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:40.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:40.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:40.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:40.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:40.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:40.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:40.088+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:40.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:40.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:40.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:40.088+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:42.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:42.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:42.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:42.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:42.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:42.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:42.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:42.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:42.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:42.232+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:43.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:43.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:43.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:43.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.264+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:43.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:43.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:43.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.364+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:43.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:43.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.372+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:43.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.392+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:43.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:43.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:43.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:43.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:43.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:43.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:43.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:43.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:43.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:43.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:46.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:46.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:26:46.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:46.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:46.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:46.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:46.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:46.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:46.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:46.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:46.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:46.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:46.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:46.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:46.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:46.504+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:46.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:46.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:46.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:46.548+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:46.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:46.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:46.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:46.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:47.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:47.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:47.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:47.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.404+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:47.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:47.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.436+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:47.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:47.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:47.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:47.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:47.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:47.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:47.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:47.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:47.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:47.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:47.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:47.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.816+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:47.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:47.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:47.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:47.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:47.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:47.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:47.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:47.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:47.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:48.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:48.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:48.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:48.048+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:48.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:48.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:48.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:48.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:48.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:48.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:26:48.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:48.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:48.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:48.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:48.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:48.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:49.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:49.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:49.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:49.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:49.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:49.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:49.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:49.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:49.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:49.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:49.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:49.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:49.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:49.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:49.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:49.392+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:49.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:49.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:49.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:49.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:49.467 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:26:50.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:50.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:50.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:50.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:50.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:50.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:50.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:50.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:50.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:50.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:50.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:50.056+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:50.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:50.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:50.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:50.108+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:50.155 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:26:50.156 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:26:50.241 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2764,"stamp":"2023-10-14T01:26:49.739920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29833961939,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2405784,"num_read_kb":9357580,"num_write":2359852,"num_write_kb":9437943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80422,"ondisk_log_size":80422,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23235136,"kb_used_data":18873764,"kb_used_omap":2788,"kb_used_meta":4358555,"kb_avail":259880384,"statfs":{"total":289910292480,"available":266117513216,"internally_reserved":0,"allocated":19326734336,"data_stored":31897713314,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2855552,"internal_metadata":4463160704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,0,5,3,2,5,11,6,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22106112,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5489,"num_read_kb":21916,"num_write":5658,"num_write_kb":22632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002095"},"pg_stats":[{"pgid":"2.7","version":"164'303451","reported_seq":594472,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:48.717348+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:26:48.717348+0000","last_peered":"2023-10-14T01:26:48.717348+0000","last_clean":"2023-10-14T01:26:48.717348+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:26:48.717348+0000","last_undegraded":"2023-10-14T01:26:48.717348+0000","last_fullsized":"2023-10-14T01:26:48.717348+0000","mapping_epoch":13,"log_start":"161'293417","ondisk_log_start":"161'293417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3629695512,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":292736,"num_read_kb":1137980,"num_write":285945,"num_write_kb":1143433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"164'318634","reported_seq":627873,"reported_epoch":164,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:26:48.676478+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:26:48.676478+0000","last_peered":"2023-10-14T01:26:48.676478+0000","last_clean":"2023-10-14T01:26:48.676478+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:26:48.676478+0000","last_undegraded":"2023-10-14T01:26:48.676478+0000","last_fullsized":"2023-10-14T01:26:48.676478+0000","mapping_epoch":13,"log_start":"161'308617","ondisk_log_start":"161'308617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":554,"log_size":10017,"log_dups_size":0,"ondisk_log_size":10017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 154s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3838402778,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":312675,"num_read_kb":1206620,"num_write":302469,"num_write_kb":1209405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"164'296573","reported_seq":584208,"reported_epoch":164,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:26:48.699393+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:26:48.699393+0000","last_peered":"2023-10-14T01:26:48.699393+0000","last_clean":"2023-10-14T01:26:48.699393+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:26:48.699393+0000","last_undegraded":"2023-10-14T01:26:48.699393+0000","last_fullsized":"2023-10-14T01:26:48.699393+0000","mapping_epoch":13,"log_start":"161'286525","ondisk_log_start":"161'286525","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":517,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 143s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3604923072,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":289503,"num_read_kb":1129175,"num_write":285020,"num_write_kb":1139770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"164'295424","reported_seq":584758,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:48.695829+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:26:48.695829+0000","last_peered":"2023-10-14T01:26:48.695829+0000","last_clean":"2023-10-14T01:26:48.695829+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:26:48.695829+0000","last_undegraded":"2023-10-14T01:26:48.695829+0000","last_fullsized":"2023-10-14T01:26:48.695829+0000","mapping_epoch":13,"log_start":"161'285422","ondisk_log_start":"161'285422","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3622302378,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":290853,"num_read_kb":1137916,"num_write":287226,"num_write_kb":1148653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"164'299153","reported_seq":596727,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:47.742226+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:26:47.742226+0000","last_peered":"2023-10-14T01:26:47.742226+0000","last_clean":"2023-10-14T01:26:47.742226+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:26:47.742226+0000","last_undegraded":"2023-10-14T01:26:47.742226+0000","last_fullsized":"2023-10-14T01:26:47.742226+0000","mapping_epoch":13,"log_start":"161'289123","ondisk_log_start":"161'289123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3694150153,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":299463,"num_read_kb":1159614,"num_write":292788,"num_write_kb":1170673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"164'301180","reported_seq":597086,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:48.777809+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:26:48.777809+0000","last_peered":"2023-10-14T01:26:48.777809+0000","last_clean":"2023-10-14T01:26:48.777809+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:26:48.777809+0000","last_undegraded":"2023-10-14T01:26:48.777809+0000","last_fullsized":"2023-10-14T01:26:48.777809+0000","mapping_epoch":13,"log_start":"161'291112","ondisk_log_start":"161'291112","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3738460478,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":297391,"num_read_kb":1166642,"num_write":295723,"num_write_kb":1182731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"164'302846","reported_seq":601269,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:48.780379+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:26:48.780379+0000","last_peered":"2023-10-14T01:26:48.780379+0000","last_clean":"2023-10-14T01:26:48.780379+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:26:48.780379+0000","last_undegraded":"2023-10-14T01:26:48.780379+0000","last_fullsized":"2023-10-14T01:26:48.780379+0000","mapping_epoch":13,"log_start":"161'292816","ondisk_log_start":"161'292816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3772113447,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":299703,"num_read_kb":1177176,"num_write":297343,"num_write_kb":1189235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"164'343810","reported_seq":664945,"reported_epoch":164,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:26:48.644451+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:26:48.644451+0000","last_peered":"2023-10-14T01:26:48.644451+0000","last_clean":"2023-10-14T01:26:48.644451+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:26:48.644451+0000","last_undegraded":"2023-10-14T01:26:48.644451+0000","last_fullsized":"2023-10-14T01:26:48.644451+0000","mapping_epoch":13,"log_start":"161'333716","ondisk_log_start":"161'333716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1742,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 757s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3933323753,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":323354,"num_read_kb":1242366,"num_write":313201,"num_write_kb":1252149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":346,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:25:55.287560+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:25:55.287560+0000","last_peered":"2023-10-14T01:25:55.287560+0000","last_clean":"2023-10-14T01:25:55.287560+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:25:55.287560+0000","last_undegraded":"2023-10-14T01:25:55.287560+0000","last_fullsized":"2023-10-14T01:25:55.287560+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29833371571,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2405678,"num_read_kb":9357489,"num_write":2359715,"num_write_kb":9436049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19324424192,"data_stored":31896915814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53766,"internal_metadata":0},"log_size":80323,"ondisk_log_size":80323,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739407,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5320212,"kb_used_data":3625164,"kb_used_omap":670,"kb_used_meta":1694369,"kb_avail":89051628,"statfs":{"total":96636764160,"available":91188867072,"internally_reserved":0,"allocated":3712167936,"data_stored":6102058914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":686442,"internal_metadata":1735034518},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,0,3,1,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:25:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.80600000000000005,"15min":0.84799999999999998},"min":{"1min":0.188,"5min":0.188,"15min":0.17399999999999999},"max":{"1min":3.2650000000000001,"5min":10.981999999999999,"15min":10.981999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.85799999999999998,"15min":0.89700000000000002},"min":{"1min":0.27500000000000002,"5min":0.26700000000000002,"15min":0.215},"max":{"1min":3.2999999999999998,"5min":11.039,"15min":11.039},"last":0.44500000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:25:58 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.74399999999999999,"15min":0.72399999999999998},"min":{"1min":0.217,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":1.55,"5min":5.7560000000000002,"15min":6.7889999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.72999999999999998,"15min":0.78500000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":2.5979999999999999,"5min":8.1899999999999995,"15min":8.3699999999999992},"last":0.34699999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739389,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10322524,"kb_used_data":9436176,"kb_used_omap":1070,"kb_used_meta":885265,"kb_avail":84049316,"statfs":{"total":96636764160,"available":86066499584,"internally_reserved":0,"allocated":9662644224,"data_stored":15948563495,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":906511861},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[11,0,0,1,2,2,9,5,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.91300000000000003,"15min":0.92800000000000005},"min":{"1min":0.22500000000000001,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":5.3330000000000002,"5min":6.673,"15min":12.076000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.81399999999999995,"15min":0.878},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.185},"max":{"1min":5.1379999999999999,"5min":7.1120000000000001,"15min":17.196999999999999},"last":0.19500000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:25:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":1.9770000000000001,"15min":1.851},"min":{"1min":0.21199999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":5.4569999999999999,"5min":17.547999999999998,"15min":17.547999999999998},"last":0.23300000000000001},{"interface":"front","average":{"1min":1.073,"5min":0.94799999999999995,"15min":0.79400000000000004},"min":{"1min":0.247,"5min":0.21199999999999999,"15min":0.20699999999999999},"max":{"1min":5.3710000000000004,"5min":11.323,"15min":11.323},"last":0.316}]}]},{"osd":0,"up_from":8,"seq":34359739407,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7592400,"kb_used_data":5812424,"kb_used_omap":1047,"kb_used_meta":1778920,"kb_avail":86779440,"statfs":{"total":96636764160,"available":88862146560,"internally_reserved":0,"allocated":5951922176,"data_stored":9847090905,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":1821614325},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.0329999999999999,"15min":0.96199999999999997},"min":{"1min":0.158,"5min":0.158,"15min":0.158},"max":{"1min":5.2519999999999998,"5min":7.7839999999999998,"15min":7.8899999999999997},"last":0.443},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.88100000000000001,"15min":1.097},"min":{"1min":0.249,"5min":0.22,"15min":0.188},"max":{"1min":5.2750000000000004,"5min":7.7409999999999997,"15min":13.903},"last":0.27200000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:25:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.78000000000000003,"15min":0.82799999999999996},"min":{"1min":0.25700000000000001,"5min":0.23100000000000001,"15min":0.21199999999999999},"max":{"1min":3.9020000000000001,"5min":6.1879999999999997,"15min":8.5559999999999992},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":1.02,"15min":0.95899999999999996},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":4.3019999999999996,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5950640128,"data_stored":9846135397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9662656512,"data_stored":15948902323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3711127552,"data_stored":6101878094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:26:50.243 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:26:50.243 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:26:50.244 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:26:50.244 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:26:51.127 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:26:51.179 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T01:26:52.024 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T01:26:52.064 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T01:26:52.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:52.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:52.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:52.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:52.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:52.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:52.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:52.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:52.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:52.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:52.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:52.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:52.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:52.812+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:52.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:52.824+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:52.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:52.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:52.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:52.824+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:52.976 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T01:26:53.038 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:26:53.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:53.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:53.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:53.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:53.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:53.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:53.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:53.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:53.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:53.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:53.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:53.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:53.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:53.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:53.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:53.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:53.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:53.520+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:53.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:53.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:53.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:53.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:54.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:54.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:54.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:54.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:54.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:54.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:54.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:54.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:54.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:54.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:54.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:54.636+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:54.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:54.680+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:54.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:54.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:54.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:54.680+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:26:55.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:55.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:26:55.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:55.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:55.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:55.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:55.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:55.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:55.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:55.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:55.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:55.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:55.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:55.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:55.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:55.228+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:55.438 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:26:55.436+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:26:58.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:58.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:26:58.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:58.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:26:58.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:58.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:26:58.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:58.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:26:58.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:58.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:26:58.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:58.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:26:58.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:58.512+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:26:58.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:58.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:26:58.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:58.524+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:26:58.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:58.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:26:58.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:26:58.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:01.540 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:27:01.532+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:27:02.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:27:02.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:02.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:02.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:02.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:02.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:02.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.628+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:02.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:02.641 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.636+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:02.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:27:02.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:27:02.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:27:02.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:02.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:02.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:02.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:02.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:02.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:02.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:02.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:02.796+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:03.247 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:27:03.244+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:27:05.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:05.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:27:05.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:05.816+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:05.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:05.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:05.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:05.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:05.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:05.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:05.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:05.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:05.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:05.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:05.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:05.852+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:05.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:05.884+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:05.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:05.896+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:05.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:05.896+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:05.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:05.896+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:07.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:07.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:07.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:07.632+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:07.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:07.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:07.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:07.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:08.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:08.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:08.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:08.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:08.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:08.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:08.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:08.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:08.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:08.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:08.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:08.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:08.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:08.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:08.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:08.044+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:08.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:08.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:08.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:08.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:09.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:09.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:27:09.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:09.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:09.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:09.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:09.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:09.784+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:09.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:09.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:09.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:09.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:09.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:09.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:09.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:09.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:09.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:09.888+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:09.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:09.888+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:09.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:09.888+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:09.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:09.888+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:12.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:12.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:12.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:12.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:12.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:12.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:12.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:12.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:12.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:12.096+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:12.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:12.096+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:12.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:12.104+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:12.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:12.140+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:12.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:12.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:12.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:12.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:13.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:13.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:27:13.039 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:27:13.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:13.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:13.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:13.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:13.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:13.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:13.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:13.040+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:13.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:13.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:13.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:13.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:13.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:13.060+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:13.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:13.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:13.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:13.076+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:13.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:13.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:13.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:13.076+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:13.891 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:27:13.891 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:27:13.929 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2778,"stamp":"2023-10-14T01:27:13.746793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29865013715,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2413636,"num_read_kb":9388908,"num_write":2367830,"num_write_kb":9469855,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80542,"ondisk_log_size":80542,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23369964,"kb_used_data":18941708,"kb_used_omap":2788,"kb_used_meta":4425435,"kb_avail":259745556,"statfs":{"total":289910292480,"available":265979449344,"internally_reserved":0,"allocated":19396308992,"data_stored":31967269923,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2855552,"internal_metadata":4531645824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,8,4,18,18,11],"upper_bound":256},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15421440,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3993,"num_read_kb":15948,"num_write":3966,"num_write_kb":15864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001627"},"pg_stats":[{"pgid":"2.7","version":"165'304441","reported_seq":596419,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-14T01:27:09.304899+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:27:09.304899+0000","last_peered":"2023-10-14T01:27:09.304899+0000","last_clean":"2023-10-14T01:27:09.304899+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:27:09.304899+0000","last_undegraded":"2023-10-14T01:27:09.304899+0000","last_fullsized":"2023-10-14T01:27:09.304899+0000","mapping_epoch":13,"log_start":"161'294417","ondisk_log_start":"161'294417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3633480216,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":293680,"num_read_kb":1141740,"num_write":286899,"num_write_kb":1147249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"165'319671","reported_seq":629897,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:27:09.043726+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:27:09.043726+0000","last_peered":"2023-10-14T01:27:09.043726+0000","last_clean":"2023-10-14T01:27:09.043726+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:27:09.043726+0000","last_undegraded":"2023-10-14T01:27:09.043726+0000","last_fullsized":"2023-10-14T01:27:09.043726+0000","mapping_epoch":13,"log_start":"161'309617","ondisk_log_start":"161'309617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":626,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 174s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3842158810,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":313629,"num_read_kb":1210432,"num_write":303434,"num_write_kb":1213265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"165'297613","reported_seq":586196,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:27:09.314420+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:27:09.314420+0000","last_peered":"2023-10-14T01:27:09.314420+0000","last_clean":"2023-10-14T01:27:09.314420+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:27:09.314420+0000","last_undegraded":"2023-10-14T01:27:09.314420+0000","last_fullsized":"2023-10-14T01:27:09.314420+0000","mapping_epoch":13,"log_start":"161'287525","ondisk_log_start":"161'287525","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":589,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 163s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3608650432,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":290430,"num_read_kb":1132879,"num_write":285983,"num_write_kb":1143622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"165'296396","reported_seq":586659,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-14T01:27:09.304889+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:27:09.304889+0000","last_peered":"2023-10-14T01:27:09.304889+0000","last_clean":"2023-10-14T01:27:09.304889+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:27:09.304889+0000","last_undegraded":"2023-10-14T01:27:09.304889+0000","last_fullsized":"2023-10-14T01:27:09.304889+0000","mapping_epoch":13,"log_start":"161'286322","ondisk_log_start":"161'286322","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3626005162,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":291775,"num_read_kb":1141604,"num_write":288186,"num_write_kb":1152493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"166'300412","reported_seq":599155,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:27:13.009062+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:27:13.009062+0000","last_peered":"2023-10-14T01:27:13.009062+0000","last_clean":"2023-10-14T01:27:13.009062+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:27:13.009062+0000","last_undegraded":"2023-10-14T01:27:13.009062+0000","last_fullsized":"2023-10-14T01:27:13.009062+0000","mapping_epoch":13,"log_start":"161'290323","ondisk_log_start":"161'290323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3699012105,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":300616,"num_read_kb":1164210,"num_write":294029,"num_write_kb":1175637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"165'302132","reported_seq":598992,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-14T01:27:08.933840+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:27:08.933840+0000","last_peered":"2023-10-14T01:27:08.933840+0000","last_clean":"2023-10-14T01:27:08.933840+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:27:08.933840+0000","last_undegraded":"2023-10-14T01:27:08.933840+0000","last_fullsized":"2023-10-14T01:27:08.933840+0000","mapping_epoch":13,"log_start":"161'292112","ondisk_log_start":"161'292112","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3742150974,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":298337,"num_read_kb":1170410,"num_write":296670,"num_write_kb":1186519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"165'303797","reported_seq":603190,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-14T01:27:08.925819+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:27:08.925819+0000","last_peered":"2023-10-14T01:27:08.925819+0000","last_clean":"2023-10-14T01:27:08.925819+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:27:08.925819+0000","last_undegraded":"2023-10-14T01:27:08.925819+0000","last_fullsized":"2023-10-14T01:27:08.925819+0000","mapping_epoch":13,"log_start":"161'293716","ondisk_log_start":"161'293716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3775832615,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":300670,"num_read_kb":1181028,"num_write":298289,"num_write_kb":1193019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"165'344929","reported_seq":667139,"reported_epoch":165,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:27:09.292013+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:27:09.292013+0000","last_peered":"2023-10-14T01:27:09.292013+0000","last_clean":"2023-10-14T01:27:09.292013+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:27:09.292013+0000","last_undegraded":"2023-10-14T01:27:09.292013+0000","last_fullsized":"2023-10-14T01:27:09.292013+0000","mapping_epoch":13,"log_start":"161'334916","ondisk_log_start":"161'334916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1808,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 778s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3937133033,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":324393,"num_read_kb":1246514,"num_write":314203,"num_write_kb":1256157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":347,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-10-14T01:26:07.764255+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:26:07.764255+0000","last_peered":"2023-10-14T01:26:07.764255+0000","last_clean":"2023-10-14T01:26:07.764255+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:26:07.764255+0000","last_undegraded":"2023-10-14T01:26:07.764255+0000","last_fullsized":"2023-10-14T01:26:07.764255+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29864423347,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2413530,"num_read_kb":9388817,"num_write":2367693,"num_write_kb":9467961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19392671744,"data_stored":31965163366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53766,"internal_metadata":0},"log_size":80443,"ondisk_log_size":80443,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739411,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5345580,"kb_used_data":3636636,"kb_used_omap":670,"kb_used_meta":1708257,"kb_avail":89026260,"statfs":{"total":96636764160,"available":91162890240,"internally_reserved":0,"allocated":3723915264,"data_stored":6113801741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":686442,"internal_metadata":1749255830},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,8,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:26:59 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.70799999999999996,"15min":0.86599999999999999},"min":{"1min":0.22,"5min":0.188,"15min":0.17399999999999999},"max":{"1min":7.859,"5min":7.859,"15min":10.981999999999999},"last":0.313},{"interface":"front","average":{"1min":1.127,"5min":0.75700000000000001,"15min":0.91400000000000003},"min":{"1min":0.28599999999999998,"5min":0.27500000000000002,"15min":0.215},"max":{"1min":7.9020000000000001,"5min":7.9020000000000001,"15min":11.039},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Oct 14 01:26:59 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.23300000000000001,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":8.4179999999999993,"5min":8.4179999999999993,"15min":8.4179999999999993},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.63300000000000001,"15min":0.78900000000000003},"min":{"1min":0.25700000000000001,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":4.7000000000000002,"5min":4.9379999999999997,"15min":8.3699999999999992},"last":0.373}]}]},{"osd":1,"up_from":8,"seq":34359739393,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10308424,"kb_used_data":9468864,"kb_used_omap":1070,"kb_used_meta":838481,"kb_avail":84063416,"statfs":{"total":96636764160,"available":86080937984,"internally_reserved":0,"allocated":9696116736,"data_stored":15982031506,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":858605045},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,6,2,9,16,11],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.84999999999999998,"15min":0.92200000000000004},"min":{"1min":0.26000000000000001,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":5.5940000000000003,"5min":6.673,"15min":12.076000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.77000000000000002,"15min":0.88300000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.185},"max":{"1min":1.8089999999999999,"5min":7.1120000000000001,"15min":17.196999999999999},"last":0.23999999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:26:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.615,"15min":1.8089999999999999},"min":{"1min":0.20200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":6.7439999999999998,"5min":17.547999999999998,"15min":17.547999999999998},"last":4.7240000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.84199999999999997,"15min":0.747},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.20699999999999999},"max":{"1min":1.091,"5min":11.323,"15min":11.323},"last":0.41999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739412,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7715960,"kb_used_data":5836208,"kb_used_omap":1047,"kb_used_meta":1878696,"kb_avail":86655880,"statfs":{"total":96636764160,"available":88735621120,"internally_reserved":0,"allocated":5976276992,"data_stored":9871436676,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":1923784949},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,1,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.93200000000000005,"15min":0.93600000000000005},"min":{"1min":0.19500000000000001,"5min":0.158,"15min":0.158},"max":{"1min":2.5899999999999999,"5min":6.7160000000000002,"15min":7.8899999999999997},"last":0.35899999999999999},{"interface":"front","average":{"1min":1.1859999999999999,"5min":0.82099999999999995,"15min":1.0940000000000001},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.188},"max":{"1min":4.4409999999999998,"5min":6.6280000000000001,"15min":13.903},"last":0.33600000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.76600000000000001,"15min":0.82499999999999996},"min":{"1min":0.222,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":4.4790000000000001,"5min":6.1879999999999997,"15min":7.2640000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":1.038,"15min":0.94199999999999995},"min":{"1min":0.20899999999999999,"5min":0.187,"15min":0.187},"max":{"1min":5.5119999999999996,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.432}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5975109632,"data_stored":9870604901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9694670848,"data_stored":15980916659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3722891264,"data_stored":6113641806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:27:13.931 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:27:13.931 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:27:13.931 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:27:13.932 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:27:17.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:17.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:17.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:17.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:17.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:17.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:17.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:17.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.224+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:17.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:17.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:17.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:27:17.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:17.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:17.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:17.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:17.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:17.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:17.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:17.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.628+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:17.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.644+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:17.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:17.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:18.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:18.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:18.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:18.952+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:19.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:19.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:19.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:19.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:19.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:19.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:19.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:19.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:19.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:19.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:19.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:19.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:19.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:19.276+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:19.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:19.288+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:19.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:19.296+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:19.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:19.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:19.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:19.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:20.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:20.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:20.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:20.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:20.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:20.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:20.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:20.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:20.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:20.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:20.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:20.396+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:20.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:20.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:20.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:20.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:21.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:21.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:21.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:21.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:21.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:21.504+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:21.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:21.504+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:21.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:21.504+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:22.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:22.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:27:22.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:22.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:22.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:22.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:22.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:22.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:22.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:22.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:22.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:22.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:22.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:22.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:22.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:22.692+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:22.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:22.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:22.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:22.748+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:22.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:22.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:22.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:22.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:27.632 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:27:27.632+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:27:28.084 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:27:28.084+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:27:28.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:28.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:28.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:28.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:28.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:28.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:28.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:28.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:28.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:28.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:28.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:28.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:28.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:28.288+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:28.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:28.288+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:28.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:28.288+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:28.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:28.288+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:28.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:28.288+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:30.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:30.408+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:27:30.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:30.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:30.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:30.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:30.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:30.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:30.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:30.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:30.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:30.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:30.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:30.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:30.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:30.476+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:30.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:30.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:30.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:30.488+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:30.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:30.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:30.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:30.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:31.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:31.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:31.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:31.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:31.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:31.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:31.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:31.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:31.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:31.376+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:31.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:31.416+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:31.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:31.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:31.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:31.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:33.039 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:27:33.036+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:27:33.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:33.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:33.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:33.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:33.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:33.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:33.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:33.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:33.933 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:27:33.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:33.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:33.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:33.940+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:33.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:33.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:33.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:33.980+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:33.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:33.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:33.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:33.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:34.653 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:27:34.654 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:27:34.728 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2788,"stamp":"2023-10-14T01:27:33.755367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29895770579,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2421585,"num_read_kb":9420664,"num_write":2375699,"num_write_kb":9501331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80647,"ondisk_log_size":80647,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23576044,"kb_used_data":19004112,"kb_used_omap":2788,"kb_used_meta":4569115,"kb_avail":259539476,"statfs":{"total":289910292480,"available":265768423424,"internally_reserved":0,"allocated":19460210688,"data_stored":32031162531,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2855552,"internal_metadata":4678774144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3,2,8,15,18,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16596992,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4296,"num_read_kb":17172,"num_write":4246,"num_write_kb":16984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006497"},"pg_stats":[{"pgid":"2.7","version":"166'305409","reported_seq":598321,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:27:29.715190+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:27:29.715190+0000","last_peered":"2023-10-14T01:27:29.715190+0000","last_clean":"2023-10-14T01:27:29.715190+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:27:29.715190+0000","last_undegraded":"2023-10-14T01:27:29.715190+0000","last_fullsized":"2023-10-14T01:27:29.715190+0000","mapping_epoch":13,"log_start":"161'295317","ondisk_log_start":"161'295317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3637195288,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":294601,"num_read_kb":1145416,"num_write":287834,"num_write_kb":1150989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"166'320799","reported_seq":632104,"reported_epoch":166,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:27:29.719921+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:27:29.719921+0000","last_peered":"2023-10-14T01:27:29.719921+0000","last_clean":"2023-10-14T01:27:29.719921+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:27:29.719921+0000","last_undegraded":"2023-10-14T01:27:29.719921+0000","last_fullsized":"2023-10-14T01:27:29.719921+0000","mapping_epoch":13,"log_start":"161'310717","ondisk_log_start":"161'310717","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":669,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 195s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3846226138,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":314688,"num_read_kb":1214668,"num_write":304479,"num_write_kb":1217445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"166'298623","reported_seq":588189,"reported_epoch":166,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:27:29.690727+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:27:29.690727+0000","last_peered":"2023-10-14T01:27:29.690727+0000","last_clean":"2023-10-14T01:27:29.690727+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:27:29.690727+0000","last_undegraded":"2023-10-14T01:27:29.690727+0000","last_fullsized":"2023-10-14T01:27:29.690727+0000","mapping_epoch":13,"log_start":"161'288525","ondisk_log_start":"161'288525","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":685,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 184s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3612259008,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":291398,"num_read_kb":1136751,"num_write":286903,"num_write_kb":1147302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"166'297386","reported_seq":588622,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:27:29.678188+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:27:29.678188+0000","last_peered":"2023-10-14T01:27:29.678188+0000","last_clean":"2023-10-14T01:27:29.678188+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:27:29.678188+0000","last_undegraded":"2023-10-14T01:27:29.678188+0000","last_fullsized":"2023-10-14T01:27:29.678188+0000","mapping_epoch":13,"log_start":"161'287322","ondisk_log_start":"161'287322","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10064,"log_dups_size":0,"ondisk_log_size":10064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3629789866,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":292743,"num_read_kb":1145468,"num_write":289165,"num_write_kb":1156409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"166'301394","reported_seq":601125,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:27:33.101604+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:27:33.101604+0000","last_peered":"2023-10-14T01:27:33.101604+0000","last_clean":"2023-10-14T01:27:33.101604+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:27:33.101604+0000","last_undegraded":"2023-10-14T01:27:33.101604+0000","last_fullsized":"2023-10-14T01:27:33.101604+0000","mapping_epoch":13,"log_start":"161'291323","ondisk_log_start":"161'291323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3702800905,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":301592,"num_read_kb":1168102,"num_write":294996,"num_write_kb":1179505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"166'303065","reported_seq":600976,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:27:28.999409+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:27:28.999409+0000","last_peered":"2023-10-14T01:27:28.999409+0000","last_clean":"2023-10-14T01:27:28.999409+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:27:28.999409+0000","last_undegraded":"2023-10-14T01:27:28.999409+0000","last_fullsized":"2023-10-14T01:27:28.999409+0000","mapping_epoch":13,"log_start":"161'293012","ondisk_log_start":"161'293012","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3745816894,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":299382,"num_read_kb":1174582,"num_write":297596,"num_write_kb":1190223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"166'304802","reported_seq":605183,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:27:28.988089+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:27:28.988089+0000","last_peered":"2023-10-14T01:27:28.988089+0000","last_clean":"2023-10-14T01:27:28.988089+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:27:28.988089+0000","last_undegraded":"2023-10-14T01:27:28.988089+0000","last_fullsized":"2023-10-14T01:27:28.988089+0000","mapping_epoch":13,"log_start":"161'294716","ondisk_log_start":"161'294716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3779785255,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":301651,"num_read_kb":1184952,"num_write":299287,"num_write_kb":1197011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"166'346118","reported_seq":669388,"reported_epoch":166,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:27:29.724677+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:27:29.724677+0000","last_peered":"2023-10-14T01:27:29.724677+0000","last_clean":"2023-10-14T01:27:29.724677+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:27:29.724677+0000","last_undegraded":"2023-10-14T01:27:29.724677+0000","last_fullsized":"2023-10-14T01:27:29.724677+0000","mapping_epoch":13,"log_start":"162'336116","ondisk_log_start":"162'336116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1841,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 799s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3941306857,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":325424,"num_read_kb":1250634,"num_write":315302,"num_write_kb":1260553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":348,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-14T01:26:55.368278+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:26:55.368278+0000","last_peered":"2023-10-14T01:26:55.368278+0000","last_clean":"2023-10-14T01:26:55.368278+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:26:55.368278+0000","last_undegraded":"2023-10-14T01:26:55.368278+0000","last_fullsized":"2023-10-14T01:26:55.368278+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29895180211,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2421479,"num_read_kb":9420573,"num_write":2375562,"num_write_kb":9499437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19456974848,"data_stored":32029466470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53766,"internal_metadata":0},"log_size":80548,"ondisk_log_size":80548,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739415,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5432076,"kb_used_data":3648644,"kb_used_omap":670,"kb_used_meta":1782753,"kb_avail":88939764,"statfs":{"total":96636764160,"available":91074318336,"internally_reserved":0,"allocated":3736211456,"data_stored":6126093389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":686442,"internal_metadata":1825539734},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,0,7,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:26:59 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.70799999999999996,"15min":0.86599999999999999},"min":{"1min":0.22,"5min":0.188,"15min":0.17399999999999999},"max":{"1min":7.859,"5min":7.859,"15min":10.981999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.127,"5min":0.75700000000000001,"15min":0.91400000000000003},"min":{"1min":0.28599999999999998,"5min":0.27500000000000002,"15min":0.215},"max":{"1min":7.9020000000000001,"5min":7.9020000000000001,"15min":11.039},"last":0.53500000000000003}]},{"osd":1,"last update":"Sat Oct 14 01:26:59 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.23300000000000001,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":8.4179999999999993,"5min":8.4179999999999993,"15min":8.4179999999999993},"last":0.432},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.63300000000000001,"15min":0.78900000000000003},"min":{"1min":0.25700000000000001,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":4.7000000000000002,"5min":4.9379999999999997,"15min":8.3699999999999992},"last":0.47399999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739397,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10350664,"kb_used_data":9500220,"kb_used_omap":1070,"kb_used_meta":849361,"kb_avail":84021176,"statfs":{"total":96636764160,"available":86037684224,"internally_reserved":0,"allocated":9728225280,"data_stored":16014135506,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":869746165},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,1,4,4,13,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.84999999999999998,"15min":0.92200000000000004},"min":{"1min":0.26000000000000001,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":5.5940000000000003,"5min":6.673,"15min":12.076000000000001},"last":4.2039999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.77000000000000002,"15min":0.88300000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.185},"max":{"1min":1.8089999999999999,"5min":7.1120000000000001,"15min":17.196999999999999},"last":0.20000000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:26:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.615,"15min":1.8089999999999999},"min":{"1min":0.20200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":6.7439999999999998,"5min":17.547999999999998,"15min":17.547999999999998},"last":0.377},{"interface":"front","average":{"1min":0.38,"5min":0.84199999999999997,"15min":0.747},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.20699999999999999},"max":{"1min":1.091,"5min":11.323,"15min":11.323},"last":4.0339999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739416,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7793304,"kb_used_data":5855248,"kb_used_omap":1047,"kb_used_meta":1937000,"kb_avail":86578536,"statfs":{"total":96636764160,"available":88656420864,"internally_reserved":0,"allocated":5995773952,"data_stored":9890933636,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":1983488245},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,1,4,4,2,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.93200000000000005,"15min":0.93600000000000005},"min":{"1min":0.19500000000000001,"5min":0.158,"15min":0.158},"max":{"1min":2.5899999999999999,"5min":6.7160000000000002,"15min":7.8899999999999997},"last":0.28999999999999998},{"interface":"front","average":{"1min":1.1859999999999999,"5min":0.82099999999999995,"15min":1.0940000000000001},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.188},"max":{"1min":4.4409999999999998,"5min":6.6280000000000001,"15min":13.903},"last":0.311}]},{"osd":2,"last update":"Sat Oct 14 01:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.76600000000000001,"15min":0.82499999999999996},"min":{"1min":0.222,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":4.4790000000000001,"5min":6.1879999999999997,"15min":7.2640000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":1.038,"15min":0.94199999999999995},"min":{"1min":0.20899999999999999,"5min":0.187,"15min":0.187},"max":{"1min":5.5119999999999996,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.48799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5994766336,"data_stored":9890261605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9727025152,"data_stored":16013270963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3735183360,"data_stored":6125933902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:27:34.729 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:27:34.730 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:27:34.730 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:27:34.731 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:27:36.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:36.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:36.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:36.236+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:36.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:36.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:36.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:36.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:36.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:36.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:36.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:36.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:36.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:36.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:36.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:36.324+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:38.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:38.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:38.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:38.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:38.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:38.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:38.861 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:38.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:38.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:38.864+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:38.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:38.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:38.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:38.880+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:38.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:38.896+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:38.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:38.900+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:38.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:38.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:38.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:38.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:40.292 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:27:40.291+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:27:41.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:27:41.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:27:41.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:41.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:41.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:41.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:41.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:41.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.151+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:41.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.151+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:41.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.159+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:41.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.183+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:41.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:41.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:41.183+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:41.331 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:27:41.327+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:27:42.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:42.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:42.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:42.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:42.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:42.247+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:42.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:42.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:42.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:42.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:42.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:42.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:42.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:42.311+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:42.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:42.315+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:42.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:42.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:42.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:42.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:43.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:43.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:43.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:43.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:43.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:43.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:43.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:43.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:43.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:43.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:43.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:43.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:43.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:43.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:43.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:43.747+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:43.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:43.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:43.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:43.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:45.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:27:45.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:27:45.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:27:45.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:45.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:45.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:45.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:45.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:45.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:45.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:45.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:45.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.411+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:45.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:45.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.423+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:45.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:27:45.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:45.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:45.660 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:45.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:45.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:45.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:45.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:45.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:45.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.775+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:45.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:45.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:45.779+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:47.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:47.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:47.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:47.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:47.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:47.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:47.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:47.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:47.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:47.787+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:47.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:47.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:47.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:47.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:47.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:47.787+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:47.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:47.787+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:48.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:48.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:48.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:48.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:48.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.091+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:48.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:48.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:48.831 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:48.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:48.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:48.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:48.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.891+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:48.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.891+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:48.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:48.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.927+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:48.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:48.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:48.927+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:49.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:49.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:27:49.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:49.175+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:27:49.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:49.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:49.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:49.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:49.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:49.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:49.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:49.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:49.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:49.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:49.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:49.231+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:49.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:49.283+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:49.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:49.303+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:49.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:49.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:49.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:49.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:50.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:50.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:50.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:50.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:50.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:50.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.339+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:50.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:50.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:27:50.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:50.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:50.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:50.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:50.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:50.443+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:51.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:51.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:27:51.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:51.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:51.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:51.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:51.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:51.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:51.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:51.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:51.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:51.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:51.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:51.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:51.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:51.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:51.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:51.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:51.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:51.099+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:51.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:51.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:51.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:51.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:52.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:52.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:52.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:52.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:52.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:52.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:52.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:52.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:52.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:52.727+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:52.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:52.739+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:53.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:53.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:53.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:53.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:53.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:53.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:53.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:53.343+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:53.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:53.355+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:53.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:53.363+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:53.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:53.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:53.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:53.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:53.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:53.371+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:53.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:53.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:54.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:54.663 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:54.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.659+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:54.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:54.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:54.732 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:27:54.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:54.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.739+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:54.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:54.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.751+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:54.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.751+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:54.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.751+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:54.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:27:54.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:27:54.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:54.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:54.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:54.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:54.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:54.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:54.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:54.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.955+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:54.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:54.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:55.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:55.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:27:55.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:55.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:27:55.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:55.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:55.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:55.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:55.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:55.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:55.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:55.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:27:55.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:55.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:27:55.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:55.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:27:55.751 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:27:55.752 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:27:55.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:55.759+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:27:55.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:55.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:27:55.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:55.759+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:27:55.784 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2798,"stamp":"2023-10-14T01:27:53.759081+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29926891987,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2429347,"num_read_kb":9451680,"num_write":2383690,"num_write_kb":9533295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80531,"ondisk_log_size":80531,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23878612,"kb_used_data":19067964,"kb_used_omap":2788,"kb_used_meta":4807835,"kb_avail":259236908,"statfs":{"total":289910292480,"available":265458593792,"internally_reserved":0,"allocated":19525595136,"data_stored":32096546979,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2855552,"internal_metadata":4923223424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,6,9,10,5,6,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16674816,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4087,"num_read_kb":16328,"num_write":4273,"num_write_kb":17092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002365"},"pg_stats":[{"pgid":"2.7","version":"166'306414","reported_seq":600250,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:27:50.357213+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:27:50.357213+0000","last_peered":"2023-10-14T01:27:50.357213+0000","last_clean":"2023-10-14T01:27:50.357213+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:27:50.357213+0000","last_undegraded":"2023-10-14T01:27:50.357213+0000","last_fullsized":"2023-10-14T01:27:50.357213+0000","mapping_epoch":13,"log_start":"161'296317","ondisk_log_start":"161'296317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3640955416,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":295515,"num_read_kb":1149072,"num_write":288791,"num_write_kb":1154817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"166'321923","reported_seq":634319,"reported_epoch":166,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:27:50.372500+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:27:50.372500+0000","last_peered":"2023-10-14T01:27:50.372500+0000","last_clean":"2023-10-14T01:27:50.372500+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:27:50.372500+0000","last_undegraded":"2023-10-14T01:27:50.372500+0000","last_fullsized":"2023-10-14T01:27:50.372500+0000","mapping_epoch":13,"log_start":"162'311917","ondisk_log_start":"162'311917","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":725,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 215s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3850264794,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":315759,"num_read_kb":1218952,"num_write":305518,"num_write_kb":1221601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"166'299724","reported_seq":590252,"reported_epoch":166,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:27:50.379677+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:27:50.379677+0000","last_peered":"2023-10-14T01:27:50.379677+0000","last_clean":"2023-10-14T01:27:50.379677+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:27:50.379677+0000","last_undegraded":"2023-10-14T01:27:50.379677+0000","last_fullsized":"2023-10-14T01:27:50.379677+0000","mapping_epoch":13,"log_start":"162'289625","ondisk_log_start":"162'289625","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":774,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 204s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3616166592,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":292348,"num_read_kb":1140543,"num_write":287903,"num_write_kb":1151302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"166'298432","reported_seq":590602,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:27:50.346356+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:27:50.346356+0000","last_peered":"2023-10-14T01:27:50.346356+0000","last_clean":"2023-10-14T01:27:50.346356+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:27:50.346356+0000","last_undegraded":"2023-10-14T01:27:50.346356+0000","last_fullsized":"2023-10-14T01:27:50.346356+0000","mapping_epoch":13,"log_start":"161'288422","ondisk_log_start":"161'288422","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3633717930,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":293673,"num_read_kb":1149180,"num_write":290196,"num_write_kb":1160533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"166'302354","reported_seq":603024,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:27:53.251440+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:27:53.251440+0000","last_peered":"2023-10-14T01:27:53.251440+0000","last_clean":"2023-10-14T01:27:53.251440+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:27:53.251440+0000","last_undegraded":"2023-10-14T01:27:53.251440+0000","last_fullsized":"2023-10-14T01:27:53.251440+0000","mapping_epoch":13,"log_start":"161'292323","ondisk_log_start":"161'292323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3706544649,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":302521,"num_read_kb":1171806,"num_write":295953,"num_write_kb":1183333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"166'304075","reported_seq":602903,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:27:49.085952+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:27:49.085952+0000","last_peered":"2023-10-14T01:27:49.085952+0000","last_clean":"2023-10-14T01:27:49.085952+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:27:49.085952+0000","last_undegraded":"2023-10-14T01:27:49.085952+0000","last_fullsized":"2023-10-14T01:27:49.085952+0000","mapping_epoch":13,"log_start":"161'294012","ondisk_log_start":"161'294012","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3749773630,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":300294,"num_read_kb":1178230,"num_write":298599,"num_write_kb":1194235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"166'305794","reported_seq":607194,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:27:49.114202+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:27:49.114202+0000","last_peered":"2023-10-14T01:27:49.114202+0000","last_clean":"2023-10-14T01:27:49.114202+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:27:49.114202+0000","last_undegraded":"2023-10-14T01:27:49.114202+0000","last_fullsized":"2023-10-14T01:27:49.114202+0000","mapping_epoch":13,"log_start":"161'295716","ondisk_log_start":"161'295716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3783672359,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":302669,"num_read_kb":1189024,"num_write":300272,"num_write_kb":1200951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"166'347264","reported_seq":671598,"reported_epoch":166,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:27:50.312433+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:27:50.312433+0000","last_peered":"2023-10-14T01:27:50.312433+0000","last_clean":"2023-10-14T01:27:50.312433+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:27:50.312433+0000","last_undegraded":"2023-10-14T01:27:50.312433+0000","last_fullsized":"2023-10-14T01:27:50.312433+0000","mapping_epoch":13,"log_start":"163'337216","ondisk_log_start":"163'337216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1892,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 819s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3945206249,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":326462,"num_read_kb":1254782,"num_write":316321,"num_write_kb":1264629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":348,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-10-14T01:26:55.368278+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:26:55.368278+0000","last_peered":"2023-10-14T01:26:55.368278+0000","last_clean":"2023-10-14T01:26:55.368278+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:26:55.368278+0000","last_undegraded":"2023-10-14T01:26:55.368278+0000","last_fullsized":"2023-10-14T01:26:55.368278+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29926301619,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2429241,"num_read_kb":9451589,"num_write":2383553,"num_write_kb":9531401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19522248704,"data_stored":32094740326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53766,"internal_metadata":0},"log_size":80432,"ondisk_log_size":80432,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739419,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5475860,"kb_used_data":3660556,"kb_used_omap":670,"kb_used_meta":1814625,"kb_avail":88895980,"statfs":{"total":96636764160,"available":91029483520,"internally_reserved":0,"allocated":3748409344,"data_stored":6138291277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":686442,"internal_metadata":1858176662},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,5,0,1,3,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:26:59 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.70799999999999996,"15min":0.86599999999999999},"min":{"1min":0.22,"5min":0.188,"15min":0.17399999999999999},"max":{"1min":7.859,"5min":7.859,"15min":10.981999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.127,"5min":0.75700000000000001,"15min":0.91400000000000003},"min":{"1min":0.28599999999999998,"5min":0.27500000000000002,"15min":0.215},"max":{"1min":7.9020000000000001,"5min":7.9020000000000001,"15min":11.039},"last":1.1759999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:26:59 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.75900000000000001,"15min":0.76200000000000001},"min":{"1min":0.23300000000000001,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":8.4179999999999993,"5min":8.4179999999999993,"15min":8.4179999999999993},"last":0.316},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.63300000000000001,"15min":0.78900000000000003},"min":{"1min":0.25700000000000001,"5min":0.24199999999999999,"15min":0.23300000000000001},"max":{"1min":4.7000000000000002,"5min":4.9379999999999997,"15min":8.3699999999999992},"last":0.36199999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739401,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10517944,"kb_used_data":9532848,"kb_used_omap":1070,"kb_used_meta":984017,"kb_avail":83853896,"statfs":{"total":96636764160,"available":85866389504,"internally_reserved":0,"allocated":9761636352,"data_stored":16047546578,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":1007633909},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,7,6,2,4,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.84999999999999998,"15min":0.92200000000000004},"min":{"1min":0.26000000000000001,"5min":0.19600000000000001,"15min":0.183},"max":{"1min":5.5940000000000003,"5min":6.673,"15min":12.076000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.77000000000000002,"15min":0.88300000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.185},"max":{"1min":1.8089999999999999,"5min":7.1120000000000001,"15min":17.196999999999999},"last":0.34300000000000003}]},{"osd":2,"last update":"Sat Oct 14 01:26:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.615,"15min":1.8089999999999999},"min":{"1min":0.20200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":6.7439999999999998,"5min":17.547999999999998,"15min":17.547999999999998},"last":3.6509999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.84199999999999997,"15min":0.747},"min":{"1min":0.23300000000000001,"5min":0.21199999999999999,"15min":0.20699999999999999},"max":{"1min":1.091,"5min":11.323,"15min":11.323},"last":18.399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739420,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7884808,"kb_used_data":5874560,"kb_used_omap":1047,"kb_used_meta":2009192,"kb_avail":86487032,"statfs":{"total":96636764160,"available":88562720768,"internally_reserved":0,"allocated":6015549440,"data_stored":9910709124,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1072907,"internal_metadata":2057412853},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,2,3,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.93200000000000005,"15min":0.93600000000000005},"min":{"1min":0.19500000000000001,"5min":0.158,"15min":0.158},"max":{"1min":2.5899999999999999,"5min":6.7160000000000002,"15min":7.8899999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":1.1859999999999999,"5min":0.82099999999999995,"15min":1.0940000000000001},"min":{"1min":0.25700000000000001,"5min":0.22,"15min":0.188},"max":{"1min":4.4409999999999998,"5min":6.6280000000000001,"15min":13.903},"last":0.312}]},{"osd":2,"last update":"Sat Oct 14 01:26:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.76600000000000001,"15min":0.82499999999999996},"min":{"1min":0.222,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":4.4790000000000001,"5min":6.1879999999999997,"15min":7.2640000000000002},"last":0.376},{"interface":"front","average":{"1min":0.80300000000000005,"5min":1.038,"15min":0.94199999999999995},"min":{"1min":0.20899999999999999,"5min":0.187,"15min":0.187},"max":{"1min":5.5119999999999996,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.438}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6014693376,"data_stored":9910188645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9760174080,"data_stored":16046419891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3747381248,"data_stored":6138131790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:27:55.786 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:27:55.786 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:27:55.787 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:27:55.787 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:27:55.885 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:27:55.883+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:27:58.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:58.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:27:58.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:58.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:27:58.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:58.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:27:58.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:27:58.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:01.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:01.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:01.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:01.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:01.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:01.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:01.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:01.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:01.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:01.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:01.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:01.675+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:01.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:01.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:01.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:01.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:01.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:01.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:28:01.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:01.675+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:02.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:02.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:02.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.259+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:02.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.283+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:02.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:02.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:02.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:02.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:02.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:02.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:02.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:02.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:02.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.483+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:02.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.491+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:02.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:02.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:02.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:03.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:03.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:03.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:03.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:03.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:03.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:03.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:03.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:04.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:04.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:04.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.131+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:04.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.139+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:04.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:04.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:04.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:04.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:04.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.219+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:04.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:04.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:04.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:04.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:04.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:04.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.579+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:04.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.583+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:04.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:04.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:04.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.631+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:04.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.687+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:04.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.723+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:04.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:04.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:04.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:06.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:28:06.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:06.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:06.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:06.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:06.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:06.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:06.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.315+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:06.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:06.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.319+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:06.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:06.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:06.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.775+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:06.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:06.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:06.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:06.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:06.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.843+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:06.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:06.867+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:08.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:08.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:08.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:08.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:08.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:08.547+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:08.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:08.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:08.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:08.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:08.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:08.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:08.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:08.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:08.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:08.679+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:08.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:08.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:08.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:08.707+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:08.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:08.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:08.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:08.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:11.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:28:11.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:28:11.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:28:11.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:11.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:11.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.287+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:11.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:11.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:11.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.311+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:11.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:11.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.319+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:11.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:11.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.359+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:11.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:11.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.359+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:11.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:11.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:11.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:11.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.423+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:11.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:11.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:11.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.475+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:11.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:11.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:11.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.491+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:11.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:11.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:11.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:13.296 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:28:13.295+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:28:15.789 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:28:15.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:15.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:15.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:15.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:15.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:15.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:15.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:15.983+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:16.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:15.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:16.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:15.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:16.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:16.019+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:16.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:16.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:16.330 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:28:16.331 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:28:16.385 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2809,"stamp":"2023-10-14T01:28:15.768924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29959832019,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2437534,"num_read_kb":9484340,"num_write":2392129,"num_write_kb":9567051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80466,"ondisk_log_size":80466,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24051436,"kb_used_data":19133844,"kb_used_omap":2893,"kb_used_meta":4914674,"kb_avail":259064084,"statfs":{"total":289910292480,"available":265281622016,"internally_reserved":0,"allocated":19593056256,"data_stored":32164008099,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2963220,"internal_metadata":5032626412},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,2,18,12,16,11],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17309696,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4304,"num_read_kb":17184,"num_write":4443,"num_write_kb":17772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003358"},"pg_stats":[{"pgid":"2.7","version":"166'307388","reported_seq":602174,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:28:11.158317+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:28:11.158317+0000","last_peered":"2023-10-14T01:28:11.158317+0000","last_clean":"2023-10-14T01:28:11.158317+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:28:11.158317+0000","last_undegraded":"2023-10-14T01:28:11.158317+0000","last_fullsized":"2023-10-14T01:28:11.158317+0000","mapping_epoch":13,"log_start":"162'297317","ondisk_log_start":"162'297317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3644613144,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":296453,"num_read_kb":1152812,"num_write":289715,"num_write_kb":1158513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"166'323090","reported_seq":636544,"reported_epoch":166,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:28:11.184983+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:28:11.184983+0000","last_peered":"2023-10-14T01:28:11.184983+0000","last_clean":"2023-10-14T01:28:11.184983+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:28:11.184983+0000","last_undegraded":"2023-10-14T01:28:11.184983+0000","last_fullsized":"2023-10-14T01:28:11.184983+0000","mapping_epoch":13,"log_start":"163'313017","ondisk_log_start":"163'313017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":779,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 236s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3854463194,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":316800,"num_read_kb":1223100,"num_write":306590,"num_write_kb":1225889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"166'300732","reported_seq":592251,"reported_epoch":166,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:28:11.161358+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:28:11.161358+0000","last_peered":"2023-10-14T01:28:11.161358+0000","last_clean":"2023-10-14T01:28:11.161358+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:28:11.161358+0000","last_undegraded":"2023-10-14T01:28:11.161358+0000","last_fullsized":"2023-10-14T01:28:11.161358+0000","mapping_epoch":13,"log_start":"163'290726","ondisk_log_start":"163'290726","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":835,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 225s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3619783360,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":293315,"num_read_kb":1144407,"num_write":288831,"num_write_kb":1155014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"166'299458","reported_seq":592553,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:28:11.155787+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:28:11.155787+0000","last_peered":"2023-10-14T01:28:11.155787+0000","last_clean":"2023-10-14T01:28:11.155787+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:28:11.155787+0000","last_undegraded":"2023-10-14T01:28:11.155787+0000","last_fullsized":"2023-10-14T01:28:11.155787+0000","mapping_epoch":13,"log_start":"162'289422","ondisk_log_start":"162'289422","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3637625514,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":294597,"num_read_kb":1152868,"num_write":291204,"num_write_kb":1164565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"166'303334","reported_seq":604950,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:28:13.390393+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:28:13.390393+0000","last_peered":"2023-10-14T01:28:13.390393+0000","last_clean":"2023-10-14T01:28:13.390393+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:28:13.390393+0000","last_undegraded":"2023-10-14T01:28:13.390393+0000","last_fullsized":"2023-10-14T01:28:13.390393+0000","mapping_epoch":13,"log_start":"163'293323","ondisk_log_start":"163'293323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3710276105,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":303453,"num_read_kb":1175530,"num_write":296921,"num_write_kb":1187205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"166'305266","reported_seq":605257,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:28:14.267649+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:28:14.267649+0000","last_peered":"2023-10-14T01:28:14.267649+0000","last_clean":"2023-10-14T01:28:14.267649+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:28:14.267649+0000","last_undegraded":"2023-10-14T01:28:14.267649+0000","last_fullsized":"2023-10-14T01:28:14.267649+0000","mapping_epoch":13,"log_start":"162'295212","ondisk_log_start":"162'295212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3754406206,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":301455,"num_read_kb":1182862,"num_write":299786,"num_write_kb":1198983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"166'307095","reported_seq":609697,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:28:14.262271+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:28:14.262271+0000","last_peered":"2023-10-14T01:28:14.262271+0000","last_clean":"2023-10-14T01:28:14.262271+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:28:14.262271+0000","last_undegraded":"2023-10-14T01:28:14.262271+0000","last_fullsized":"2023-10-14T01:28:14.262271+0000","mapping_epoch":13,"log_start":"163'297016","ondisk_log_start":"163'297016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3788771879,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":303863,"num_read_kb":1193792,"num_write":301569,"num_write_kb":1206139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"166'348453","reported_seq":673849,"reported_epoch":166,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:28:11.165115+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:28:11.165115+0000","last_peered":"2023-10-14T01:28:11.165115+0000","last_clean":"2023-10-14T01:28:11.165115+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:28:11.165115+0000","last_undegraded":"2023-10-14T01:28:11.165115+0000","last_fullsized":"2023-10-14T01:28:11.165115+0000","mapping_epoch":13,"log_start":"163'338416","ondisk_log_start":"163'338416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1933,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 840s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3949302249,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":327492,"num_read_kb":1258878,"num_write":317376,"num_write_kb":1268849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":349,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:27:10.369492+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:27:10.369492+0000","last_peered":"2023-10-14T01:27:10.369492+0000","last_clean":"2023-10-14T01:27:10.369492+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:27:10.369492+0000","last_undegraded":"2023-10-14T01:27:10.369492+0000","last_fullsized":"2023-10-14T01:27:10.369492+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29959241651,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2437428,"num_read_kb":9484249,"num_write":2391992,"num_write_kb":9565157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19589980160,"data_stored":32162471782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53766,"internal_metadata":0},"log_size":80367,"ondisk_log_size":80367,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739424,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5563400,"kb_used_data":3675904,"kb_used_omap":670,"kb_used_meta":1886817,"kb_avail":88808440,"statfs":{"total":96636764160,"available":90939842560,"internally_reserved":0,"allocated":3764125696,"data_stored":6154007629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":686442,"internal_metadata":1932101270},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,8,2,3,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.70399999999999996,"15min":0.83399999999999996},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":4.1070000000000002,"5min":7.859,"15min":10.981999999999999},"last":0.318},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.748,"15min":0.88300000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":4.1440000000000001,"5min":7.9020000000000001,"15min":11.039},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Oct 14 01:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.85799999999999998,"15min":0.78800000000000003},"min":{"1min":0.217,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":11.846,"5min":11.846,"15min":11.846},"last":0.246},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.66600000000000004,"15min":0.74299999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":3.7080000000000002,"5min":4.9379999999999997,"15min":8.3699999999999992},"last":0.27700000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739405,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10696840,"kb_used_data":9563776,"kb_used_omap":1070,"kb_used_meta":1131985,"kb_avail":83675000,"statfs":{"total":96636764160,"available":85683200000,"internally_reserved":0,"allocated":9793306624,"data_stored":16079216850,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":1159153141},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,1,8,8,11,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.747,"15min":0.86399999999999999},"min":{"1min":0.25,"5min":0.22,"15min":0.183},"max":{"1min":4.3019999999999996,"5min":5.9459999999999997,"15min":12.076000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.63300000000000001,"15min":0.76600000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":4.258,"5min":5.1379999999999999,"15min":17.196999999999999},"last":0.29599999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:27:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9159999999999999,"5min":1.573,"15min":1.7869999999999999},"min":{"1min":0.20200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":7.4580000000000002,"5min":17.547999999999998,"15min":17.547999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":2.1509999999999998,"5min":1.159,"15min":0.83499999999999996},"min":{"1min":0.25,"5min":0.23300000000000001,"15min":0.20699999999999999},"max":{"1min":18.399999999999999,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.379}]}]},{"osd":0,"up_from":8,"seq":34359739424,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7791196,"kb_used_data":5894164,"kb_used_omap":1152,"kb_used_meta":1895871,"kb_avail":86580644,"statfs":{"total":96636764160,"available":88658579456,"internally_reserved":0,"allocated":6035623936,"data_stored":9930783620,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1180575,"internal_metadata":1941372001},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,2,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:27:57 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.93500000000000005,"15min":0.95799999999999996},"min":{"1min":0.19600000000000001,"5min":0.158,"15min":0.158},"max":{"1min":8.4009999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.186},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.90200000000000002,"15min":1.1160000000000001},"min":{"1min":0.27400000000000002,"5min":0.22,"15min":0.188},"max":{"1min":8.3569999999999993,"5min":8.3569999999999993,"15min":13.903},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Oct 14 01:27:57 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":7.3499999999999996,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.317},{"interface":"front","average":{"1min":1.232,"5min":1.04,"15min":0.97599999999999998},"min":{"1min":0.23100000000000001,"5min":0.187,"15min":0.187},"max":{"1min":7.3879999999999999,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":1.2190000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6034288640,"data_stored":9929783909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9792946176,"data_stored":16079191987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3762745344,"data_stored":6153495886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:28:16.387 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:28:16.387 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:28:16.388 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:28:16.388 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:28:17.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:17.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:17.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:17.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:17.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:17.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:17.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:17.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:17.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:17.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:17.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:17.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:17.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:17.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:17.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:17.475+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:17.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:17.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:17.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:17.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:19.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:19.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:28:20.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:20.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:20.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:20.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:20.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:20.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:20.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.207+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:20.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:20.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:20.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.263+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:20.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:20.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:20.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:20.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:20.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:20.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:20.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.707+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:20.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:20.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.743+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:20.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:20.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:20.743+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:22.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:22.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:22.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:22.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:22.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:22.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:22.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:22.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:22.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:22.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:22.780 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:28:22.779+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:28:22.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:22.815+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:22.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:22.827+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:22.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:22.835+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:22.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:22.859+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:22.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:22.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:22.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:22.879+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:23.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:23.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:23.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:23.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:23.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:23.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:23.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:23.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:23.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:23.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:23.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:23.527+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:23.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:23.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:23.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:23.559+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:23.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:23.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:23.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:23.559+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:28.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.051+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:28:28.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:28.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:28.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.099+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:28.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:28.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:28.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:28.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.263+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:28.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:28.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.331+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:28.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:28.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:28.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.395+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:28.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:28.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:28.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:28.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:28.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:28.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:29.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:29.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:29.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:29.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:29.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:29.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:29.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:29.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:29.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:29.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:30.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:30.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:30.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.035+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:30.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:30.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.099+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:30.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:30.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:30.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.471+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:30.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:30.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:30.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.539+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:30.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:30.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.603+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:30.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:30.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:30.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.651+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:30.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.663+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:30.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:30.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:30.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:35.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:35.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:35.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:35.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:35.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:35.043+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:35.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:35.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:35.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:35.075+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:35.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:35.075+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:35.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:35.083+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:35.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:35.099+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:35.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:35.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:35.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:35.099+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:35.240 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:28:35.239+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:28:36.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:36.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:36.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:36.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:36.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:36.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.323+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:36.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:36.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.355+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:36.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:36.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.355+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:36.389 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:28:36.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:28:36.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:28:36.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:36.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:36.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:36.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:36.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:37.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:37.031+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:37.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:37.031+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:37.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:37.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:37.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:37.055+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:37.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:37.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:37.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:37.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:37.177 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:28:37.178 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:28:37.207 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2820,"stamp":"2023-10-14T01:28:35.772346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29990805971,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2445429,"num_read_kb":9515856,"num_write":2400097,"num_write_kb":9598923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80574,"ondisk_log_size":80574,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24394556,"kb_used_data":19197732,"kb_used_omap":2893,"kb_used_meta":5193906,"kb_avail":258720964,"statfs":{"total":289910292480,"available":264930267136,"internally_reserved":0,"allocated":19658477568,"data_stored":32229415650,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2963220,"internal_metadata":5318559980},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,7,2,7,19,14,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17371136,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4415,"num_read_kb":17620,"num_write":4472,"num_write_kb":17888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001833"},"pg_stats":[{"pgid":"2.7","version":"167'308423","reported_seq":604227,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:28:31.768440+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:28:31.768440+0000","last_peered":"2023-10-14T01:28:31.768440+0000","last_clean":"2023-10-14T01:28:31.768440+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:28:31.768440+0000","last_undegraded":"2023-10-14T01:28:31.768440+0000","last_fullsized":"2023-10-14T01:28:31.768440+0000","mapping_epoch":13,"log_start":"163'298417","ondisk_log_start":"163'298417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3648504344,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":297455,"num_read_kb":1156820,"num_write":290715,"num_write_kb":1162513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'324206","reported_seq":638663,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:28:31.730501+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:28:31.730501+0000","last_peered":"2023-10-14T01:28:31.730501+0000","last_clean":"2023-10-14T01:28:31.730501+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:28:31.730501+0000","last_undegraded":"2023-10-14T01:28:31.730501+0000","last_fullsized":"2023-10-14T01:28:31.730501+0000","mapping_epoch":13,"log_start":"163'314117","ondisk_log_start":"163'314117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":824,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 257s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3858579674,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":317781,"num_read_kb":1227012,"num_write":307639,"num_write_kb":1230085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'301775","reported_seq":594284,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:28:31.759866+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:28:31.759866+0000","last_peered":"2023-10-14T01:28:31.759866+0000","last_clean":"2023-10-14T01:28:31.759866+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:28:31.759866+0000","last_undegraded":"2023-10-14T01:28:31.759866+0000","last_fullsized":"2023-10-14T01:28:31.759866+0000","mapping_epoch":13,"log_start":"163'291726","ondisk_log_start":"163'291726","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":900,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 246s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3623518912,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":294286,"num_read_kb":1148291,"num_write":289804,"num_write_kb":1158906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'300410","reported_seq":594514,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:28:31.757645+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:28:31.757645+0000","last_peered":"2023-10-14T01:28:31.757645+0000","last_clean":"2023-10-14T01:28:31.757645+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:28:31.757645+0000","last_undegraded":"2023-10-14T01:28:31.757645+0000","last_fullsized":"2023-10-14T01:28:31.757645+0000","mapping_epoch":13,"log_start":"163'290322","ondisk_log_start":"163'290322","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3641184938,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":295599,"num_read_kb":1156868,"num_write":292145,"num_write_kb":1168329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"167'304323","reported_seq":606946,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:28:33.527503+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:28:33.527503+0000","last_peered":"2023-10-14T01:28:33.527503+0000","last_clean":"2023-10-14T01:28:33.527503+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:28:33.527503+0000","last_undegraded":"2023-10-14T01:28:33.527503+0000","last_fullsized":"2023-10-14T01:28:33.527503+0000","mapping_epoch":13,"log_start":"163'294223","ondisk_log_start":"163'294223","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3714089481,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":304449,"num_read_kb":1179498,"num_write":297898,"num_write_kb":1191113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"167'306269","reported_seq":607200,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:28:34.436451+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:28:34.436451+0000","last_peered":"2023-10-14T01:28:34.436451+0000","last_clean":"2023-10-14T01:28:34.436451+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:28:34.436451+0000","last_undegraded":"2023-10-14T01:28:34.436451+0000","last_fullsized":"2023-10-14T01:28:34.436451+0000","mapping_epoch":13,"log_start":"163'296212","ondisk_log_start":"163'296212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3758338366,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":302390,"num_read_kb":1186590,"num_write":300785,"num_write_kb":1202979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"167'308134","reported_seq":611720,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:28:34.424231+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:28:34.424231+0000","last_peered":"2023-10-14T01:28:34.424231+0000","last_clean":"2023-10-14T01:28:34.424231+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:28:34.424231+0000","last_undegraded":"2023-10-14T01:28:34.424231+0000","last_fullsized":"2023-10-14T01:28:34.424231+0000","mapping_epoch":13,"log_start":"163'298116","ondisk_log_start":"163'298116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3792810535,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":304843,"num_read_kb":1197696,"num_write":302604,"num_write_kb":1210279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"167'349584","reported_seq":676040,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:28:31.698765+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:28:31.698765+0000","last_peered":"2023-10-14T01:28:31.698765+0000","last_clean":"2023-10-14T01:28:31.698765+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:28:31.698765+0000","last_undegraded":"2023-10-14T01:28:31.698765+0000","last_fullsized":"2023-10-14T01:28:31.698765+0000","mapping_epoch":13,"log_start":"163'339516","ondisk_log_start":"163'339516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2020,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 861s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3953189353,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":328520,"num_read_kb":1262990,"num_write":318370,"num_write_kb":1272825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":350,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:28:11.156966+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:28:11.156966+0000","last_peered":"2023-10-14T01:28:11.156966+0000","last_clean":"2023-10-14T01:28:11.156966+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:28:11.156966+0000","last_undegraded":"2023-10-14T01:28:11.156966+0000","last_fullsized":"2023-10-14T01:28:11.156966+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":29990215603,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2445323,"num_read_kb":9515765,"num_write":2399960,"num_write_kb":9597029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19655270400,"data_stored":32227762022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53766,"internal_metadata":0},"log_size":80475,"ondisk_log_size":80475,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739428,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5659952,"kb_used_data":3687848,"kb_used_omap":670,"kb_used_meta":1971425,"kb_avail":88711888,"statfs":{"total":96636764160,"available":90840973312,"internally_reserved":0,"allocated":3776356352,"data_stored":6166233698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":686442,"internal_metadata":2018739862},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,2,5,4,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.70399999999999996,"15min":0.83399999999999996},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":4.1070000000000002,"5min":7.859,"15min":10.981999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.748,"15min":0.88300000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":4.1440000000000001,"5min":7.9020000000000001,"15min":11.039},"last":0.41899999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.85799999999999998,"15min":0.78800000000000003},"min":{"1min":0.217,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":11.846,"5min":11.846,"15min":11.846},"last":0.222},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.66600000000000004,"15min":0.74299999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":3.7080000000000002,"5min":4.9379999999999997,"15min":8.3699999999999992},"last":0.44600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739409,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10870024,"kb_used_data":9596480,"kb_used_omap":1070,"kb_used_meta":1272465,"kb_avail":83501816,"statfs":{"total":96636764160,"available":85505859584,"internally_reserved":0,"allocated":9826795520,"data_stored":16112701159,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":1303004661},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,5,2,4,11,8,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.747,"15min":0.86399999999999999},"min":{"1min":0.25,"5min":0.22,"15min":0.183},"max":{"1min":4.3019999999999996,"5min":5.9459999999999997,"15min":12.076000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.63300000000000001,"15min":0.76600000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":4.258,"5min":5.1379999999999999,"15min":17.196999999999999},"last":0.26200000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:27:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9159999999999999,"5min":1.573,"15min":1.7869999999999999},"min":{"1min":0.20200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":7.4580000000000002,"5min":17.547999999999998,"15min":17.547999999999998},"last":0.20799999999999999},{"interface":"front","average":{"1min":2.1509999999999998,"5min":1.159,"15min":0.83499999999999996},"min":{"1min":0.25,"5min":0.23300000000000001,"15min":0.20699999999999999},"max":{"1min":18.399999999999999,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.435}]}]},{"osd":0,"up_from":8,"seq":34359739428,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7864580,"kb_used_data":5913404,"kb_used_omap":1152,"kb_used_meta":1950015,"kb_avail":86507260,"statfs":{"total":96636764160,"available":88583434240,"internally_reserved":0,"allocated":6055325696,"data_stored":9950480793,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1180575,"internal_metadata":1996815457},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1,3,2,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:27:57 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.93500000000000005,"15min":0.95799999999999996},"min":{"1min":0.19600000000000001,"5min":0.158,"15min":0.158},"max":{"1min":8.4009999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.90200000000000002,"15min":1.1160000000000001},"min":{"1min":0.27400000000000002,"5min":0.22,"15min":0.188},"max":{"1min":8.3569999999999993,"5min":8.3569999999999993,"15min":13.903},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:27:57 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":7.3499999999999996,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.437},{"interface":"front","average":{"1min":1.232,"5min":1.04,"15min":0.97599999999999998},"min":{"1min":0.23100000000000001,"5min":0.187,"15min":0.187},"max":{"1min":7.3879999999999999,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.33800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6054211584,"data_stored":9949706853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9825918976,"data_stored":16112164787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3775139840,"data_stored":6165890382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:28:37.209 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:28:37.209 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:28:37.209 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:28:37.210 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:28:42.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:42.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:42.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:42.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:42.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:42.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.342+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:42.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:42.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.390+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:42.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:42.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:42.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:43.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:43.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:43.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:42.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:43.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:43.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:43.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:43.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:43.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:43.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:43.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:43.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:43.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:43.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:43.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:43.074+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:43.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:43.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:43.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:43.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:44.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:44.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:44.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:44.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:44.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:44.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:44.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:44.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:44.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:44.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:44.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:44.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:44.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:44.098+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:44.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:44.126+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:44.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:44.130+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:44.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:44.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:44.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:44.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:45.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:45.738+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:45.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:45.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:45.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:45.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:45.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:45.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:45.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:45.766+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:45.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:45.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:45.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:45.794+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:45.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:45.814+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:45.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:45.846+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:45.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:45.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:45.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:45.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:46.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:46.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:46.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:46.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:46.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.094+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:46.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:46.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.118+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:46.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:46.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.118+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:46.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:46.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:46.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:46.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:46.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:46.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:46.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:46.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:46.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.446+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:46.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:46.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:46.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:28:46.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:28:46.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:46.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:46.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:46.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:46.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:46.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:46.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:46.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:46.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.794+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:46.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.798+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:46.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.798+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:46.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:46.798+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:48.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:48.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:48.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:48.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:48.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:48.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:48.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:48.710+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:48.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:48.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:48.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:48.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:50.542 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:28:50.538+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:28:52.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:28:52.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:52.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:52.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:52.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:52.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:52.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:52.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:52.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:52.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:52.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.658+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:52.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:52.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:52.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:54.690 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:28:54.686+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:28:54.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:54.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:54.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:54.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:54.845 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:54.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:54.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:54.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:54.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:54.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:54.891 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:54.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:54.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:54.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:54.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:54.910+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:54.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:54.922+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:54.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:54.930+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:54.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:54.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:54.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:54.930+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:55.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:55.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:55.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:55.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:55.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:55.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:55.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.710+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:55.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.726+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:55.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:28:55.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:28:55.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:28:55.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:55.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:55.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.802+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:55.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:55.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:55.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.854+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:55.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:55.878+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:57.211 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:28:57.923 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:28:57.924 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:28:57.972 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2831,"stamp":"2023-10-14T01:28:57.777526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30026654163,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2454545,"num_read_kb":9552264,"num_write":2409346,"num_write_kb":9635919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80551,"ondisk_log_size":80551,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24769060,"kb_used_data":19269708,"kb_used_omap":2893,"kb_used_meta":5496434,"kb_avail":258346460,"statfs":{"total":289910292480,"available":264546775040,"internally_reserved":0,"allocated":19732180992,"data_stored":32303119074,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2963220,"internal_metadata":5628348652},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,2,5,9,6,31,15,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20099072,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5221,"num_read_kb":20848,"num_write":5178,"num_write_kb":20712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003657"},"pg_stats":[{"pgid":"2.7","version":"167'309697","reported_seq":606708,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:28:57.517463+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:28:57.517463+0000","last_peered":"2023-10-14T01:28:57.517463+0000","last_clean":"2023-10-14T01:28:57.517463+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:28:57.517463+0000","last_undegraded":"2023-10-14T01:28:57.517463+0000","last_fullsized":"2023-10-14T01:28:57.517463+0000","mapping_epoch":13,"log_start":"163'299617","ondisk_log_start":"163'299617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3653296664,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":298647,"num_read_kb":1161584,"num_write":291944,"num_write_kb":1167429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'325613","reported_seq":641283,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:28:57.508672+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:28:57.508672+0000","last_peered":"2023-10-14T01:28:57.508672+0000","last_clean":"2023-10-14T01:28:57.508672+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:28:57.508672+0000","last_undegraded":"2023-10-14T01:28:57.508672+0000","last_fullsized":"2023-10-14T01:28:57.508672+0000","mapping_epoch":13,"log_start":"163'315517","ondisk_log_start":"163'315517","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":882,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 283s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3863683290,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":318977,"num_read_kb":1231788,"num_write":308958,"num_write_kb":1235361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'303053","reported_seq":596840,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:28:57.506188+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:28:57.506188+0000","last_peered":"2023-10-14T01:28:57.506188+0000","last_clean":"2023-10-14T01:28:57.506188+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:28:57.506188+0000","last_undegraded":"2023-10-14T01:28:57.506188+0000","last_fullsized":"2023-10-14T01:28:57.506188+0000","mapping_epoch":13,"log_start":"163'293027","ondisk_log_start":"163'293027","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1008,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 272s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3628061376,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":295548,"num_read_kb":1153327,"num_write":290973,"num_write_kb":1163582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'301649","reported_seq":596979,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:28:57.505989+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:28:57.505989+0000","last_peered":"2023-10-14T01:28:57.505989+0000","last_clean":"2023-10-14T01:28:57.505989+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:28:57.505989+0000","last_undegraded":"2023-10-14T01:28:57.505989+0000","last_fullsized":"2023-10-14T01:28:57.505989+0000","mapping_epoch":13,"log_start":"163'291622","ondisk_log_start":"163'291622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3645883050,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":296818,"num_read_kb":1161740,"num_write":293369,"num_write_kb":1173225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"167'305303","reported_seq":608870,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:28:53.691187+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:28:53.691187+0000","last_peered":"2023-10-14T01:28:53.691187+0000","last_clean":"2023-10-14T01:28:53.691187+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:28:53.691187+0000","last_undegraded":"2023-10-14T01:28:53.691187+0000","last_fullsized":"2023-10-14T01:28:53.691187+0000","mapping_epoch":13,"log_start":"163'295223","ondisk_log_start":"163'295223","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3717882377,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":305379,"num_read_kb":1183214,"num_write":298866,"num_write_kb":1194985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"167'307267","reported_seq":609176,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:28:54.571915+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:28:54.571915+0000","last_peered":"2023-10-14T01:28:54.571915+0000","last_clean":"2023-10-14T01:28:54.571915+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:28:54.571915+0000","last_undegraded":"2023-10-14T01:28:54.571915+0000","last_fullsized":"2023-10-14T01:28:54.571915+0000","mapping_epoch":13,"log_start":"163'297212","ondisk_log_start":"163'297212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3762204990,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":303365,"num_read_kb":1190482,"num_write":301776,"num_write_kb":1206943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"167'309177","reported_seq":613772,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:28:54.561019+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:28:54.561019+0000","last_peered":"2023-10-14T01:28:54.561019+0000","last_clean":"2023-10-14T01:28:54.561019+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:28:54.561019+0000","last_undegraded":"2023-10-14T01:28:54.561019+0000","last_fullsized":"2023-10-14T01:28:54.561019+0000","mapping_epoch":13,"log_start":"163'299116","ondisk_log_start":"163'299116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3796894247,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":305848,"num_read_kb":1201708,"num_write":303640,"num_write_kb":1214423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"167'351043","reported_seq":678879,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:28:57.493514+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:28:57.493514+0000","last_peered":"2023-10-14T01:28:57.493514+0000","last_clean":"2023-10-14T01:28:57.493514+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:28:57.493514+0000","last_undegraded":"2023-10-14T01:28:57.493514+0000","last_fullsized":"2023-10-14T01:28:57.493514+0000","mapping_epoch":13,"log_start":"164'341016","ondisk_log_start":"164'341016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2104,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 886s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3958157801,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":329857,"num_read_kb":1268330,"num_write":319683,"num_write_kb":1278077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":350,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:28:11.156966+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:28:11.156966+0000","last_peered":"2023-10-14T01:28:11.156966+0000","last_clean":"2023-10-14T01:28:11.156966+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:28:11.156966+0000","last_undegraded":"2023-10-14T01:28:11.156966+0000","last_fullsized":"2023-10-14T01:28:11.156966+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30026063795,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2454439,"num_read_kb":9552173,"num_write":2409209,"num_write_kb":9634025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19728699392,"data_stored":32301191014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":53766,"internal_metadata":0},"log_size":80452,"ondisk_log_size":80452,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739432,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5740024,"kb_used_data":3699952,"kb_used_omap":670,"kb_used_meta":2039393,"kb_avail":88631816,"statfs":{"total":96636764160,"available":90758979584,"internally_reserved":0,"allocated":3788750848,"data_stored":6178628194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":686442,"internal_metadata":2088339094},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1,2,0,2,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.70399999999999996,"15min":0.83399999999999996},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":4.1070000000000002,"5min":7.859,"15min":10.981999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.748,"15min":0.88300000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":4.1440000000000001,"5min":7.9020000000000001,"15min":11.039},"last":0.55300000000000005}]},{"osd":1,"last update":"Sat Oct 14 01:28:01 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.85799999999999998,"15min":0.78800000000000003},"min":{"1min":0.217,"5min":0.20499999999999999,"15min":0.193},"max":{"1min":11.846,"5min":11.846,"15min":11.846},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.66600000000000004,"15min":0.74299999999999999},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":3.7080000000000002,"5min":4.9379999999999997,"15min":8.3699999999999992},"last":0.44500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739414,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11069016,"kb_used_data":9637264,"kb_used_omap":1070,"kb_used_meta":1430673,"kb_avail":83302824,"statfs":{"total":96636764160,"available":85302091776,"internally_reserved":0,"allocated":9868558336,"data_stored":16154463975,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":1465009653},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,0,2,6,4,29,8,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.27800000000000002,"5min":0.22,"15min":0.183},"max":{"1min":3.1539999999999999,"5min":5.9459999999999997,"15min":9.8879999999999999},"last":0.745},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.26200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":4.1989999999999998,"5min":5.1379999999999999,"15min":10.029999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:28:50 2023","interfaces":[{"interface":"back","average":{"1min":1.7290000000000001,"5min":1.522,"15min":1.8080000000000001},"min":{"1min":0.20799999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":7.4619999999999997,"5min":9.9600000000000009,"15min":17.547999999999998},"last":0.435},{"interface":"front","average":{"1min":0.77300000000000002,"5min":1.105,"15min":0.83299999999999996},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.20699999999999999},"max":{"1min":4.3170000000000002,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.39000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739432,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7960020,"kb_used_data":5932492,"kb_used_omap":1152,"kb_used_meta":2026367,"kb_avail":86411820,"statfs":{"total":96636764160,"available":88485703680,"internally_reserved":0,"allocated":6074871808,"data_stored":9970026905,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1180575,"internal_metadata":2074999905},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,1,2],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:27:57 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.93500000000000005,"15min":0.95799999999999996},"min":{"1min":0.19600000000000001,"5min":0.158,"15min":0.158},"max":{"1min":8.4009999999999998,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.29999999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":0.90200000000000002,"15min":1.1160000000000001},"min":{"1min":0.27400000000000002,"5min":0.22,"15min":0.188},"max":{"1min":8.3569999999999993,"5min":8.3569999999999993,"15min":13.903},"last":0.502}]},{"osd":2,"last update":"Sat Oct 14 01:27:57 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":0.85199999999999998,"15min":0.86299999999999999},"min":{"1min":0.26000000000000001,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":7.3499999999999996,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.232,"5min":1.04,"15min":0.97599999999999998},"min":{"1min":0.23100000000000001,"5min":0.187,"15min":0.187},"max":{"1min":7.3879999999999999,"5min":9.4649999999999999,"15min":9.4649999999999999},"last":0.45300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6074056704,"data_stored":9969551973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21261,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9867116544,"data_stored":16153362355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3787526144,"data_stored":6178276686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:28:57.974 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:28:57.974 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:28:57.975 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:28:57.975 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:28:58.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:58.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:28:58.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:58.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:28:58.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:58.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:28:58.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:58.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:28:58.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:58.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:28:58.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:58.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:28:58.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:58.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:28:58.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:58.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:28:58.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:58.190+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:28:58.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:58.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:28:58.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:28:58.190+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:28:58.835 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:28:58.904 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T01:28:59.600 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T01:28:59.648 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T01:29:00.544 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T01:29:00.634 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:29:02.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.630+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:29:02.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:02.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:02.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:02.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.698+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:02.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.702+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:02.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:02.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:02.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:02.766 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:02.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.762+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:02.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:02.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:02.762+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:04.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:04.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:04.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:04.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:04.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:04.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:04.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:04.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:04.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:04.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:04.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:04.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:04.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:04.590+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:04.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:04.602+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:04.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:04.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:04.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:04.602+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:05.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:05.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:05.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:05.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:05.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:05.946+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:05.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:05.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:05.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:05.994+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:05.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:05.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:05.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:05.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:06.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:06.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:29:06.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:06.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:06.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:06.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:06.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:06.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:06.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:06.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:06.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:06.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:06.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:06.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:06.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:06.162+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:06.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:06.202+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:06.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:06.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:06.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:06.202+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:07.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:29:07.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:07.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:07.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:07.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:07.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:07.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:07.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:07.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.426+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:07.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.438+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:07.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.442+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:07.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:07.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.442+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:07.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:29:07.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:29:07.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:29:07.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:07.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:07.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:07.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:07.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:07.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:07.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:07.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:07.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.542+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:07.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:07.574+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:08.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:08.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:08.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:08.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:08.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:08.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:08.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:08.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:08.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:08.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:08.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:08.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:08.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:08.370+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:08.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:08.378+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:08.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:08.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:08.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:08.378+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:11.697 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:29:11.694+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:29:12.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:12.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:12.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:12.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:12.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:12.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:12.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:12.246+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:12.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:12.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:12.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:12.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:12.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:12.270+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:12.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:12.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:12.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:12.294+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:12.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:12.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:12.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:12.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:12.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:12.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:13.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:13.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:13.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:13.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:13.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:13.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:13.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.058+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:13.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:13.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.078+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:13.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:13.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:13.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:13.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:13.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:13.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:13.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:13.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:13.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:13.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:13.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.350+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:13.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.350+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:13.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.350+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:13.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:13.350+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:14.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:14.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:14.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:14.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:14.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:14.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:14.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:14.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:14.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:14.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:14.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:14.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:14.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:14.702+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:14.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:14.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:14.706 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:14.702+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:15.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.670+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:29:15.690 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:29:15.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:15.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.690+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:15.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:15.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:15.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.694+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:15.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:15.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:15.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.754+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:15.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:15.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.774+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:15.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:15.790 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:15.782+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:17.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:17.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:17.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:17.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:17.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:17.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:17.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:17.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:17.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:17.870+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:17.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:17.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:17.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:17.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:17.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:17.902+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:17.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:17.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:17.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:17.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:18.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:29:18.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:18.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:18.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:18.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:18.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:18.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:18.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.858+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:18.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:18.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.886+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:18.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.886+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:18.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:29:18.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:18.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:18.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:19.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:19.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:19.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:19.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:19.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:19.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:19.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:19.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:19.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:19.046+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:19.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:19.062+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:19.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:19.090+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:19.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:19.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:20.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:29:20.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:20.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:20.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:20.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.102+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:20.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:20.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:20.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:20.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:20.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:20.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:20.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:20.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.530+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:20.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:20.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.578+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:20.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:20.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:20.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:20.635 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:29:21.600 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:29:21.601 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:29:21.700 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2842,"stamp":"2023-10-14T01:29:19.787735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30058553811,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2462363,"num_read_kb":9583460,"num_write":2417536,"num_write_kb":9668679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80404,"ondisk_log_size":80404,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23780364,"kb_used_data":19337004,"kb_used_omap":2883,"kb_used_meta":4440444,"kb_avail":259335156,"statfs":{"total":289910292480,"available":265559199744,"internally_reserved":0,"allocated":19801092096,"data_stored":32372030178,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":2952653,"internal_metadata":4547015219},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,8,8,11,12,4,9],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16523264,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4098,"num_read_kb":16344,"num_write":4234,"num_write_kb":16936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006885"},"pg_stats":[{"pgid":"2.7","version":"167'310733","reported_seq":608727,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:29:17.970219+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:29:17.970219+0000","last_peered":"2023-10-14T01:29:17.970219+0000","last_clean":"2023-10-14T01:29:17.970219+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:29:17.970219+0000","last_undegraded":"2023-10-14T01:29:17.970219+0000","last_fullsized":"2023-10-14T01:29:17.970219+0000","mapping_epoch":13,"log_start":"163'300717","ondisk_log_start":"163'300717","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3657290264,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":299623,"num_read_kb":1165472,"num_write":292938,"num_write_kb":1171405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"167'326706","reported_seq":643424,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:29:18.004181+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:29:18.004181+0000","last_peered":"2023-10-14T01:29:18.004181+0000","last_clean":"2023-10-14T01:29:18.004181+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:29:18.004181+0000","last_undegraded":"2023-10-14T01:29:18.004181+0000","last_fullsized":"2023-10-14T01:29:18.004181+0000","mapping_epoch":13,"log_start":"164'316617","ondisk_log_start":"164'316617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":957,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 303s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3867599066,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":320001,"num_read_kb":1235880,"num_write":309958,"num_write_kb":1239361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"167'304182","reported_seq":598918,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:29:17.987328+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:29:17.987328+0000","last_peered":"2023-10-14T01:29:17.987328+0000","last_clean":"2023-10-14T01:29:17.987328+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:29:17.987328+0000","last_undegraded":"2023-10-14T01:29:17.987328+0000","last_fullsized":"2023-10-14T01:29:17.987328+0000","mapping_epoch":13,"log_start":"164'294127","ondisk_log_start":"164'294127","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1076,"log_size":10055,"log_dups_size":0,"ondisk_log_size":10055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 292s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3632124608,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":296477,"num_read_kb":1157035,"num_write":292023,"num_write_kb":1167782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"167'302644","reported_seq":598858,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:29:17.924053+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:29:17.924053+0000","last_peered":"2023-10-14T01:29:17.924053+0000","last_clean":"2023-10-14T01:29:17.924053+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:29:17.924053+0000","last_undegraded":"2023-10-14T01:29:17.924053+0000","last_fullsized":"2023-10-14T01:29:17.924053+0000","mapping_epoch":13,"log_start":"163'292622","ondisk_log_start":"163'292622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3649680042,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":297698,"num_read_kb":1165248,"num_write":294350,"num_write_kb":1177149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"167'306545","reported_seq":611248,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:29:18.824809+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:29:18.824809+0000","last_peered":"2023-10-14T01:29:18.824809+0000","last_clean":"2023-10-14T01:29:18.824809+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:29:18.824809+0000","last_undegraded":"2023-10-14T01:29:18.824809+0000","last_fullsized":"2023-10-14T01:29:18.824809+0000","mapping_epoch":13,"log_start":"163'296523","ondisk_log_start":"163'296523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3722719753,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":306500,"num_read_kb":1187694,"num_write":300096,"num_write_kb":1199905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"167'308274","reported_seq":611134,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:29:14.728041+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:29:14.728041+0000","last_peered":"2023-10-14T01:29:14.728041+0000","last_clean":"2023-10-14T01:29:14.728041+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:29:14.728041+0000","last_undegraded":"2023-10-14T01:29:14.728041+0000","last_fullsized":"2023-10-14T01:29:14.728041+0000","mapping_epoch":13,"log_start":"163'298212","ondisk_log_start":"163'298212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3766034750,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":304310,"num_read_kb":1194254,"num_write":302776,"num_write_kb":1210943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"167'310142","reported_seq":615705,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:29:14.748577+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:29:14.748577+0000","last_peered":"2023-10-14T01:29:14.748577+0000","last_clean":"2023-10-14T01:29:14.748577+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:29:14.748577+0000","last_undegraded":"2023-10-14T01:29:14.748577+0000","last_fullsized":"2023-10-14T01:29:14.748577+0000","mapping_epoch":13,"log_start":"163'300116","ondisk_log_start":"163'300116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3800637991,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":306813,"num_read_kb":1205556,"num_write":304598,"num_write_kb":1218255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"167'352129","reported_seq":680975,"reported_epoch":167,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:29:17.937570+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:29:17.937570+0000","last_peered":"2023-10-14T01:29:17.937570+0000","last_clean":"2023-10-14T01:29:17.937570+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:29:17.937570+0000","last_undegraded":"2023-10-14T01:29:17.937570+0000","last_fullsized":"2023-10-14T01:29:17.937570+0000","mapping_epoch":13,"log_start":"164'342116","ondisk_log_start":"164'342116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2141,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 907s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3961876969,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":330835,"num_read_kb":1272230,"num_write":320660,"num_write_kb":1281985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":350,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-14T01:28:11.156966+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:28:11.156966+0000","last_peered":"2023-10-14T01:28:11.156966+0000","last_clean":"2023-10-14T01:28:11.156966+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:28:11.156966+0000","last_undegraded":"2023-10-14T01:28:11.156966+0000","last_fullsized":"2023-10-14T01:28:11.156966+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30057963443,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2462257,"num_read_kb":9583369,"num_write":2417399,"num_write_kb":9666785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19798716416,"data_stored":32371208038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80305,"ondisk_log_size":80305,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739436,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5783756,"kb_used_data":3711744,"kb_used_omap":670,"kb_used_meta":2071329,"kb_avail":88588084,"statfs":{"total":96636764160,"available":90714198016,"internally_reserved":0,"allocated":3800825856,"data_stored":6190703202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":686442,"internal_metadata":2121041558},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,5,4,3,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.79200000000000004,"15min":0.82299999999999995},"min":{"1min":0.26700000000000002,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":8.0719999999999992,"5min":8.0719999999999992,"15min":10.981999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.83499999999999996,"15min":0.871},"min":{"1min":0.307,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":8.0999999999999996,"5min":8.0999999999999996,"15min":11.039},"last":0.48999999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.88300000000000001,"15min":0.80100000000000005},"min":{"1min":0.219,"5min":0.20799999999999999,"15min":0.20499999999999999},"max":{"1min":4.2880000000000003,"5min":11.846,"15min":11.846},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.115,"5min":0.78600000000000003,"15min":0.76500000000000001},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":8.0229999999999997,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":0.42699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739418,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11234884,"kb_used_data":9668472,"kb_used_omap":1070,"kb_used_meta":1565329,"kb_avail":83136956,"statfs":{"total":96636764160,"available":85132242944,"internally_reserved":0,"allocated":9900515328,"data_stored":16186420967,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":1602897397},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,2,4,6,4,9],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.27800000000000002,"5min":0.22,"15min":0.183},"max":{"1min":3.1539999999999999,"5min":5.9459999999999997,"15min":9.8879999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.26200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":4.1989999999999998,"5min":5.1379999999999999,"15min":10.029999999999999},"last":0.32200000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:28:50 2023","interfaces":[{"interface":"back","average":{"1min":1.7290000000000001,"5min":1.522,"15min":1.8080000000000001},"min":{"1min":0.20799999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":7.4619999999999997,"5min":9.9600000000000009,"15min":17.547999999999998},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":1.105,"15min":0.83299999999999996},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.20699999999999999},"max":{"1min":4.3170000000000002,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.49399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739437,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6761724,"kb_used_data":5956788,"kb_used_omap":1142,"kb_used_meta":803785,"kb_avail":87610116,"statfs":{"total":96636764160,"available":89712758784,"internally_reserved":0,"allocated":6099750912,"data_stored":9994906009,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":823076264},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,4,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:28:58 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.186,"5min":0.158,"15min":0.158},"max":{"1min":5.7069999999999999,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.435},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.879,"15min":1.0629999999999999},"min":{"1min":0.24299999999999999,"5min":0.22,"15min":0.188},"max":{"1min":5.7290000000000001,"5min":8.3569999999999993,"15min":13.903},"last":0.36799999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.86799999999999999,"15min":0.78300000000000003},"min":{"1min":0.27500000000000002,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":4.218,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.093,"15min":1.022},"min":{"1min":0.249,"5min":0.187,"15min":0.187},"max":{"1min":8.8900000000000006,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":0.40699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6099161088,"data_stored":9994656357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9899945984,"data_stored":16186191795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3799609344,"data_stored":6190359886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:29:21.701 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:29:21.702 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:29:21.702 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:29:21.703 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:29:21.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:21.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:21.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:21.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:21.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:21.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:21.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:21.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:22.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.010+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:22.038 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:22.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:22.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:22.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.038+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:22.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.038+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:22.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.038+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:22.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.038+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:22.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.714+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:29:22.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:22.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:22.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.734+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:22.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:22.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.770+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:22.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.770+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:22.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.778+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:22.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.790+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:22.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:22.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:22.790+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:23.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:29:23.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:29:23.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:29:23.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:23.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:23.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:23.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:23.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:23.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:23.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:23.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:23.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:23.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.382+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:23.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:23.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.390+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:23.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:29:23.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:29:23.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:29:23.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:23.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:23.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:23.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:23.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.458+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:23.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.474+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:23.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:23.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:23.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:23.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.490+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:23.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:23.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.490+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:23.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:29:23.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:23.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:23.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:23.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:23.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:24.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:24.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.034+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:24.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.050+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:24.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:24.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.082+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:24.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.110+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:24.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:24.120 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.110+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:24.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.362+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:24.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:24.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:24.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:24.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:24.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.394+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:24.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.482+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:24.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:24.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:24.482+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:26.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:26.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:26.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:26.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:26.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:26.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:26.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:26.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.218+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:26.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:26.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:26.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:26.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:26.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.594+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:26.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:26.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.622+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:26.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:26.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:26.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:26.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.722+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:26.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:26.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:26.734+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:27.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:27.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:27.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:27.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:27.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:27.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:27.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:27.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:27.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:27.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:27.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:27.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:27.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:27.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:27.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:27.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:27.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:27.222+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:27.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:27.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:27.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:27.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:27.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:27.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:28.167 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:29:28.166+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:29:30.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:30.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:30.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:30.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:30.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:30.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:30.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:30.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:30.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:30.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:30.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:30.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:30.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:30.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:30.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:30.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:30.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:30.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:30.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:30.262+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:30.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:30.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:30.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:30.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:33.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:33.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:33.290 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:33.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:33.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:33.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:33.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:33.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:33.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:33.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:33.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:33.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:33.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:33.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:33.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:33.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:33.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:33.314+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:33.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:33.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:33.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:33.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:34.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:34.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:34.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:34.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:34.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:34.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:34.781 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:34.778+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:34.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:34.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:34.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:34.794+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:38.099 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:29:38.094+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:29:40.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:40.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:40.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:40.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:40.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:40.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:40.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:40.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:40.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:40.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:40.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:40.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:40.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:40.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:40.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:40.250+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:40.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:40.262+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:40.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:40.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:40.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:40.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:41.704 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:29:42.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:42.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:42.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:42.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:42.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:42.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:42.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:42.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:42.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:42.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:42.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:42.306+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:42.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:42.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:42.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:42.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:42.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:42.366+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:42.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:42.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:42.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:42.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:42.441 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:29:42.442 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:29:42.499 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2854,"stamp":"2023-10-14T01:29:41.799346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30091350483,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2470846,"num_read_kb":9617292,"num_write":2425969,"num_write_kb":9702411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80457,"ondisk_log_size":80457,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23762180,"kb_used_data":19404900,"kb_used_omap":2939,"kb_used_meta":4354308,"kb_avail":259353340,"statfs":{"total":289910292480,"available":265577820160,"internally_reserved":0,"allocated":19870617600,"data_stored":32441541792,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3009767,"internal_metadata":4458812185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,3,1,6,12,15,11,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15753216,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4051,"num_read_kb":16156,"num_write":4063,"num_write_kb":16252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.006516"},"pg_stats":[{"pgid":"2.7","version":"168'311783","reported_seq":610801,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:29:38.591224+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:29:38.591224+0000","last_peered":"2023-10-14T01:29:38.591224+0000","last_clean":"2023-10-14T01:29:38.591224+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:29:38.591224+0000","last_undegraded":"2023-10-14T01:29:38.591224+0000","last_fullsized":"2023-10-14T01:29:38.591224+0000","mapping_epoch":13,"log_start":"164'301717","ondisk_log_start":"164'301717","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3661238808,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":300634,"num_read_kb":1169504,"num_write":293940,"num_write_kb":1175413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"168'327823","reported_seq":645634,"reported_epoch":168,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:29:38.491741+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:29:38.491741+0000","last_peered":"2023-10-14T01:29:38.491741+0000","last_clean":"2023-10-14T01:29:38.491741+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:29:38.491741+0000","last_undegraded":"2023-10-14T01:29:38.491741+0000","last_fullsized":"2023-10-14T01:29:38.491741+0000","mapping_epoch":13,"log_start":"164'317817","ondisk_log_start":"164'317817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1009,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 324s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3871600858,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":321072,"num_read_kb":1240144,"num_write":310987,"num_write_kb":1243477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"168'305251","reported_seq":601011,"reported_epoch":168,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:29:38.534831+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:29:38.534831+0000","last_peered":"2023-10-14T01:29:38.534831+0000","last_clean":"2023-10-14T01:29:38.534831+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:29:38.534831+0000","last_undegraded":"2023-10-14T01:29:38.534831+0000","last_fullsized":"2023-10-14T01:29:38.534831+0000","mapping_epoch":13,"log_start":"164'295227","ondisk_log_start":"164'295227","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1158,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 313s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3635897024,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":297481,"num_read_kb":1161031,"num_write":292998,"num_write_kb":1171682,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"168'303687","reported_seq":600870,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:29:38.514931+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:29:38.514931+0000","last_peered":"2023-10-14T01:29:38.514931+0000","last_clean":"2023-10-14T01:29:38.514931+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:29:38.514931+0000","last_undegraded":"2023-10-14T01:29:38.514931+0000","last_fullsized":"2023-10-14T01:29:38.514931+0000","mapping_epoch":13,"log_start":"164'293622","ondisk_log_start":"164'293622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3653636778,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":298668,"num_read_kb":1169112,"num_write":295376,"num_write_kb":1181253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"168'307509","reported_seq":613199,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:29:38.981891+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:29:38.981891+0000","last_peered":"2023-10-14T01:29:38.981891+0000","last_clean":"2023-10-14T01:29:38.981891+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:29:38.981891+0000","last_undegraded":"2023-10-14T01:29:38.981891+0000","last_fullsized":"2023-10-14T01:29:38.981891+0000","mapping_epoch":13,"log_start":"164'297423","ondisk_log_start":"164'297423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3726492169,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":307473,"num_read_kb":1191586,"num_write":301051,"num_write_kb":1203725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"168'309541","reported_seq":613611,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:29:39.974301+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:29:39.974301+0000","last_peered":"2023-10-14T01:29:39.974301+0000","last_clean":"2023-10-14T01:29:39.974301+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:29:39.974301+0000","last_undegraded":"2023-10-14T01:29:39.974301+0000","last_fullsized":"2023-10-14T01:29:39.974301+0000","mapping_epoch":13,"log_start":"164'299512","ondisk_log_start":"164'299512","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10029,"log_dups_size":0,"ondisk_log_size":10029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3770876222,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":305514,"num_read_kb":1199062,"num_write":304034,"num_write_kb":1215975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"168'311351","reported_seq":618150,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:29:39.993092+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:29:39.993092+0000","last_peered":"2023-10-14T01:29:39.993092+0000","last_clean":"2023-10-14T01:29:39.993092+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:29:39.993092+0000","last_undegraded":"2023-10-14T01:29:39.993092+0000","last_fullsized":"2023-10-14T01:29:39.993092+0000","mapping_epoch":13,"log_start":"164'301316","ondisk_log_start":"164'301316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3805332007,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":308045,"num_read_kb":1210476,"num_write":305798,"num_write_kb":1223055,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"168'353263","reported_seq":683163,"reported_epoch":168,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:29:38.481665+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:29:38.481665+0000","last_peered":"2023-10-14T01:29:38.481665+0000","last_clean":"2023-10-14T01:29:38.481665+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:29:38.481665+0000","last_undegraded":"2023-10-14T01:29:38.481665+0000","last_fullsized":"2023-10-14T01:29:38.481665+0000","mapping_epoch":13,"log_start":"164'343216","ondisk_log_start":"164'343216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2211,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 927s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3965686249,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":331853,"num_read_kb":1276286,"num_write":321648,"num_write_kb":1285937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":351,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:28:20.408391+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:28:20.408391+0000","last_peered":"2023-10-14T01:28:20.408391+0000","last_clean":"2023-10-14T01:28:20.408391+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:28:20.408391+0000","last_undegraded":"2023-10-14T01:28:20.408391+0000","last_fullsized":"2023-10-14T01:28:20.408391+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30090760115,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2470740,"num_read_kb":9617201,"num_write":2425832,"num_write_kb":9700517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19866767360,"data_stored":32439258982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80358,"ondisk_log_size":80358,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739441,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5457676,"kb_used_data":3726276,"kb_used_omap":726,"kb_used_meta":1730665,"kb_avail":88914164,"statfs":{"total":96636764160,"available":91048103936,"internally_reserved":0,"allocated":3815706624,"data_stored":6205579340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1772201852},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,2,0,3,1,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.79200000000000004,"15min":0.82299999999999995},"min":{"1min":0.26700000000000002,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":8.0719999999999992,"5min":8.0719999999999992,"15min":10.981999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.83499999999999996,"15min":0.871},"min":{"1min":0.307,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":8.0999999999999996,"5min":8.0999999999999996,"15min":11.039},"last":0.44900000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.88300000000000001,"15min":0.80100000000000005},"min":{"1min":0.219,"5min":0.20799999999999999,"15min":0.20499999999999999},"max":{"1min":4.2880000000000003,"5min":11.846,"15min":11.846},"last":0.19600000000000001},{"interface":"front","average":{"1min":1.115,"5min":0.78600000000000003,"15min":0.76500000000000001},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":8.0229999999999997,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":0.47499999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739422,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11445864,"kb_used_data":9701276,"kb_used_omap":1070,"kb_used_meta":1743505,"kb_avail":82925976,"statfs":{"total":96636764160,"available":84916199424,"internally_reserved":0,"allocated":9934106624,"data_stored":16220007633,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":1785349621},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,11,13,10,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:28:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.27800000000000002,"5min":0.22,"15min":0.183},"max":{"1min":3.1539999999999999,"5min":5.9459999999999997,"15min":9.8879999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.65500000000000003,"15min":0.68799999999999994},"min":{"1min":0.26200000000000001,"5min":0.185,"15min":0.185},"max":{"1min":4.1989999999999998,"5min":5.1379999999999999,"15min":10.029999999999999},"last":0.77600000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:28:50 2023","interfaces":[{"interface":"back","average":{"1min":1.7290000000000001,"5min":1.522,"15min":1.8080000000000001},"min":{"1min":0.20799999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":7.4619999999999997,"5min":9.9600000000000009,"15min":17.547999999999998},"last":4.0419999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":1.105,"15min":0.83299999999999996},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.20699999999999999},"max":{"1min":4.3170000000000002,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.29599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739441,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6858640,"kb_used_data":5977348,"kb_used_omap":1142,"kb_used_meta":880137,"kb_avail":87513200,"statfs":{"total":96636764160,"available":89613516800,"internally_reserved":0,"allocated":6120804352,"data_stored":10015954819,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":901260712},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:28:58 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.186,"5min":0.158,"15min":0.158},"max":{"1min":5.7069999999999999,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":2.2290000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.879,"15min":1.0629999999999999},"min":{"1min":0.24299999999999999,"5min":0.22,"15min":0.188},"max":{"1min":5.7290000000000001,"5min":8.3569999999999993,"15min":13.903},"last":7.641}]},{"osd":2,"last update":"Sat Oct 14 01:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.86799999999999999,"15min":0.78300000000000003},"min":{"1min":0.27500000000000002,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":4.218,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":4.282},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.093,"15min":1.022},"min":{"1min":0.249,"5min":0.187,"15min":0.187},"max":{"1min":8.8900000000000006,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":3.758}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6119366656,"data_stored":10014861925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9932713984,"data_stored":16218959795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3814686720,"data_stored":6205437262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:29:42.500 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:29:42.500 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:29:42.501 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:29:42.501 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:29:44.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:44.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:44.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:44.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:44.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:44.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:44.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:44.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.409+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:44.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:44.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.409+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:44.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.409+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:29:44.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:29:44.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:44.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:44.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:44.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.489+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:44.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.489+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:44.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:44.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.501+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:44.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:44.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:44.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:44.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:44.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:44.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:44.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:44.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:44.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.673+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:44.697 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.693+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:44.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.717+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:44.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:44.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:44.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:46.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:46.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:46.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:46.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:46.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:46.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:46.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:46.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:46.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:46.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:46.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:46.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:46.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:46.289+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:46.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:46.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:46.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:46.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:50.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:50.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:50.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:50.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:50.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:50.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:50.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.149+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:50.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:50.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.149+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:50.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.161+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:50.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:50.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:50.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.809+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:29:50.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:50.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:50.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:50.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:50.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:50.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:50.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:50.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:50.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.845+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:50.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.857+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:50.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:50.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:50.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:50.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:51.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:51.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:51.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:51.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:51.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:51.037+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:51.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:51.041+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:51.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:51.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:51.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:51.041+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:52.803 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:29:52.797+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:29:53.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:53.537+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:53.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:53.565+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:53.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:53.577+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:53.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:53.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:54.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:54.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:55.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:55.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:55.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:55.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:55.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:55.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:55.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.077+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:55.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:55.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:55.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:55.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:55.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:55.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:55.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:55.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:57.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:57.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:57.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:57.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.061+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:57.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:57.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:57.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:57.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:57.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.317+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:57.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:57.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:57.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:57.809 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:57.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:57.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:57.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:57.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:57.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.829+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:57.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.841+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:57.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.849+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:57.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.853+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:57.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:57.853+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:58.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:29:58.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:29:58.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.693+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:58.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:58.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.713+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:58.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:58.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:58.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:58.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:58.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:58.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:58.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.817+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:58.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:58.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:58.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:29:59.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:59.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:29:59.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:59.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:29:59.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:59.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:29:59.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:59.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:29:59.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:59.177+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:29:59.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:59.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:29:59.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:59.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:29:59.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:59.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:29:59.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:59.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:29:59.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:59.281+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:29:59.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:59.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:29:59.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:29:59.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:01.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:01.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:01.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:01.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:01.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:01.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:01.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:01.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:01.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:01.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:01.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:01.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.793+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:01.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.821+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:01.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.861+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:01.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:01.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:01.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:02.503 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:30:02.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:02.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:02.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:02.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:02.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:02.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:02.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:02.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:02.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:02.697+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:02.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:02.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:02.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:02.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:02.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:02.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:02.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:02.741+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:02.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:02.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:02.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:02.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:03.400 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:30:03.400 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:30:03.435 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2864,"stamp":"2023-10-14T01:30:01.803210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30122615251,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2479001,"num_read_kb":9649824,"num_write":2433977,"num_write_kb":9734443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80526,"ondisk_log_size":80526,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24034008,"kb_used_data":19468156,"kb_used_omap":2939,"kb_used_meta":4562884,"kb_avail":259081512,"statfs":{"total":289910292480,"available":265299468288,"internally_reserved":0,"allocated":19935391744,"data_stored":32506315936,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3009767,"internal_metadata":4672394009},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,2,3,15,2,9,15,19,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17338368,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4600,"num_read_kb":18344,"num_write":4448,"num_write_kb":17792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002541"},"pg_stats":[{"pgid":"2.7","version":"168'312848","reported_seq":612870,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:29:59.246958+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:29:59.246958+0000","last_peered":"2023-10-14T01:29:59.246958+0000","last_clean":"2023-10-14T01:29:59.246958+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:29:59.246958+0000","last_undegraded":"2023-10-14T01:29:59.246958+0000","last_fullsized":"2023-10-14T01:29:59.246958+0000","mapping_epoch":13,"log_start":"164'302817","ondisk_log_start":"164'302817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3665248792,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":301624,"num_read_kb":1173456,"num_write":294958,"num_write_kb":1179485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"168'328936","reported_seq":647741,"reported_epoch":168,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:29:59.250579+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:29:59.250579+0000","last_peered":"2023-10-14T01:29:59.250579+0000","last_clean":"2023-10-14T01:29:59.250579+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:29:59.250579+0000","last_undegraded":"2023-10-14T01:29:59.250579+0000","last_fullsized":"2023-10-14T01:29:59.250579+0000","mapping_epoch":13,"log_start":"164'318918","ondisk_log_start":"164'318918","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1062,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 344s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3875631322,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":322043,"num_read_kb":1244012,"num_write":312017,"num_write_kb":1247597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"168'306254","reported_seq":603108,"reported_epoch":168,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:29:59.199176+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:29:59.199176+0000","last_peered":"2023-10-14T01:29:59.199176+0000","last_clean":"2023-10-14T01:29:59.199176+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:29:59.199176+0000","last_undegraded":"2023-10-14T01:29:59.199176+0000","last_fullsized":"2023-10-14T01:29:59.199176+0000","mapping_epoch":13,"log_start":"164'296227","ondisk_log_start":"164'296227","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1223,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 333s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3639460544,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":298558,"num_read_kb":1165331,"num_write":293919,"num_write_kb":1175366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"168'304715","reported_seq":602906,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:29:59.192422+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:29:59.192422+0000","last_peered":"2023-10-14T01:29:59.192422+0000","last_clean":"2023-10-14T01:29:59.192422+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:29:59.192422+0000","last_undegraded":"2023-10-14T01:29:59.192422+0000","last_fullsized":"2023-10-14T01:29:59.192422+0000","mapping_epoch":13,"log_start":"164'294622","ondisk_log_start":"164'294622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3657609898,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":299667,"num_read_kb":1173108,"num_write":296388,"num_write_kb":1185301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"168'308507","reported_seq":615180,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:29:59.124466+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:29:59.124466+0000","last_peered":"2023-10-14T01:29:59.124466+0000","last_clean":"2023-10-14T01:29:59.124466+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:29:59.124466+0000","last_undegraded":"2023-10-14T01:29:59.124466+0000","last_fullsized":"2023-10-14T01:29:59.124466+0000","mapping_epoch":13,"log_start":"164'298423","ondisk_log_start":"164'298423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3730334217,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":308444,"num_read_kb":1195462,"num_write":302037,"num_write_kb":1207669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"168'310501","reported_seq":615625,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:30:00.147169+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:30:00.147169+0000","last_peered":"2023-10-14T01:30:00.147169+0000","last_clean":"2023-10-14T01:30:00.147169+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:30:00.147169+0000","last_undegraded":"2023-10-14T01:30:00.147169+0000","last_fullsized":"2023-10-14T01:30:00.147169+0000","mapping_epoch":13,"log_start":"164'300412","ondisk_log_start":"164'300412","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10089,"log_dups_size":0,"ondisk_log_size":10089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3774599486,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":306565,"num_read_kb":1203250,"num_write":304992,"num_write_kb":1219807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"168'312359","reported_seq":620171,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:30:00.193195+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:30:00.193195+0000","last_peered":"2023-10-14T01:30:00.193195+0000","last_clean":"2023-10-14T01:30:00.193195+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:30:00.193195+0000","last_undegraded":"2023-10-14T01:30:00.193195+0000","last_fullsized":"2023-10-14T01:30:00.193195+0000","mapping_epoch":13,"log_start":"164'302316","ondisk_log_start":"164'302316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3809321511,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":309056,"num_read_kb":1214504,"num_write":306804,"num_write_kb":1227079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"168'354458","reported_seq":685472,"reported_epoch":168,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:29:59.187492+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:29:59.187492+0000","last_peered":"2023-10-14T01:29:59.187492+0000","last_clean":"2023-10-14T01:29:59.187492+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:29:59.187492+0000","last_undegraded":"2023-10-14T01:29:59.187492+0000","last_fullsized":"2023-10-14T01:29:59.187492+0000","mapping_epoch":13,"log_start":"165'344416","ondisk_log_start":"165'344416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2242,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 948s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3969819113,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":332938,"num_read_kb":1280610,"num_write":322725,"num_write_kb":1290245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":351,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-14T01:28:20.408391+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:28:20.408391+0000","last_peered":"2023-10-14T01:28:20.408391+0000","last_clean":"2023-10-14T01:28:20.408391+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:28:20.408391+0000","last_undegraded":"2023-10-14T01:28:20.408391+0000","last_fullsized":"2023-10-14T01:28:20.408391+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30122024883,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2478895,"num_read_kb":9649733,"num_write":2433840,"num_write_kb":9732549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19932200960,"data_stored":32504692582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80427,"ondisk_log_size":80427,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739445,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5518420,"kb_used_data":3738444,"kb_used_omap":726,"kb_used_meta":1779241,"kb_avail":88853420,"statfs":{"total":96636764160,"available":90985902080,"internally_reserved":0,"allocated":3828166656,"data_stored":6218039372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1821943676},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,0,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.79200000000000004,"15min":0.82299999999999995},"min":{"1min":0.26700000000000002,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":8.0719999999999992,"5min":8.0719999999999992,"15min":10.981999999999999},"last":0.37},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.83499999999999996,"15min":0.871},"min":{"1min":0.307,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":8.0999999999999996,"5min":8.0999999999999996,"15min":11.039},"last":0.40300000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:29:03 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.88300000000000001,"15min":0.80100000000000005},"min":{"1min":0.219,"5min":0.20799999999999999,"15min":0.20499999999999999},"max":{"1min":4.2880000000000003,"5min":11.846,"15min":11.846},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.115,"5min":0.78600000000000003,"15min":0.76500000000000001},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":8.0229999999999997,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":1.6200000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739426,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11624300,"kb_used_data":9732900,"kb_used_omap":1070,"kb_used_meta":1890321,"kb_avail":82747540,"statfs":{"total":96636764160,"available":84733480960,"internally_reserved":0,"allocated":9966489600,"data_stored":16252390609,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":1935689205},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,3,1,2,5,10,19,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.77400000000000002,"15min":0.79200000000000004},"min":{"1min":0.246,"5min":0.22500000000000001,"15min":0.183},"max":{"1min":5.3040000000000003,"5min":5.5940000000000003,"15min":9.8879999999999999},"last":0.308},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.74399999999999999,"15min":0.67400000000000004},"min":{"1min":0.29499999999999998,"5min":0.185,"15min":0.185},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":10.029999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":1.292,"15min":1.7669999999999999},"min":{"1min":0.21299999999999999,"5min":0.20200000000000001,"15min":0.19900000000000001},"max":{"1min":4.0419999999999998,"5min":7.4619999999999997,"15min":17.547999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":1.006,"15min":0.81999999999999995},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":3.4220000000000002,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.34399999999999997}]}]},{"osd":0,"up_from":8,"seq":34359739445,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6891288,"kb_used_data":5996812,"kb_used_omap":1142,"kb_used_meta":893321,"kb_avail":87480552,"statfs":{"total":96636764160,"available":89580085248,"internally_reserved":0,"allocated":6140735488,"data_stored":10035885955,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":914761128},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2,0,11,0,3,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:28:58 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":0.90600000000000003,"15min":0.91500000000000004},"min":{"1min":0.186,"5min":0.158,"15min":0.158},"max":{"1min":5.7069999999999999,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.879,"15min":1.0629999999999999},"min":{"1min":0.24299999999999999,"5min":0.22,"15min":0.188},"max":{"1min":5.7290000000000001,"5min":8.3569999999999993,"15min":13.903},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:28:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.86799999999999999,"15min":0.78300000000000003},"min":{"1min":0.27500000000000002,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":4.218,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.093,"15min":1.022},"min":{"1min":0.249,"5min":0.187,"15min":0.187},"max":{"1min":8.8900000000000006,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":0.56799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6139215872,"data_stored":10034711141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9965871104,"data_stored":16252116915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3827113984,"data_stored":6217864526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:30:03.436 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:30:03.437 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:30:03.437 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:30:03.438 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:30:04.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:04.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:04.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:04.289 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:04.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.301+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:04.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.301+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:04.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:04.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.309+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:04.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:04.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:04.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:30:04.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:04.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:04.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:04.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:04.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:04.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:04.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:04.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:04.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:04.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.569+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:04.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:04.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:04.569+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:05.774 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:30:05.769+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:30:08.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:08.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:08.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:08.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:08.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:08.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:08.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:08.457+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:08.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:08.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:08.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:08.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:08.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:08.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:08.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:08.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:08.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:08.505+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:08.510 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:08.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:08.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:08.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:10.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:10.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:10.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:10.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:10.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:10.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:10.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:10.769+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:10.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:10.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:10.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:10.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:10.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:10.809+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:10.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:10.809+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:10.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:10.809+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:11.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:11.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:11.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:11.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:11.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:11.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:30:11.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:11.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:11.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:11.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:11.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:11.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:11.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:11.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:11.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.937+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:11.955 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:30:11.949+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:30:11.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:11.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:12.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:12.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:12.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:12.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:12.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:12.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:12.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:12.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:12.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:12.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:12.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:12.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:12.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:12.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:12.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:12.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:12.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:12.381+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:12.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:12.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:15.077 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:30:15.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:15.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:15.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:15.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:15.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:15.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:15.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:15.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:15.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:15.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.181+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:15.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:15.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:15.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:16.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:16.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:16.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:16.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:16.048 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:16.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.045+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:16.078 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:16.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.081+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:16.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:16.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:16.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:16.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:16.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:16.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:16.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.377+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:16.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:16.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:16.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.505+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:16.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.525+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:16.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:16.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:16.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:30:16.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:16.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:16.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:16.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:16.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:16.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:16.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:16.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:16.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.717+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:16.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:16.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:16.726 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:30:16.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:30:16.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:16.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:16.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:16.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:16.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:16.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.765+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:16.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:16.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.801+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:16.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:16.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.893+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:16.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:16.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:16.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:17.902 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:30:17.897+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:30:18.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:18.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:18.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:18.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:18.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:18.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.057+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:18.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:18.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.073+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:18.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:18.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:18.756 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:30:18.753+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:30:18.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:30:18.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:30:18.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:18.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:18.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:18.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:18.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:18.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:18.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.889+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:18.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:18.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.917+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:18.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:18.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:18.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:20.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:20.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:20.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:20.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:20.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:20.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:20.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.413+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:20.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.413+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:20.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:20.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.429+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:20.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:20.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.429+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:20.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:20.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:20.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:20.738 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:30:20.733+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:30:20.740 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:20.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:20.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:20.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:20.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:20.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.781+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:20.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:20.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:20.781+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:22.217 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:30:22.213+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:30:23.439 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:30:24.040 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:30:24.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:24.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:24.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:24.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:24.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:24.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:24.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:24.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.101+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:24.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.105+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:24.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.117+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:24.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.117+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:24.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.117+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:24.154 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:30:24.154 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:30:24.181 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2875,"stamp":"2023-10-14T01:30:23.813564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30153662931,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2486933,"num_read_kb":9681460,"num_write":2441927,"num_write_kb":9766243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80534,"ondisk_log_size":80534,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24368860,"kb_used_data":19531576,"kb_used_omap":2939,"kb_used_meta":4834308,"kb_avail":258746660,"statfs":{"total":289910292480,"available":264956579840,"internally_reserved":0,"allocated":20000333824,"data_stored":32571258016,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3009767,"internal_metadata":4950332185},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,0,4,3,16,18,11],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15245312,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3878,"num_read_kb":15472,"num_write":3895,"num_write_kb":15580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004132"},"pg_stats":[{"pgid":"2.7","version":"168'313871","reported_seq":614895,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:30:20.024424+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:30:20.024424+0000","last_peered":"2023-10-14T01:30:20.024424+0000","last_clean":"2023-10-14T01:30:20.024424+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:30:20.024424+0000","last_undegraded":"2023-10-14T01:30:20.024424+0000","last_fullsized":"2023-10-14T01:30:20.024424+0000","mapping_epoch":13,"log_start":"165'303817","ondisk_log_start":"165'303817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3669070360,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":302614,"num_read_kb":1177404,"num_write":295924,"num_write_kb":1183349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"168'330046","reported_seq":649891,"reported_epoch":168,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:30:20.009710+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:30:20.009710+0000","last_peered":"2023-10-14T01:30:20.009710+0000","last_clean":"2023-10-14T01:30:20.009710+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:30:20.009710+0000","last_undegraded":"2023-10-14T01:30:20.009710+0000","last_fullsized":"2023-10-14T01:30:20.009710+0000","mapping_epoch":13,"log_start":"166'320018","ondisk_log_start":"166'320018","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1114,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 365s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3879645402,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":323065,"num_read_kb":1248096,"num_write":313033,"num_write_kb":1251661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"168'307359","reported_seq":605227,"reported_epoch":168,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:30:20.019958+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:30:20.019958+0000","last_peered":"2023-10-14T01:30:20.019958+0000","last_clean":"2023-10-14T01:30:20.019958+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:30:20.019958+0000","last_undegraded":"2023-10-14T01:30:20.019958+0000","last_fullsized":"2023-10-14T01:30:20.019958+0000","mapping_epoch":13,"log_start":"165'297327","ondisk_log_start":"165'297327","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1315,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 354s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3643364032,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":299556,"num_read_kb":1169307,"num_write":294915,"num_write_kb":1179350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"168'305713","reported_seq":604896,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:30:19.988244+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:30:19.988244+0000","last_peered":"2023-10-14T01:30:19.988244+0000","last_clean":"2023-10-14T01:30:19.988244+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:30:19.988244+0000","last_undegraded":"2023-10-14T01:30:19.988244+0000","last_fullsized":"2023-10-14T01:30:19.988244+0000","mapping_epoch":13,"log_start":"164'295622","ondisk_log_start":"164'295622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3661402794,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":300657,"num_read_kb":1177056,"num_write":297367,"num_write_kb":1189217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"168'309505","reported_seq":617138,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:30:19.282705+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:30:19.282705+0000","last_peered":"2023-10-14T01:30:19.282705+0000","last_clean":"2023-10-14T01:30:19.282705+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:30:19.282705+0000","last_undegraded":"2023-10-14T01:30:19.282705+0000","last_fullsized":"2023-10-14T01:30:19.282705+0000","mapping_epoch":13,"log_start":"164'299423","ondisk_log_start":"164'299423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3734221321,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":309392,"num_read_kb":1199246,"num_write":303023,"num_write_kb":1211613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"168'311470","reported_seq":617522,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:30:20.247604+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:30:20.247604+0000","last_peered":"2023-10-14T01:30:20.247604+0000","last_clean":"2023-10-14T01:30:20.247604+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:30:20.247604+0000","last_undegraded":"2023-10-14T01:30:20.247604+0000","last_fullsized":"2023-10-14T01:30:20.247604+0000","mapping_epoch":13,"log_start":"164'301412","ondisk_log_start":"164'301412","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3778326846,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":307488,"num_read_kb":1206934,"num_write":305955,"num_write_kb":1223659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"168'313362","reported_seq":622160,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:30:20.264042+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:30:20.264042+0000","last_peered":"2023-10-14T01:30:20.264042+0000","last_clean":"2023-10-14T01:30:20.264042+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:30:20.264042+0000","last_undegraded":"2023-10-14T01:30:20.264042+0000","last_fullsized":"2023-10-14T01:30:20.264042+0000","mapping_epoch":13,"log_start":"165'303316","ondisk_log_start":"165'303316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3813224999,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":310032,"num_read_kb":1218388,"num_write":307801,"num_write_kb":1231067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"168'355660","reported_seq":687788,"reported_epoch":168,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:30:19.994993+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:30:19.994993+0000","last_peered":"2023-10-14T01:30:19.994993+0000","last_clean":"2023-10-14T01:30:19.994993+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:30:19.994993+0000","last_undegraded":"2023-10-14T01:30:19.994993+0000","last_fullsized":"2023-10-14T01:30:19.994993+0000","mapping_epoch":13,"log_start":"166'345616","ondisk_log_start":"166'345616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2301,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 969s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3973816809,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":334023,"num_read_kb":1284938,"num_write":323772,"num_write_kb":1294433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":352,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:29:35.445684+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:29:35.445684+0000","last_peered":"2023-10-14T01:29:35.445684+0000","last_clean":"2023-10-14T01:29:35.445684+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:29:35.445684+0000","last_undegraded":"2023-10-14T01:29:35.445684+0000","last_fullsized":"2023-10-14T01:29:35.445684+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30153072563,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2486827,"num_read_kb":9681369,"num_write":2441790,"num_write_kb":9764349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":19996909568,"data_stored":32569401190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80435,"ondisk_log_size":80435,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739449,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5586688,"kb_used_data":3750260,"kb_used_omap":726,"kb_used_meta":1835689,"kb_avail":88785152,"statfs":{"total":96636764160,"available":90915995648,"internally_reserved":0,"allocated":3840266240,"data_stored":6230138956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1879746428},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,1,2,3,7,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.75800000000000001,"15min":0.83799999999999997},"min":{"1min":0.25600000000000001,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":6.202,"5min":8.0719999999999992,"15min":10.981999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.81200000000000006,"15min":0.89000000000000001},"min":{"1min":0.31,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":6.2460000000000004,"5min":8.0999999999999996,"15min":11.039},"last":0.80800000000000005}]},{"osd":1,"last update":"Sat Oct 14 01:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.90600000000000003,"15min":0.80100000000000005},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":6.4870000000000001,"5min":11.846,"15min":11.846},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.71099999999999997,"15min":0.75900000000000001},"min":{"1min":0.251,"5min":0.222,"15min":0.222},"max":{"1min":2.3119999999999998,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":0.77800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739430,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11817644,"kb_used_data":9765412,"kb_used_omap":1070,"kb_used_meta":2051153,"kb_avail":82554196,"statfs":{"total":96636764160,"available":84535496704,"internally_reserved":0,"allocated":9999781888,"data_stored":16285682897,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1096203,"internal_metadata":2100381173},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,1,10,6,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.77400000000000002,"15min":0.79200000000000004},"min":{"1min":0.246,"5min":0.22500000000000001,"15min":0.183},"max":{"1min":5.3040000000000003,"5min":5.5940000000000003,"15min":9.8879999999999999},"last":1.159},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.74399999999999999,"15min":0.67400000000000004},"min":{"1min":0.29499999999999998,"5min":0.185,"15min":0.185},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":10.029999999999999},"last":1.036}]},{"osd":2,"last update":"Sat Oct 14 01:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":1.292,"15min":1.7669999999999999},"min":{"1min":0.21299999999999999,"5min":0.20200000000000001,"15min":0.19900000000000001},"max":{"1min":4.0419999999999998,"5min":7.4619999999999997,"15min":17.547999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":1.006,"15min":0.81999999999999995},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":3.4220000000000002,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.88800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739449,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6964528,"kb_used_data":6015904,"kb_used_omap":1142,"kb_used_meta":947465,"kb_avail":87407312,"statfs":{"total":96636764160,"available":89505087488,"internally_reserved":0,"allocated":6160285696,"data_stored":10055436163,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":970204584},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,3,0,3,5,8],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:30:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.073,"15min":0.90200000000000002},"min":{"1min":0.27100000000000002,"5min":0.158,"15min":0.158},"max":{"1min":5.5140000000000002,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.006,"15min":0.98399999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.188},"max":{"1min":7.641,"5min":8.3569999999999993,"15min":8.3569999999999993},"last":0.29299999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93400000000000005,"15min":0.80600000000000005},"min":{"1min":0.249,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":4.282,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.24399999999999999},{"interface":"front","average":{"1min":1.8959999999999999,"5min":1.262,"15min":1.1160000000000001},"min":{"1min":0.28799999999999998,"5min":0.187,"15min":0.187},"max":{"1min":7.6189999999999998,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":0.42599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6159011840,"data_stored":10054507109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9998700544,"data_stored":16284946355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3839197184,"data_stored":6229947726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:30:24.183 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:30:24.183 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:30:24.184 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:30:24.184 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:30:24.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.537+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:30:24.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:24.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:24.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:24.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:24.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:24.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:24.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.589+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:24.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.601+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:24.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:24.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:24.609+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:25.788 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:25.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:25.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:25.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:25.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:25.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:25.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:25.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:25.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:25.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:25.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:25.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:25.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:25.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:25.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:25.889+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:25.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:25.889+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:25.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:25.889+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:25.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:25.889+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:25.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:25.889+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:27.896 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:30:27.893+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:30:30.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:30.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:30.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:30.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:30.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:30.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:30.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:30.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.741+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:30.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:30.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.741+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:30.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.825+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:30.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:30.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:30.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:30.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:30.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:30.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:30.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:30.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:30.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.953+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:30.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:30.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:30.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:31.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:31.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:31.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:31.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:31.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:31.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:31.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:31.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:31.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:31.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:31.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:31.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:31.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:31.461+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:31.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:31.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:31.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:31.481+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:31.486 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:31.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:31.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:31.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:33.819 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:30:33.817+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:30:34.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:34.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:30:34.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:34.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:34.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:34.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:34.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:34.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:34.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:34.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:34.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:34.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:34.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:34.961+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:34.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:34.969+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:37.411 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:30:37.405+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:30:41.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:41.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:41.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:41.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:41.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:41.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:41.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:41.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:41.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:41.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:41.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:41.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:41.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:41.237+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:41.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:41.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:42.114 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:30:42.109+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:30:42.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:42.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:42.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:42.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:42.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:42.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:42.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:42.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:42.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:42.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:42.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:42.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:42.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:42.821+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:42.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:42.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:42.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:42.869+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:42.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:42.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:42.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:42.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:43.704 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:30:43.701+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:30:44.185 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:30:45.043 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:30:45.044 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:30:45.100 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2885,"stamp":"2023-10-14T01:30:43.817082+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30185411027,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2494979,"num_read_kb":9713540,"num_write":2450022,"num_write_kb":9798623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80618,"ondisk_log_size":80618,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24379820,"kb_used_data":19594448,"kb_used_omap":3019,"kb_used_meta":4782324,"kb_avail":258735700,"statfs":{"total":289910292480,"available":264945356800,"internally_reserved":0,"allocated":20064714752,"data_stored":32635638944,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3091787,"internal_metadata":4897100469},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2,7,16,12,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16084992,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4071,"num_read_kb":16228,"num_write":4090,"num_write_kb":16360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002142"},"pg_stats":[{"pgid":"2.7","version":"168'314853","reported_seq":616861,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:30:40.683008+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:30:40.683008+0000","last_peered":"2023-10-14T01:30:40.683008+0000","last_clean":"2023-10-14T01:30:40.683008+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:30:40.683008+0000","last_undegraded":"2023-10-14T01:30:40.683008+0000","last_fullsized":"2023-10-14T01:30:40.683008+0000","mapping_epoch":13,"log_start":"166'304817","ondisk_log_start":"166'304817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3672896024,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":303585,"num_read_kb":1181280,"num_write":296876,"num_write_kb":1187157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"168'331202","reported_seq":652172,"reported_epoch":168,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:30:40.706484+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:30:40.706484+0000","last_peered":"2023-10-14T01:30:40.706484+0000","last_clean":"2023-10-14T01:30:40.706484+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:30:40.706484+0000","last_undegraded":"2023-10-14T01:30:40.706484+0000","last_fullsized":"2023-10-14T01:30:40.706484+0000","mapping_epoch":13,"log_start":"166'321118","ondisk_log_start":"166'321118","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1162,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 386s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3883876570,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":324167,"num_read_kb":1252476,"num_write":314122,"num_write_kb":1256017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"168'308427","reported_seq":607269,"reported_epoch":168,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:30:40.679382+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:30:40.679382+0000","last_peered":"2023-10-14T01:30:40.679382+0000","last_clean":"2023-10-14T01:30:40.679382+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:30:40.679382+0000","last_undegraded":"2023-10-14T01:30:40.679382+0000","last_fullsized":"2023-10-14T01:30:40.679382+0000","mapping_epoch":13,"log_start":"166'298327","ondisk_log_start":"166'298327","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1387,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 375s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3647226560,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":300518,"num_read_kb":1173139,"num_write":295908,"num_write_kb":1183322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"168'306703","reported_seq":606885,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:30:40.657549+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:30:40.657549+0000","last_peered":"2023-10-14T01:30:40.657549+0000","last_clean":"2023-10-14T01:30:40.657549+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:30:40.657549+0000","last_undegraded":"2023-10-14T01:30:40.657549+0000","last_fullsized":"2023-10-14T01:30:40.657549+0000","mapping_epoch":13,"log_start":"166'296622","ondisk_log_start":"166'296622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3665244842,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":301649,"num_read_kb":1181016,"num_write":298347,"num_write_kb":1193137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"168'310479","reported_seq":619098,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:30:39.478557+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:30:39.478557+0000","last_peered":"2023-10-14T01:30:39.478557+0000","last_clean":"2023-10-14T01:30:39.478557+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:30:39.478557+0000","last_undegraded":"2023-10-14T01:30:39.478557+0000","last_fullsized":"2023-10-14T01:30:39.478557+0000","mapping_epoch":13,"log_start":"166'300423","ondisk_log_start":"166'300423","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3738042889,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":310366,"num_read_kb":1203130,"num_write":303994,"num_write_kb":1215497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"168'312444","reported_seq":619470,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:30:40.429402+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:30:40.429402+0000","last_peered":"2023-10-14T01:30:40.429402+0000","last_clean":"2023-10-14T01:30:40.429402+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:30:40.429402+0000","last_undegraded":"2023-10-14T01:30:40.429402+0000","last_fullsized":"2023-10-14T01:30:40.429402+0000","mapping_epoch":13,"log_start":"166'302412","ondisk_log_start":"166'302412","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3782107454,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":308461,"num_read_kb":1210822,"num_write":306919,"num_write_kb":1227515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"168'314367","reported_seq":624151,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:30:40.436544+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:30:40.436544+0000","last_peered":"2023-10-14T01:30:40.436544+0000","last_clean":"2023-10-14T01:30:40.436544+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:30:40.436544+0000","last_undegraded":"2023-10-14T01:30:40.436544+0000","last_fullsized":"2023-10-14T01:30:40.436544+0000","mapping_epoch":13,"log_start":"166'304316","ondisk_log_start":"166'304316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3817189927,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":311015,"num_read_kb":1222308,"num_write":308796,"num_write_kb":1235047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"168'356895","reported_seq":690141,"reported_epoch":168,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:30:40.651642+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:30:40.651642+0000","last_peered":"2023-10-14T01:30:40.651642+0000","last_clean":"2023-10-14T01:30:40.651642+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:30:40.651642+0000","last_undegraded":"2023-10-14T01:30:40.651642+0000","last_fullsized":"2023-10-14T01:30:40.651642+0000","mapping_epoch":13,"log_start":"166'346816","ondisk_log_start":"166'346816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2334,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 990s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3978236393,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":335112,"num_read_kb":1289278,"num_write":324923,"num_write_kb":1299037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":352,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-10-14T01:29:35.445684+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:29:35.445684+0000","last_peered":"2023-10-14T01:29:35.445684+0000","last_clean":"2023-10-14T01:29:35.445684+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:29:35.445684+0000","last_undegraded":"2023-10-14T01:29:35.445684+0000","last_fullsized":"2023-10-14T01:29:35.445684+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30184820659,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2494873,"num_read_kb":9713449,"num_write":2449885,"num_write_kb":9796729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20062904320,"data_stored":32635395942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80519,"ondisk_log_size":80519,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739453,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5655592,"kb_used_data":3762528,"kb_used_omap":726,"kb_used_meta":1892329,"kb_avail":88716248,"statfs":{"total":96636764160,"available":90845437952,"internally_reserved":0,"allocated":3852828672,"data_stored":6242701388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1937745788},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,1,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.75800000000000001,"15min":0.83799999999999997},"min":{"1min":0.25600000000000001,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":6.202,"5min":8.0719999999999992,"15min":10.981999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.81200000000000006,"15min":0.89000000000000001},"min":{"1min":0.31,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":6.2460000000000004,"5min":8.0999999999999996,"15min":11.039},"last":0.32400000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.90600000000000003,"15min":0.80100000000000005},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":6.4870000000000001,"5min":11.846,"15min":11.846},"last":1.8140000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.71099999999999997,"15min":0.75900000000000001},"min":{"1min":0.251,"5min":0.222,"15min":0.222},"max":{"1min":2.3119999999999998,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":0.45500000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739434,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11682268,"kb_used_data":9796880,"kb_used_omap":1150,"kb_used_meta":1884225,"kb_avail":82689572,"statfs":{"total":96636764160,"available":84674121728,"internally_reserved":0,"allocated":10032005120,"data_stored":16317906129,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1178223,"internal_metadata":1929446801},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2,10,8,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.77400000000000002,"15min":0.79200000000000004},"min":{"1min":0.246,"5min":0.22500000000000001,"15min":0.183},"max":{"1min":5.3040000000000003,"5min":5.5940000000000003,"15min":9.8879999999999999},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.74399999999999999,"15min":0.67400000000000004},"min":{"1min":0.29499999999999998,"5min":0.185,"15min":0.185},"max":{"1min":5.3689999999999998,"5min":5.3689999999999998,"15min":10.029999999999999},"last":0.34300000000000003}]},{"osd":2,"last update":"Sat Oct 14 01:29:53 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":1.292,"15min":1.7669999999999999},"min":{"1min":0.21299999999999999,"5min":0.20200000000000001,"15min":0.19900000000000001},"max":{"1min":4.0419999999999998,"5min":7.4619999999999997,"15min":17.547999999999998},"last":7.7199999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":1.006,"15min":0.81999999999999995},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":3.4220000000000002,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.30299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739453,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7041960,"kb_used_data":6035040,"kb_used_omap":1142,"kb_used_meta":1005769,"kb_avail":87329880,"statfs":{"total":96636764160,"available":89425797120,"internally_reserved":0,"allocated":6179880960,"data_stored":10075031427,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":1029907880},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,4,3,4,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:30:01 2023","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.073,"15min":0.90200000000000002},"min":{"1min":0.27100000000000002,"5min":0.158,"15min":0.158},"max":{"1min":5.5140000000000002,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":3.7280000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.006,"15min":0.98399999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.188},"max":{"1min":7.641,"5min":8.3569999999999993,"15min":8.3569999999999993},"last":3.681}]},{"osd":2,"last update":"Sat Oct 14 01:30:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.93400000000000005,"15min":0.80600000000000005},"min":{"1min":0.249,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":4.282,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.8959999999999999,"5min":1.262,"15min":1.1160000000000001},"min":{"1min":0.28799999999999998,"5min":0.187,"15min":0.187},"max":{"1min":7.6189999999999998,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":0.38700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6178885632,"data_stored":10074380901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10032177152,"data_stored":16318422963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3851841536,"data_stored":6242592078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:30:45.101 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:30:45.102 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:30:45.102 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:30:45.103 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:30:46.426 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:46.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:46.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:46.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:46.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:46.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:46.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:46.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:46.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:46.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:46.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:46.453+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:46.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:46.457+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:46.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:46.481+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:46.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:46.493+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:46.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:46.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:46.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:46.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:47.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:47.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:47.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:47.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:47.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:47.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:47.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:47.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:47.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:47.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:47.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:47.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:47.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:47.688+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:47.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:47.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:47.707 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:47.704+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:47.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:47.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:47.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:47.704+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:48.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:48.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:48.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:48.084+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:48.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:48.148+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:48.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:48.192+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:49.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:49.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:30:49.761 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:49.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:49.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:49.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:49.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:49.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:49.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:49.772+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:49.798 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:49.788+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:49.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:49.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:49.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:49.828+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:51.055 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:30:51.052+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:30:51.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:51.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:51.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:51.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:51.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:51.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:51.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:51.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.584+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:51.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.588+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:51.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:51.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:51.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:30:51.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.976+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:30:52.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:51.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:52.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:52.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:52.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:52.004+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:52.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:52.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:52.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:52.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:52.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:52.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:52.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:52.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:52.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:52.168+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:52.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:52.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:52.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:52.204+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:52.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:52.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:52.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:52.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:53.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.656+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:30:53.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:53.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:53.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:53.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:53.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:53.751 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:53.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:53.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.760+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:53.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:53.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.768+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:53.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:53.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:53.768+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:54.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:54.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:54.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:54.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:54.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:54.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:54.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:54.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:54.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:54.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:54.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:54.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:54.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:54.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:54.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:54.716+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:54.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:54.744+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:54.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:54.748+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:54.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:54.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:54.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:54.748+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:55.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:30:55.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:30:55.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:55.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:55.668 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:55.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:55.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:55.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:55.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:55.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:55.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.788+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:55.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:55.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:55.788+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:57.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:57.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:57.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:57.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:57.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:57.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.528+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:57.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:57.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:57.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:57.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.592+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:57.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:57.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:57.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:30:57.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:57.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:57.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.812+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:57.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.884+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:30:57.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:30:57.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:30:57.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:57.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.936+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:57.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.944+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:30:57.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:30:57.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:57.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:30:59.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:59.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:30:59.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:59.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:30:59.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:59.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:30:59.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:59.124+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:30:59.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:59.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:30:59.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:30:59.148+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:00.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:00.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:00.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:00.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:00.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:00.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:00.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:00.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:00.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:00.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:00.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:00.636+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:00.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:00.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:00.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:00.696+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:00.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:00.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:00.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:00.696+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:01.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:01.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:01.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.228+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:01.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.292+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:01.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.332+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:01.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:01.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.332+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:01.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:01.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.928+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:01.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:01.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:01.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:01.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:01.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:02.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.008+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:02.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:02.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:02.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:02.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:02.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:02.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:02.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:02.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:02.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:02.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:02.888 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.888+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:02.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:02.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:02.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.940+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:02.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:03.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:02.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:03.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:03.000+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:04.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:04.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:04.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:04.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:04.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:04.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:04.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:04.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:04.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:04.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:04.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:04.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:04.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:04.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:04.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:04.456+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:04.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:04.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:04.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:04.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:05.104 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:31:05.903 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:31:05.904 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:31:05.945 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2898,"stamp":"2023-10-14T01:31:05.822816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30218977747,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2503707,"num_read_kb":9748380,"num_write":2458655,"num_write_kb":9833155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80543,"ondisk_log_size":80543,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24701516,"kb_used_data":19666864,"kb_used_omap":3019,"kb_used_meta":5031604,"kb_avail":258414004,"statfs":{"total":289910292480,"available":264615940096,"internally_reserved":0,"allocated":20138868736,"data_stored":32709764761,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3091787,"internal_metadata":5152363189},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,6,7,7,10,10,6],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15130624,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3813,"num_read_kb":15224,"num_write":3898,"num_write_kb":15592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001608"},"pg_stats":[{"pgid":"2.7","version":"170'315869","reported_seq":618851,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:01.412732+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:31:01.412732+0000","last_peered":"2023-10-14T01:31:01.412732+0000","last_clean":"2023-10-14T01:31:01.412732+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:31:01.412732+0000","last_undegraded":"2023-10-14T01:31:01.412732+0000","last_fullsized":"2023-10-14T01:31:01.412732+0000","mapping_epoch":13,"log_start":"166'305817","ondisk_log_start":"166'305817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3676725784,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":304545,"num_read_kb":1185120,"num_write":297844,"num_write_kb":1191029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"170'332338","reported_seq":654418,"reported_epoch":170,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:31:01.434545+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:31:01.434545+0000","last_peered":"2023-10-14T01:31:01.434545+0000","last_clean":"2023-10-14T01:31:01.434545+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:31:01.434545+0000","last_undegraded":"2023-10-14T01:31:01.434545+0000","last_fullsized":"2023-10-14T01:31:01.434545+0000","mapping_epoch":13,"log_start":"166'322318","ondisk_log_start":"166'322318","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1209,"log_size":10020,"log_dups_size":0,"ondisk_log_size":10020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 406s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3887988954,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":325255,"num_read_kb":1256816,"num_write":315176,"num_write_kb":1260233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"170'309497","reported_seq":609342,"reported_epoch":170,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:31:01.396019+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:31:01.396019+0000","last_peered":"2023-10-14T01:31:01.396019+0000","last_clean":"2023-10-14T01:31:01.396019+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:31:01.396019+0000","last_undegraded":"2023-10-14T01:31:01.396019+0000","last_fullsized":"2023-10-14T01:31:01.396019+0000","mapping_epoch":13,"log_start":"166'299427","ondisk_log_start":"166'299427","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1464,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 395s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3651048128,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":301497,"num_read_kb":1177051,"num_write":296889,"num_write_kb":1187246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"170'307675","reported_seq":608819,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:01.371564+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:31:01.371564+0000","last_peered":"2023-10-14T01:31:01.371564+0000","last_clean":"2023-10-14T01:31:01.371564+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:31:01.371564+0000","last_undegraded":"2023-10-14T01:31:01.371564+0000","last_fullsized":"2023-10-14T01:31:01.371564+0000","mapping_epoch":13,"log_start":"166'297622","ondisk_log_start":"166'297622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10053,"log_dups_size":0,"ondisk_log_size":10053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3668906666,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":302605,"num_read_kb":1184836,"num_write":299303,"num_write_kb":1196961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"170'311705","reported_seq":621550,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:04.698270+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:31:04.698270+0000","last_peered":"2023-10-14T01:31:04.698270+0000","last_clean":"2023-10-14T01:31:04.698270+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:31:04.698270+0000","last_undegraded":"2023-10-14T01:31:04.698270+0000","last_fullsized":"2023-10-14T01:31:04.698270+0000","mapping_epoch":13,"log_start":"166'301623","ondisk_log_start":"166'301623","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3742765577,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":311577,"num_read_kb":1207962,"num_write":305208,"num_write_kb":1220353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"170'313648","reported_seq":621868,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:05.598328+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:31:05.598328+0000","last_peered":"2023-10-14T01:31:05.598328+0000","last_clean":"2023-10-14T01:31:05.598328+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:31:05.598328+0000","last_undegraded":"2023-10-14T01:31:05.598328+0000","last_fullsized":"2023-10-14T01:31:05.598328+0000","mapping_epoch":13,"log_start":"166'303612","ondisk_log_start":"166'303612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3786719550,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":309647,"num_read_kb":1215554,"num_write":308117,"num_write_kb":1232307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"170'315611","reported_seq":626667,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:05.655832+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:31:05.655832+0000","last_peered":"2023-10-14T01:31:05.655832+0000","last_clean":"2023-10-14T01:31:05.655832+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:31:05.655832+0000","last_undegraded":"2023-10-14T01:31:05.655832+0000","last_fullsized":"2023-10-14T01:31:05.655832+0000","mapping_epoch":13,"log_start":"166'305516","ondisk_log_start":"166'305516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3822088743,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":312280,"num_read_kb":1227348,"num_write":310034,"num_write_kb":1239999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"170'358052","reported_seq":692420,"reported_epoch":170,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:31:01.372788+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:31:01.372788+0000","last_peered":"2023-10-14T01:31:01.372788+0000","last_clean":"2023-10-14T01:31:01.372788+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:31:01.372788+0000","last_undegraded":"2023-10-14T01:31:01.372788+0000","last_fullsized":"2023-10-14T01:31:01.372788+0000","mapping_epoch":13,"log_start":"166'348016","ondisk_log_start":"166'348016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2384,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 1010s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3982143977,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":336195,"num_read_kb":1293602,"num_write":325947,"num_write_kb":1303133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":354,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T01:30:45.444214+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:30:45.444214+0000","last_peered":"2023-10-14T01:30:45.444214+0000","last_clean":"2023-10-14T01:30:45.444214+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:30:45.444214+0000","last_undegraded":"2023-10-14T01:30:45.444214+0000","last_fullsized":"2023-10-14T01:30:45.444214+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30218387379,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2503601,"num_read_kb":9748289,"num_write":2458518,"num_write_kb":9831261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20135399424,"data_stored":32707891046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80444,"ondisk_log_size":80444,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739458,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5724900,"kb_used_data":3777692,"kb_used_omap":726,"kb_used_meta":1946473,"kb_avail":88646940,"statfs":{"total":96636764160,"available":90774466560,"internally_reserved":0,"allocated":3868356608,"data_stored":6258219935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1993189244},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.75800000000000001,"15min":0.83799999999999997},"min":{"1min":0.25600000000000001,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":6.202,"5min":8.0719999999999992,"15min":10.981999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.81200000000000006,"15min":0.89000000000000001},"min":{"1min":0.31,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":6.2460000000000004,"5min":8.0999999999999996,"15min":11.039},"last":0.52600000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:30:05 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.90600000000000003,"15min":0.80100000000000005},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":6.4870000000000001,"5min":11.846,"15min":11.846},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.71099999999999997,"15min":0.75900000000000001},"min":{"1min":0.251,"5min":0.222,"15min":0.222},"max":{"1min":2.3119999999999998,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":0.55900000000000005}]}]},{"osd":1,"up_from":8,"seq":34359739438,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11874592,"kb_used_data":9829780,"kb_used_omap":1150,"kb_used_meta":2043649,"kb_avail":82497248,"statfs":{"total":96636764160,"available":84477181952,"internally_reserved":0,"allocated":10065694720,"data_stored":16351586340,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1178223,"internal_metadata":2092696977},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,6,5,4,8,7,6],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.70799999999999996,"15min":0.81299999999999994},"min":{"1min":0.221,"5min":0.221,"15min":0.183},"max":{"1min":3.149,"5min":5.5940000000000003,"15min":9.8879999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.63700000000000001,"15min":0.68300000000000005},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":1.6160000000000001,"5min":5.3689999999999998,"15min":10.029999999999999},"last":0.49399999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:30:55 2023","interfaces":[{"interface":"back","average":{"1min":2.1520000000000001,"5min":1.544,"15min":1.8520000000000001},"min":{"1min":0.223,"5min":0.20200000000000001,"15min":0.19900000000000001},"max":{"1min":14.208,"5min":14.208,"15min":17.547999999999998},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.94499999999999995,"15min":0.84799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":4.6269999999999998,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.57999999999999996}]}]},{"osd":0,"up_from":8,"seq":34359739458,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7102024,"kb_used_data":6059392,"kb_used_omap":1142,"kb_used_meta":1041481,"kb_avail":87269816,"statfs":{"total":96636764160,"available":89364291584,"internally_reserved":0,"allocated":6204817408,"data_stored":10099958486,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":1066476968},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2,3,1,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:31:04 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.111,"15min":0.94399999999999995},"min":{"1min":0.247,"5min":0.186,"15min":0.158},"max":{"1min":6.2149999999999999,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":3.923},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.24199999999999999,"5min":0.24099999999999999,"15min":0.20999999999999999},"max":{"1min":4.008,"5min":8.3569999999999993,"15min":8.3569999999999993},"last":4.008}]},{"osd":2,"last update":"Sat Oct 14 01:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.875,"15min":0.80800000000000005},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":3.7559999999999998,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":3.7559999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.1850000000000001,"15min":1.1020000000000001},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.187},"max":{"1min":1.986,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":0.29699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6203600896,"data_stored":10099096165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10064896000,"data_stored":16351141811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3866902528,"data_stored":6257653070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:31:05.946 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:31:05.947 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:31:05.947 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:31:05.948 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:31:07.001 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:31:07.079 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T01:31:08.012 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T01:31:08.093 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-10-14T01:31:08.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:08.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:08.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:08.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:08.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:08.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:08.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:08.300+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:08.937 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-10-14T01:31:08.978 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:31:10.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:10.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:10.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:10.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:10.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:10.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:10.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.400+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:10.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:10.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:10.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:31:10.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:10.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:10.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:10.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:10.745 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:10.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:10.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.784+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:10.787 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:10.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:11.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:11.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:11.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:11.576+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:11.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:11.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:11.610 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:11.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:11.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:11.608+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:11.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:11.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:11.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:11.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:13.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:13.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:13.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:13.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:13.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:13.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:13.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:13.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:13.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:13.464+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:14.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:14.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:14.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:14.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:14.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:14.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:14.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:14.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:14.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:14.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:31:14.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:14.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:14.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:14.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:14.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:14.280+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:17.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:17.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:17.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:17.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:17.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:17.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:17.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:17.932+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:17.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:17.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:17.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:17.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:18.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:18.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.012+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:18.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.064+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:18.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.084+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:18.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:18.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.084+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:18.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:18.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:18.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:18.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.420+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:18.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:18.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:18.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.440+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:18.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:18.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.452+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:18.454 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:18.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:18.452+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:19.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:19.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:19.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:19.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:19.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:19.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.192+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:19.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.204+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:19.243 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:31:19.244+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:31:19.243 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:31:19.244+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:31:19.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:19.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:19.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:19.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:19.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:19.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:19.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:19.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:19.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:19.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:19.731 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:19.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:19.733 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.732+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:19.760 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.756+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:19.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:19.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:19.792+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:21.131 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:21.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:31:21.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:21.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:31:21.148 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:21.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:21.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:21.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:21.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:21.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:21.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:21.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:21.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:21.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:21.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:21.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:21.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:21.192+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:21.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:21.196+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:21.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:21.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:21.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:21.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:23.197 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:31:23.196+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:31:23.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:23.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:23.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:23.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:23.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:23.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:23.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:23.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:23.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:23.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:23.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:23.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:23.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:23.600+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:23.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:23.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:23.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:23.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:25.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:25.268+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:25.283 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:25.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:25.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:25.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:25.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:25.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:25.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:25.356+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:25.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:25.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:25.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:25.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:26.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:26.304+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:26.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:26.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:26.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:26.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:26.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:26.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:26.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:26.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:26.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:26.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:26.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:26.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:26.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:26.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:26.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:26.436+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:26.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:26.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:26.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:26.436+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:28.875 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:31:28.876+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:31:28.979 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:31:29.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:29.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:29.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:29.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:29.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:29.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:29.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:29.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:29.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:29.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:29.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:29.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:29.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:29.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:29.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:29.200+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:29.591 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:31:29.592 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:31:29.667 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2909,"stamp":"2023-10-14T01:31:27.835291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30254666195,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2512831,"num_read_kb":9784812,"num_write":2467800,"num_write_kb":9869735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80463,"ondisk_log_size":80463,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23668996,"kb_used_data":19736744,"kb_used_omap":3020,"kb_used_meta":3929203,"kb_avail":259446524,"statfs":{"total":289910292480,"available":265673240576,"internally_reserved":0,"allocated":20210425856,"data_stored":32781321881,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3093466,"internal_metadata":4023503910},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,5,5,14,10,12,14],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":20951040,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5242,"num_read_kb":20928,"num_write":5352,"num_write_kb":21408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010422"},"pg_stats":[{"pgid":"2.7","version":"170'317201","reported_seq":621398,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:27.092140+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:31:27.092140+0000","last_peered":"2023-10-14T01:31:27.092140+0000","last_clean":"2023-10-14T01:31:27.092140+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:31:27.092140+0000","last_undegraded":"2023-10-14T01:31:27.092140+0000","last_fullsized":"2023-10-14T01:31:27.092140+0000","mapping_epoch":13,"log_start":"166'307117","ondisk_log_start":"166'307117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3681763864,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":305745,"num_read_kb":1189908,"num_write":299118,"num_write_kb":1196125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"170'333749","reported_seq":657151,"reported_epoch":170,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:31:27.086494+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:31:27.086494+0000","last_peered":"2023-10-14T01:31:27.086494+0000","last_clean":"2023-10-14T01:31:27.086494+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:31:27.086494+0000","last_undegraded":"2023-10-14T01:31:27.086494+0000","last_fullsized":"2023-10-14T01:31:27.086494+0000","mapping_epoch":13,"log_start":"167'323718","ondisk_log_start":"167'323718","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1276,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 432s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3893072090,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":326551,"num_read_kb":1261988,"num_write":316478,"num_write_kb":1265441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"170'310793","reported_seq":611856,"reported_epoch":170,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:31:27.066434+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:31:27.066434+0000","last_peered":"2023-10-14T01:31:27.066434+0000","last_clean":"2023-10-14T01:31:27.066434+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:31:27.066434+0000","last_undegraded":"2023-10-14T01:31:27.066434+0000","last_fullsized":"2023-10-14T01:31:27.066434+0000","mapping_epoch":13,"log_start":"166'300727","ondisk_log_start":"166'300727","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1558,"log_size":10066,"log_dups_size":0,"ondisk_log_size":10066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 421s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3655647936,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":302693,"num_read_kb":1181823,"num_write":298072,"num_write_kb":1191978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"170'308854","reported_seq":611192,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:27.045482+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:31:27.045482+0000","last_peered":"2023-10-14T01:31:27.045482+0000","last_clean":"2023-10-14T01:31:27.045482+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:31:27.045482+0000","last_undegraded":"2023-10-14T01:31:27.045482+0000","last_fullsized":"2023-10-14T01:31:27.045482+0000","mapping_epoch":13,"log_start":"166'298822","ondisk_log_start":"166'298822","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3673371306,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":303793,"num_read_kb":1189584,"num_write":300462,"num_write_kb":1201597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"170'312655","reported_seq":623433,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:24.829898+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:31:24.829898+0000","last_peered":"2023-10-14T01:31:24.829898+0000","last_clean":"2023-10-14T01:31:24.829898+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:31:24.829898+0000","last_undegraded":"2023-10-14T01:31:24.829898+0000","last_fullsized":"2023-10-14T01:31:24.829898+0000","mapping_epoch":13,"log_start":"166'302623","ondisk_log_start":"166'302623","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3746456073,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":312500,"num_read_kb":1211646,"num_write":306146,"num_write_kb":1224105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"170'314580","reported_seq":623786,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:25.810346+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:31:25.810346+0000","last_peered":"2023-10-14T01:31:25.810346+0000","last_clean":"2023-10-14T01:31:25.810346+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:31:25.810346+0000","last_undegraded":"2023-10-14T01:31:25.810346+0000","last_fullsized":"2023-10-14T01:31:25.810346+0000","mapping_epoch":13,"log_start":"166'304512","ondisk_log_start":"166'304512","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3790307646,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":310627,"num_read_kb":1219466,"num_write":309042,"num_write_kb":1236007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"170'316624","reported_seq":628667,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:25.814612+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:31:25.814612+0000","last_peered":"2023-10-14T01:31:25.814612+0000","last_clean":"2023-10-14T01:31:25.814612+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:31:25.814612+0000","last_undegraded":"2023-10-14T01:31:25.814612+0000","last_fullsized":"2023-10-14T01:31:25.814612+0000","mapping_epoch":13,"log_start":"166'306616","ondisk_log_start":"166'306616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3826053671,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":313263,"num_read_kb":1231276,"num_write":311040,"num_write_kb":1244023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"170'359559","reported_seq":695324,"reported_epoch":170,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:31:27.053183+0000","last_change":"2023-10-14T01:14:10.515176+0000","last_active":"2023-10-14T01:31:27.053183+0000","last_peered":"2023-10-14T01:31:27.053183+0000","last_clean":"2023-10-14T01:31:27.053183+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:31:27.053183+0000","last_undegraded":"2023-10-14T01:31:27.053183+0000","last_fullsized":"2023-10-14T01:31:27.053183+0000","mapping_epoch":13,"log_start":"167'349516","ondisk_log_start":"167'349516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2433,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 1036s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3987403241,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":337553,"num_read_kb":1299030,"num_write":327305,"num_write_kb":1308565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":354,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T01:30:45.444214+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:30:45.444214+0000","last_peered":"2023-10-14T01:30:45.444214+0000","last_clean":"2023-10-14T01:30:45.444214+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:30:45.444214+0000","last_undegraded":"2023-10-14T01:30:45.444214+0000","last_fullsized":"2023-10-14T01:30:45.444214+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30254075827,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2512725,"num_read_kb":9784721,"num_write":2467663,"num_write_kb":9867841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10147,"num_omap_keys":167,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20208041984,"data_stored":32780533606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80364,"ondisk_log_size":80364,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739462,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5768816,"kb_used_data":3789672,"kb_used_omap":726,"kb_used_meta":1978409,"kb_avail":88603024,"statfs":{"total":96636764160,"available":90729496576,"internally_reserved":0,"allocated":3880624128,"data_stored":6270487455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":2025891708},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,2,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.71999999999999997,"15min":0.81000000000000005},"min":{"1min":0.19600000000000001,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":0.74199999999999999,"5min":8.0719999999999992,"15min":10.981999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.77900000000000003,"15min":0.86299999999999999},"min":{"1min":0.28599999999999998,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.80800000000000005,"5min":8.0999999999999996,"15min":11.039},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.002,"15min":0.80800000000000005},"min":{"1min":0.20200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.4400000000000004,"5min":11.846,"15min":11.846},"last":6.0960000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.70699999999999996,"15min":0.73999999999999999},"min":{"1min":0.253,"5min":0.222,"15min":0.222},"max":{"1min":1.8680000000000001,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":0.32300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739443,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10784884,"kb_used_data":9868648,"kb_used_omap":1152,"kb_used_meta":915071,"kb_avail":83586956,"statfs":{"total":96636764160,"available":85593042944,"internally_reserved":0,"allocated":10105495552,"data_stored":16391387172,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1179902,"internal_metadata":937033474},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,5,4,6,4,8,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.70799999999999996,"15min":0.81299999999999994},"min":{"1min":0.221,"5min":0.221,"15min":0.183},"max":{"1min":3.149,"5min":5.5940000000000003,"15min":9.8879999999999999},"last":0.215},{"interface":"front","average":{"1min":0.498,"5min":0.63700000000000001,"15min":0.68300000000000005},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":1.6160000000000001,"5min":5.3689999999999998,"15min":10.029999999999999},"last":0.28799999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:30:55 2023","interfaces":[{"interface":"back","average":{"1min":2.1520000000000001,"5min":1.544,"15min":1.8520000000000001},"min":{"1min":0.223,"5min":0.20200000000000001,"15min":0.19900000000000001},"max":{"1min":14.208,"5min":14.208,"15min":17.547999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.94499999999999995,"15min":0.84799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":4.6269999999999998,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.24399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739462,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7115296,"kb_used_data":6078424,"kb_used_omap":1142,"kb_used_meta":1035721,"kb_avail":87256544,"statfs":{"total":96636764160,"available":89350701056,"internally_reserved":0,"allocated":6224306176,"data_stored":10119447254,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":1060578728},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,7,4,3,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:31:04 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.111,"15min":0.94399999999999995},"min":{"1min":0.247,"5min":0.186,"15min":0.158},"max":{"1min":6.2149999999999999,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.441},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.24199999999999999,"5min":0.24099999999999999,"15min":0.20999999999999999},"max":{"1min":4.008,"5min":8.3569999999999993,"15min":8.3569999999999993},"last":0.252}]},{"osd":2,"last update":"Sat Oct 14 01:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.875,"15min":0.80800000000000005},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":3.7559999999999998,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.1850000000000001,"15min":1.1020000000000001},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.187},"max":{"1min":1.986,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":0.41299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6223192064,"data_stored":10118687333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10105593856,"data_stored":16391839667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3879256064,"data_stored":6270006606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:31:29.668 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:31:29.669 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:31:29.669 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:31:29.670 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:31:32.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:32.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:32.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:32.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:32.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:32.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:32.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:32.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:32.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:32.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:32.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:32.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:32.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:32.432+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:32.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:32.448+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:32.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:32.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:32.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:32.448+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:33.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:33.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.080+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:33.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:33.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:33.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.132+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:33.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:33.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.156+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:33.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:31:33.184 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:31:33.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:33.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:33.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:33.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.244+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:33.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:33.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.244+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:33.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:33.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:33.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:33.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:33.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:33.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:33.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:33.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:33.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.528+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:33.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:33.530 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:33.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:35.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:35.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:35.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:35.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:35.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:35.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.552+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:35.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.572+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:35.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.572+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:35.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:31:35.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:35.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:35.699 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:35.700 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:35.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:35.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:35.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.720+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:35.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.736+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:35.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.772+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:35.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:35.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:35.772+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:37.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:31:37.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:31:37.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:31:37.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:37.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:37.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:37.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:37.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:37.461 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:37.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:37.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.472+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:37.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:37.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:37.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.476+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:31:37.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:31:37.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:31:37.498 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.492+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:37.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:37.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:37.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:37.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:37.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:37.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.560+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:37.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.560+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:37.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.560+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:37.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.560+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:37.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:37.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:41.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:41.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:41.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:41.488+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:41.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:41.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:41.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:41.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:41.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:41.548+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:41.550 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:41.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:41.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:41.612+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:41.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:41.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:41.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:41.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:42.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:42.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:42.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.064+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:42.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:42.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:42.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.132+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:42.206 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:42.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:42.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.228+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:42.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.236+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:42.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:42.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.236+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:42.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:31:42.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:31:42.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:31:42.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:42.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:42.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:42.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:42.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:42.390 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:42.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:42.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:42.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:42.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.408+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:42.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:42.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:42.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:43.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:43.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:43.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:43.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:43.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:43.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:43.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:43.076+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:43.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:43.128+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:43.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:43.128+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:43.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:43.140+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:43.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:43.156+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:43.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:43.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:43.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:43.156+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:43.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:43.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:43.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:43.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:45.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:45.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:45.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:45.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:45.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:45.624+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:45.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:45.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:45.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:45.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:45.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:45.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:45.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:45.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:45.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:45.684+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:46.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:31:46.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:31:46.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:46.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:46.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:46.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:46.777 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:46.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:46.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:46.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.800+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:46.819 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.816+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:46.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.872+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:46.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:46.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:46.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:47.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:47.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:31:48.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:48.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:48.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.012+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:48.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:48.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.036+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:48.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:48.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.092+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:48.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.100+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:48.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.112+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:48.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.112+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:48.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.112+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:48.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:48.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:48.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:48.876 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:48.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:48.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:48.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:48.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.908+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:48.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.924+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:48.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:48.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:48.960+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:49.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:49.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:49.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.200+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:49.214 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.212+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:49.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.224+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:49.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.252+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:49.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.252+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:49.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:49.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.316+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:49.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:49.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:49.671 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:31:49.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.720+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:31:49.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.736+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:49.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:49.747 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.744+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:49.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:49.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.832+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:49.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.840+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:49.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:49.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.844+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:49.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:49.928+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:50.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:50.024+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:50.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:50.024+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:50.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:50.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:31:50.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:50.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:50.438 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:31:50.439 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:31:50.504 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2920,"stamp":"2023-10-14T01:31:49.838975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30286569939,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2520909,"num_read_kb":9817052,"num_write":2475983,"num_write_kb":9902467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80398,"ondisk_log_size":80398,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24050344,"kb_used_data":19802952,"kb_used_omap":3020,"kb_used_meta":4244339,"kb_avail":259065176,"statfs":{"total":289910292480,"available":265282740224,"internally_reserved":0,"allocated":20278222848,"data_stored":32849118873,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3093466,"internal_metadata":4346203174},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,6,6,6,9,6,10,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16248832,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4048,"num_read_kb":16164,"num_write":4160,"num_write_kb":16640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002036"},"pg_stats":[{"pgid":"2.7","version":"170'318250","reported_seq":623457,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:47.561426+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:31:47.561426+0000","last_peered":"2023-10-14T01:31:47.561426+0000","last_clean":"2023-10-14T01:31:47.561426+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:31:47.561426+0000","last_undegraded":"2023-10-14T01:31:47.561426+0000","last_fullsized":"2023-10-14T01:31:47.561426+0000","mapping_epoch":13,"log_start":"167'308217","ondisk_log_start":"167'308217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3685696024,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":306743,"num_read_kb":1193888,"num_write":300122,"num_write_kb":1200141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"170'334941","reported_seq":659399,"reported_epoch":170,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:31:47.592193+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:31:47.592193+0000","last_peered":"2023-10-14T01:31:47.592193+0000","last_clean":"2023-10-14T01:31:47.592193+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:31:47.592193+0000","last_undegraded":"2023-10-14T01:31:47.592193+0000","last_fullsized":"2023-10-14T01:31:47.592193+0000","mapping_epoch":13,"log_start":"167'324918","ondisk_log_start":"167'324918","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1320,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 453s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3897405658,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":327586,"num_read_kb":1266124,"num_write":317592,"num_write_kb":1269897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"170'311843","reported_seq":613954,"reported_epoch":170,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:31:47.554158+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:31:47.554158+0000","last_peered":"2023-10-14T01:31:47.554158+0000","last_clean":"2023-10-14T01:31:47.554158+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:31:47.554158+0000","last_undegraded":"2023-10-14T01:31:47.554158+0000","last_fullsized":"2023-10-14T01:31:47.554158+0000","mapping_epoch":13,"log_start":"167'301827","ondisk_log_start":"167'301827","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1635,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 442s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3659387584,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":303724,"num_read_kb":1185943,"num_write":299040,"num_write_kb":1195850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"170'309883","reported_seq":613160,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:47.586216+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:31:47.586216+0000","last_peered":"2023-10-14T01:31:47.586216+0000","last_clean":"2023-10-14T01:31:47.586216+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:31:47.586216+0000","last_undegraded":"2023-10-14T01:31:47.586216+0000","last_fullsized":"2023-10-14T01:31:47.586216+0000","mapping_epoch":13,"log_start":"166'299822","ondisk_log_start":"166'299822","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3677311658,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":304738,"num_read_kb":1193348,"num_write":301475,"num_write_kb":1205649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"170'313608","reported_seq":625321,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:45.021362+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:31:45.021362+0000","last_peered":"2023-10-14T01:31:45.021362+0000","last_clean":"2023-10-14T01:31:45.021362+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:31:45.021362+0000","last_undegraded":"2023-10-14T01:31:45.021362+0000","last_fullsized":"2023-10-14T01:31:45.021362+0000","mapping_epoch":13,"log_start":"166'303523","ondisk_log_start":"166'303523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3750117897,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":313419,"num_read_kb":1215306,"num_write":307090,"num_write_kb":1227881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"170'315620","reported_seq":625845,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:45.921015+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:31:45.921015+0000","last_peered":"2023-10-14T01:31:45.921015+0000","last_clean":"2023-10-14T01:31:45.921015+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:31:45.921015+0000","last_undegraded":"2023-10-14T01:31:45.921015+0000","last_fullsized":"2023-10-14T01:31:45.921015+0000","mapping_epoch":13,"log_start":"167'305612","ondisk_log_start":"167'305612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3794403646,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":311641,"num_read_kb":1223518,"num_write":310076,"num_write_kb":1240143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"170'317674","reported_seq":630741,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:45.947114+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:31:45.947114+0000","last_peered":"2023-10-14T01:31:45.947114+0000","last_clean":"2023-10-14T01:31:45.947114+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:31:45.947114+0000","last_undegraded":"2023-10-14T01:31:45.947114+0000","last_fullsized":"2023-10-14T01:31:45.947114+0000","mapping_epoch":13,"log_start":"167'307616","ondisk_log_start":"167'307616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3830166055,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":314282,"num_read_kb":1235344,"num_write":312084,"num_write_kb":1248199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"170'360731","reported_seq":697649,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:31:47.581117+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:31:47.581117+0000","last_peered":"2023-10-14T01:31:47.581117+0000","last_clean":"2023-10-14T01:31:47.581117+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:31:47.581117+0000","last_undegraded":"2023-10-14T01:31:47.581117+0000","last_fullsized":"2023-10-14T01:31:47.581117+0000","mapping_epoch":13,"log_start":"167'350716","ondisk_log_start":"167'350716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3991491049,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":338670,"num_read_kb":1303490,"num_write":328367,"num_write_kb":1312813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":354,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T01:30:45.444214+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:30:45.444214+0000","last_peered":"2023-10-14T01:30:45.444214+0000","last_clean":"2023-10-14T01:30:45.444214+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:30:45.444214+0000","last_undegraded":"2023-10-14T01:30:45.444214+0000","last_fullsized":"2023-10-14T01:30:45.444214+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30285979571,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2520803,"num_read_kb":9816961,"num_write":2475846,"num_write_kb":9900573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20275228672,"data_stored":32847720294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80299,"ondisk_log_size":80299,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739466,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5847852,"kb_used_data":3802084,"kb_used_omap":726,"kb_used_meta":2045033,"kb_avail":88523988,"statfs":{"total":96636764160,"available":90648563712,"internally_reserved":0,"allocated":3893334016,"data_stored":6283197343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":2094114684},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,4,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.71999999999999997,"15min":0.81000000000000005},"min":{"1min":0.19600000000000001,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":0.74199999999999999,"5min":8.0719999999999992,"15min":10.981999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.77900000000000003,"15min":0.86299999999999999},"min":{"1min":0.28599999999999998,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.80800000000000005,"5min":8.0999999999999996,"15min":11.039},"last":0.442}]},{"osd":1,"last update":"Sat Oct 14 01:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.002,"15min":0.80800000000000005},"min":{"1min":0.20200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.4400000000000004,"5min":11.846,"15min":11.846},"last":4.6749999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.70699999999999996,"15min":0.73999999999999999},"min":{"1min":0.253,"5min":0.222,"15min":0.222},"max":{"1min":1.8680000000000001,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":4.0609999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739447,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10976968,"kb_used_data":9902456,"kb_used_omap":1152,"kb_used_meta":1073343,"kb_avail":83394872,"statfs":{"total":96636764160,"available":85396348928,"internally_reserved":0,"allocated":10140114944,"data_stored":16426006564,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1179902,"internal_metadata":1099104002},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,2,2,3,6,4,10,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:30:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.70799999999999996,"15min":0.81299999999999994},"min":{"1min":0.221,"5min":0.221,"15min":0.183},"max":{"1min":3.149,"5min":5.5940000000000003,"15min":9.8879999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.63700000000000001,"15min":0.68300000000000005},"min":{"1min":0.224,"5min":0.185,"15min":0.185},"max":{"1min":1.6160000000000001,"5min":5.3689999999999998,"15min":10.029999999999999},"last":3.8090000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:30:55 2023","interfaces":[{"interface":"back","average":{"1min":2.1520000000000001,"5min":1.544,"15min":1.8520000000000001},"min":{"1min":0.223,"5min":0.20200000000000001,"15min":0.19900000000000001},"max":{"1min":14.208,"5min":14.208,"15min":17.547999999999998},"last":3.7850000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.94499999999999995,"15min":0.84799999999999998},"min":{"1min":0.23799999999999999,"5min":0.23300000000000001,"15min":0.21199999999999999},"max":{"1min":4.6269999999999998,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.27200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739466,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7225524,"kb_used_data":6098412,"kb_used_omap":1142,"kb_used_meta":1125961,"kb_avail":87146316,"statfs":{"total":96636764160,"available":89237827584,"internally_reserved":0,"allocated":6244773888,"data_stored":10139914966,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":1152984488},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,2,2,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:31:04 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.111,"15min":0.94399999999999995},"min":{"1min":0.247,"5min":0.186,"15min":0.158},"max":{"1min":6.2149999999999999,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.24199999999999999,"5min":0.24099999999999999,"15min":0.20999999999999999},"max":{"1min":4.008,"5min":8.3569999999999993,"15min":8.3569999999999993},"last":0.41599999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.875,"15min":0.80800000000000005},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":3.7559999999999998,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.1850000000000001,"15min":1.1020000000000001},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.187},"max":{"1min":1.986,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":0.61899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6243700736,"data_stored":10139196005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10139475968,"data_stored":16425721779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3892051968,"data_stored":6282802510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:31:50.505 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:31:50.506 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:31:50.506 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:31:51.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:51.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:51.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:51.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:51.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:51.535+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:51.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:51.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:51.597 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:51.595+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:51.598 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:51.595+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:51.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:51.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:51.626 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:51.623+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:51.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:51.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:51.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:51.623+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:53.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:53.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:53.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:53.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:53.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:53.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:53.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:53.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:54.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:53.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:54.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:54.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:54.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:54.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:54.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:54.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:54.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:54.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:54.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:54.079+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:54.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:54.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:54.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:54.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:54.756 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:31:54.755+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:31:56.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:56.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:56.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:56.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:56.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:56.443+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:56.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:56.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:56.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:56.467+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:56.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:56.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:56.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:56.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:56.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:56.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:56.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:56.507+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:56.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:56.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:56.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:56.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:31:59.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.703+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:31:59.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:31:59.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:31:59.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:31:59.772 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.751+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:31:59.773 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:31:59.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.779+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:31:59.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.799+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:31:59.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:31:59.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:31:59.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.811+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:31:59.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:31:59.816 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:31:59.811+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:01.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:01.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:01.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:01.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:01.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:01.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:01.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:01.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:01.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:01.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:01.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:01.943+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:01.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:01.975+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:01.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:01.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:01.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:01.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:03.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:03.607+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:03.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:03.611+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:03.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:03.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:03.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:03.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:03.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:03.631+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:03.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:03.635+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:03.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:03.635+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:03.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:03.635+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:04.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.519+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:04.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:04.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.527+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:04.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:04.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:04.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.591+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:04.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.603+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:04.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.607+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:04.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.611+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:04.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.611+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:04.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.611+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:04.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:32:04.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:04.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:04.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:04.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:04.689 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.683+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:04.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.719+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:04.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.719+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:04.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.755+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:04.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.783+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:04.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:32:04.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.803+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:32:04.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:32:04.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:04.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:04.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:04.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:04.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:04.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.895+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:04.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:04.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:04.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.907+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:04.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.923+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:04.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:04.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:04.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:06.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:06.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:06.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:06.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:06.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:06.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.347+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:06.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.371+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:06.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:06.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.419+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:06.421 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:32:06.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:32:06.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:06.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:06.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.427+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:06.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:06.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:06.491 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.487+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:06.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.499+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:06.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.499+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:06.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.499+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:06.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.499+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:06.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:06.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:06.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:06.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:06.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:06.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:06.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.955+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:06.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:06.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:07.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:07.023+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:07.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:07.023+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:07.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:07.023+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:07.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:07.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:32:07.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:07.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:08.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:08.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:08.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:08.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:08.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:08.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:08.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:08.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:08.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:08.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:08.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:08.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:08.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:08.111+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:08.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:08.119+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:08.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:08.167+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:08.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:08.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:08.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:08.167+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:08.631 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:32:08.631+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:32:10.507 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:32:10.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:10.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:10.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:10.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:10.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:10.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:10.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:10.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:10.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:10.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:10.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:10.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:10.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:10.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:10.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:10.959+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:10.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:10.987+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:10.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:10.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:10.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:10.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:11.436 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:32:11.437 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:32:11.482 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2930,"stamp":"2023-10-14T01:32:09.842820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30319342035,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2529099,"num_read_kb":9849724,"num_write":2484403,"num_write_kb":9936147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80458,"ondisk_log_size":80458,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24351616,"kb_used_data":19869028,"kb_used_omap":3020,"kb_used_meta":4479539,"kb_avail":258763904,"statfs":{"total":289910292480,"available":264974237696,"internally_reserved":0,"allocated":20345884672,"data_stored":32916780697,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3093466,"internal_metadata":4587047974},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,5,9,15,16,16,5,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":21905408,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5490,"num_read_kb":21908,"num_write":5622,"num_write_kb":22488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002543"},"pg_stats":[{"pgid":"2.7","version":"170'319331","reported_seq":625595,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:32:08.344036+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:32:08.344036+0000","last_peered":"2023-10-14T01:32:08.344036+0000","last_clean":"2023-10-14T01:32:08.344036+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:32:08.344036+0000","last_undegraded":"2023-10-14T01:32:08.344036+0000","last_fullsized":"2023-10-14T01:32:08.344036+0000","mapping_epoch":13,"log_start":"167'309317","ondisk_log_start":"167'309317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3689751064,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":307791,"num_read_kb":1198072,"num_write":301151,"num_write_kb":1204257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"170'336165","reported_seq":661711,"reported_epoch":170,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:32:08.327972+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:32:08.327972+0000","last_peered":"2023-10-14T01:32:08.327972+0000","last_clean":"2023-10-14T01:32:08.327972+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:32:08.327972+0000","last_undegraded":"2023-10-14T01:32:08.327972+0000","last_fullsized":"2023-10-14T01:32:08.327972+0000","mapping_epoch":13,"log_start":"167'326118","ondisk_log_start":"167'326118","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1377,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 473s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3901829338,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":328658,"num_read_kb":1270404,"num_write":318725,"num_write_kb":1274429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"170'312949","reported_seq":616084,"reported_epoch":170,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:32:08.298633+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:32:08.298633+0000","last_peered":"2023-10-14T01:32:08.298633+0000","last_clean":"2023-10-14T01:32:08.298633+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:32:08.298633+0000","last_undegraded":"2023-10-14T01:32:08.298633+0000","last_fullsized":"2023-10-14T01:32:08.298633+0000","mapping_epoch":13,"log_start":"167'302927","ondisk_log_start":"167'302927","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1682,"log_size":10022,"log_dups_size":0,"ondisk_log_size":10022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 462s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3663393472,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":304732,"num_read_kb":1189963,"num_write":300077,"num_write_kb":1199998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"170'310917","reported_seq":615203,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:32:08.283378+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:32:08.283378+0000","last_peered":"2023-10-14T01:32:08.283378+0000","last_clean":"2023-10-14T01:32:08.283378+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:32:08.283378+0000","last_undegraded":"2023-10-14T01:32:08.283378+0000","last_fullsized":"2023-10-14T01:32:08.283378+0000","mapping_epoch":13,"log_start":"167'300822","ondisk_log_start":"167'300822","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3681202858,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":305736,"num_read_kb":1197336,"num_write":302491,"num_write_kb":1209713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"170'314598","reported_seq":627331,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:32:05.120789+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:32:05.120789+0000","last_peered":"2023-10-14T01:32:05.120789+0000","last_clean":"2023-10-14T01:32:05.120789+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:32:05.120789+0000","last_undegraded":"2023-10-14T01:32:05.120789+0000","last_fullsized":"2023-10-14T01:32:05.120789+0000","mapping_epoch":13,"log_start":"167'304523","ondisk_log_start":"167'304523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3753910793,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":314429,"num_read_kb":1219342,"num_write":308077,"num_write_kb":1231829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"170'316644","reported_seq":627889,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:32:06.025829+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:32:06.025829+0000","last_peered":"2023-10-14T01:32:06.025829+0000","last_clean":"2023-10-14T01:32:06.025829+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:32:06.025829+0000","last_undegraded":"2023-10-14T01:32:06.025829+0000","last_fullsized":"2023-10-14T01:32:06.025829+0000","mapping_epoch":13,"log_start":"167'306612","ondisk_log_start":"167'306612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3798421822,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":312657,"num_read_kb":1227554,"num_write":311096,"num_write_kb":1244223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"170'318757","reported_seq":632793,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:32:06.034829+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:32:06.034829+0000","last_peered":"2023-10-14T01:32:06.034829+0000","last_clean":"2023-10-14T01:32:06.034829+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:32:06.034829+0000","last_undegraded":"2023-10-14T01:32:06.034829+0000","last_fullsized":"2023-10-14T01:32:06.034829+0000","mapping_epoch":13,"log_start":"167'308716","ondisk_log_start":"167'308716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3834429991,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":315249,"num_read_kb":1239196,"num_write":313163,"num_write_kb":1252515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"170'361949","reported_seq":699961,"reported_epoch":170,"state":"active+clean","last_fresh":"2023-10-14T01:32:08.293343+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:32:08.293343+0000","last_peered":"2023-10-14T01:32:08.293343+0000","last_clean":"2023-10-14T01:32:08.293343+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:32:08.293343+0000","last_undegraded":"2023-10-14T01:32:08.293343+0000","last_fullsized":"2023-10-14T01:32:08.293343+0000","mapping_epoch":13,"log_start":"167'351916","ondisk_log_start":"167'351916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10033,"log_dups_size":0,"ondisk_log_size":10033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":3995812329,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":339741,"num_read_kb":1307766,"num_write":329486,"num_write_kb":1317289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":354,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-10-14T01:30:45.444214+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:30:45.444214+0000","last_peered":"2023-10-14T01:30:45.444214+0000","last_clean":"2023-10-14T01:30:45.444214+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:30:45.444214+0000","last_undegraded":"2023-10-14T01:30:45.444214+0000","last_fullsized":"2023-10-14T01:30:45.444214+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30318751667,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2528993,"num_read_kb":9849633,"num_write":2484266,"num_write_kb":9934253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20343808000,"data_stored":32916299622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80359,"ondisk_log_size":80359,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739471,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5892440,"kb_used_data":3814732,"kb_used_omap":726,"kb_used_meta":2076969,"kb_avail":88479400,"statfs":{"total":96636764160,"available":90602905600,"internally_reserved":0,"allocated":3906285568,"data_stored":6296148895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":2126817148},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,3,4,6,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.71999999999999997,"15min":0.81000000000000005},"min":{"1min":0.19600000000000001,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":0.74199999999999999,"5min":8.0719999999999992,"15min":10.981999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.77900000000000003,"15min":0.86299999999999999},"min":{"1min":0.28599999999999998,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":0.80800000000000005,"5min":8.0999999999999996,"15min":11.039},"last":0.48699999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.002,"15min":0.80800000000000005},"min":{"1min":0.20200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.4400000000000004,"5min":11.846,"15min":11.846},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.70699999999999996,"15min":0.73999999999999999},"min":{"1min":0.253,"5min":0.222,"15min":0.222},"max":{"1min":1.8680000000000001,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":0.51400000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739451,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11200132,"kb_used_data":9935932,"kb_used_omap":1152,"kb_used_meta":1263039,"kb_avail":83171708,"statfs":{"total":96636764160,"available":85167828992,"internally_reserved":0,"allocated":10174394368,"data_stored":16460285988,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1179902,"internal_metadata":1293352706},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3,10,9,6,4,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69499999999999995,"15min":0.82199999999999995},"min":{"1min":0.215,"5min":0.215,"15min":0.183},"max":{"1min":3.758,"5min":5.3040000000000003,"15min":9.8879999999999999},"last":0.751},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.23400000000000001,"5min":0.185,"15min":0.185},"max":{"1min":3.8090000000000002,"5min":5.3689999999999998,"15min":10.029999999999999},"last":0.504}]},{"osd":2,"last update":"Sat Oct 14 01:31:55 2023","interfaces":[{"interface":"back","average":{"1min":1.806,"5min":1.679,"15min":1.8560000000000001},"min":{"1min":0.22600000000000001,"5min":0.20200000000000001,"15min":0.19900000000000001},"max":{"1min":8.577,"5min":14.208,"15min":17.547999999999998},"last":6.2329999999999997},{"interface":"front","average":{"1min":0.373,"5min":0.94399999999999995,"15min":0.83999999999999997},"min":{"1min":0.24399999999999999,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":0.57999999999999996,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.317}]}]},{"osd":0,"up_from":8,"seq":34359739470,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7259044,"kb_used_data":6118364,"kb_used_omap":1142,"kb_used_meta":1139529,"kb_avail":87112796,"statfs":{"total":96636764160,"available":89203503104,"internally_reserved":0,"allocated":6265204736,"data_stored":10160345814,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":1166878120},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,2,3,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:31:04 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.111,"15min":0.94399999999999995},"min":{"1min":0.247,"5min":0.186,"15min":0.158},"max":{"1min":6.2149999999999999,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":5.4749999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.24199999999999999,"5min":0.24099999999999999,"15min":0.20999999999999999},"max":{"1min":4.008,"5min":8.3569999999999993,"15min":8.3569999999999993},"last":5.0599999999999996}]},{"osd":2,"last update":"Sat Oct 14 01:31:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.875,"15min":0.80800000000000005},"min":{"1min":0.24399999999999999,"5min":0.222,"15min":0.21199999999999999},"max":{"1min":3.7559999999999998,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":1.1850000000000001,"15min":1.1020000000000001},"min":{"1min":0.252,"5min":0.20899999999999999,"15min":0.187},"max":{"1min":1.986,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":5.085}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6264401920,"data_stored":10159897189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10174275584,"data_stored":16460521395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3905130496,"data_stored":6295881038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:32:11.483 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:32:11.484 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:32:11.484 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:32:11.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:32:11.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:11.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:11.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.855+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:11.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.875+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:11.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:11.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:11.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:11.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.903+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:11.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:11.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.931+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:11.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:11.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:11.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:12.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:12.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:12.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:12.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:12.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:12.523+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:12.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:12.531+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:12.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:12.535+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:12.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:12.543+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:12.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:12.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:12.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:12.543+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:12.626 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:32:12.623+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:32:12.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:12.915+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:12.942 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:12.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:12.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:12.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:12.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:12.971+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:13.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:13.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:13.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:13.081 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:13.110 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.103+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:13.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.123+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:13.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:13.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:13.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.127+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:32:13.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:32:13.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:13.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:13.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:13.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:13.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:13.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:13.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:13.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:13.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:13.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.239+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:13.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:13.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:13.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:14.005 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:32:14.003+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:32:15.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:32:15.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:15.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:15.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:15.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:15.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:15.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.283+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:15.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.283+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:15.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.299+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:15.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:15.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:15.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:32:15.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:32:15.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:15.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:15.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:15.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:15.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.319+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:15.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:15.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.327+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:15.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:15.327+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:19.065 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:32:19.063+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:32:19.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:19.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:19.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:19.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:19.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:19.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:19.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:19.655+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:19.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:19.667+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:19.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:19.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:19.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:19.667+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:19.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:19.671+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:19.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:19.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:19.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:19.671+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:20.962 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:32:20.959+0000 7f30478aa640 -1 reset not still connected to 0x55c893dcb5f0 2023-10-14T01:32:20.962 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:32:20.959+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:32:21.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:21.359+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:32:21.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:21.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:21.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:21.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:21.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:21.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:21.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:21.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:21.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:21.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:21.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:21.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:21.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:21.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:21.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:21.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:21.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:21.447+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:21.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:21.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:21.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:21.447+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:29.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:29.691+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:29.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:29.691+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:29.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:29.699+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:29.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:29.703+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:29.705 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:29.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:29.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:29.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:29.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:29.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:30.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:30.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:30.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:30.015+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:30.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:30.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:30.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:30.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:30.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:30.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:30.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:30.051+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:30.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:30.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:30.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:30.051+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:31.485 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:32:31.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:31.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:32.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:32.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:32.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:32.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:32.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:32.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:32.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:32.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:32.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:32.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:32.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:32.023+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:32.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:32.043+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:32.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:32.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:32.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:32.043+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:32.166 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:32:32.167 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:32:32.220 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2942,"stamp":"2023-10-14T01:32:31.846645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30355296723,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2537964,"num_read_kb":9885076,"num_write":2493601,"num_write_kb":9972939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80519,"ondisk_log_size":80519,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":23827772,"kb_used_data":19945572,"kb_used_omap":3020,"kb_used_meta":3879155,"kb_avail":259287748,"statfs":{"total":289910292480,"available":265510653952,"internally_reserved":0,"allocated":20424265728,"data_stored":32995147476,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3093466,"internal_metadata":3972254758},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,5,6,14,12,7,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19795968,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4829,"num_read_kb":19248,"num_write":5057,"num_write_kb":20228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001923"},"pg_stats":[{"pgid":"2.7","version":"171'320374","reported_seq":627653,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:29.077444+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:32:29.077444+0000","last_peered":"2023-10-14T01:32:29.077444+0000","last_clean":"2023-10-14T01:32:29.077444+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:32:29.077444+0000","last_undegraded":"2023-10-14T01:32:29.077444+0000","last_fullsized":"2023-10-14T01:32:29.077444+0000","mapping_epoch":13,"log_start":"167'310317","ondisk_log_start":"167'310317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10057,"log_dups_size":0,"ondisk_log_size":10057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3693769240,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":308792,"num_read_kb":1202064,"num_write":302167,"num_write_kb":1208321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"171'337331","reported_seq":663963,"reported_epoch":171,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:32:29.065368+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:32:29.065368+0000","last_peered":"2023-10-14T01:32:29.065368+0000","last_clean":"2023-10-14T01:32:29.065368+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:32:29.065368+0000","last_undegraded":"2023-10-14T01:32:29.065368+0000","last_fullsized":"2023-10-14T01:32:29.065368+0000","mapping_epoch":13,"log_start":"167'327318","ondisk_log_start":"167'327318","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1416,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 494s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3906220250,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":329723,"num_read_kb":1274648,"num_write":319836,"num_write_kb":1278873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"171'314015","reported_seq":618137,"reported_epoch":171,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:32:29.067279+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:32:29.067279+0000","last_peered":"2023-10-14T01:32:29.067279+0000","last_clean":"2023-10-14T01:32:29.067279+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:32:29.067279+0000","last_undegraded":"2023-10-14T01:32:29.067279+0000","last_fullsized":"2023-10-14T01:32:29.067279+0000","mapping_epoch":13,"log_start":"167'303927","ondisk_log_start":"167'303927","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1771,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 483s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3667219136,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":305696,"num_read_kb":1193811,"num_write":301063,"num_write_kb":1203942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"171'311961","reported_seq":617258,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:29.053153+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:32:29.053153+0000","last_peered":"2023-10-14T01:32:29.053153+0000","last_clean":"2023-10-14T01:32:29.053153+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:32:29.053153+0000","last_undegraded":"2023-10-14T01:32:29.053153+0000","last_fullsized":"2023-10-14T01:32:29.053153+0000","mapping_epoch":13,"log_start":"167'301922","ondisk_log_start":"167'301922","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3685225130,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":306739,"num_read_kb":1201348,"num_write":303526,"num_write_kb":1213853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"171'315916","reported_seq":629898,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:30.412618+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:32:30.412618+0000","last_peered":"2023-10-14T01:32:30.412618+0000","last_clean":"2023-10-14T01:32:30.412618+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:32:30.412618+0000","last_undegraded":"2023-10-14T01:32:30.412618+0000","last_fullsized":"2023-10-14T01:32:30.412618+0000","mapping_epoch":13,"log_start":"167'305823","ondisk_log_start":"167'305823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3758993929,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":315668,"num_read_kb":1224274,"num_write":309377,"num_write_kb":1237029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"171'317958","reported_seq":630499,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:31.185162+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:32:31.185162+0000","last_peered":"2023-10-14T01:32:31.185162+0000","last_clean":"2023-10-14T01:32:31.185162+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:32:31.185162+0000","last_undegraded":"2023-10-14T01:32:31.185162+0000","last_fullsized":"2023-10-14T01:32:31.185162+0000","mapping_epoch":13,"log_start":"167'307912","ondisk_log_start":"167'307912","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3803517246,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":313949,"num_read_kb":1232702,"num_write":312400,"num_write_kb":1249439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"171'320054","reported_seq":635343,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:31.186030+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:32:31.186030+0000","last_peered":"2023-10-14T01:32:31.186030+0000","last_clean":"2023-10-14T01:32:31.186030+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:32:31.186030+0000","last_undegraded":"2023-10-14T01:32:31.186030+0000","last_fullsized":"2023-10-14T01:32:31.186030+0000","mapping_epoch":13,"log_start":"167'310016","ondisk_log_start":"167'310016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3839504935,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":316496,"num_read_kb":1244164,"num_write":314450,"num_write_kb":1257663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"171'363162","reported_seq":702255,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:29.034510+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:32:29.034510+0000","last_peered":"2023-10-14T01:32:29.034510+0000","last_clean":"2023-10-14T01:32:29.034510+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:32:29.034510+0000","last_undegraded":"2023-10-14T01:32:29.034510+0000","last_fullsized":"2023-10-14T01:32:29.034510+0000","mapping_epoch":13,"log_start":"167'353116","ondisk_log_start":"167'353116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10046,"log_dups_size":0,"ondisk_log_size":10046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4000256489,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":340795,"num_read_kb":1311974,"num_write":330645,"num_write_kb":1321925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":356,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:15.500537+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:32:15.500537+0000","last_peered":"2023-10-14T01:32:15.500537+0000","last_clean":"2023-10-14T01:32:15.500537+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:32:15.500537+0000","last_undegraded":"2023-10-14T01:32:15.500537+0000","last_fullsized":"2023-10-14T01:32:15.500537+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30354706355,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2537858,"num_read_kb":9884985,"num_write":2493464,"num_write_kb":9971045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20420952064,"data_stored":32993443686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80420,"ondisk_log_size":80420,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739476,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024476,"kb_used_data":3830676,"kb_used_omap":726,"kb_used_meta":1193065,"kb_avail":89347364,"statfs":{"total":96636764160,"available":91491700736,"internally_reserved":0,"allocated":3922612224,"data_stored":6312470792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1221699452},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,4,5],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:32:12 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.60199999999999998,"15min":0.73999999999999999},"min":{"1min":0.21099999999999999,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":2.4449999999999998,"5min":8.0719999999999992,"15min":10.981999999999999},"last":6.9279999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.66600000000000004,"15min":0.79400000000000004},"min":{"1min":0.27400000000000002,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":2.48,"5min":8.0999999999999996,"15min":11.039},"last":6.9669999999999996}]},{"osd":1,"last update":"Sat Oct 14 01:32:12 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.96699999999999997,"15min":0.81299999999999994},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":6.0960000000000001,"5min":11.846,"15min":11.846},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67100000000000004,"15min":0.71299999999999997},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":4.0609999999999999,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":0.39100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739455,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11419000,"kb_used_data":9971248,"kb_used_omap":1152,"kb_used_meta":1446591,"kb_avail":82952840,"statfs":{"total":96636764160,"available":84943708160,"internally_reserved":0,"allocated":10210557952,"data_stored":16496444813,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1179902,"internal_metadata":1481309954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,5,3,10,7,7,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69499999999999995,"15min":0.82199999999999995},"min":{"1min":0.215,"5min":0.215,"15min":0.183},"max":{"1min":3.758,"5min":5.3040000000000003,"15min":9.8879999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.23400000000000001,"5min":0.185,"15min":0.185},"max":{"1min":3.8090000000000002,"5min":5.3689999999999998,"15min":10.029999999999999},"last":0.42099999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:31:55 2023","interfaces":[{"interface":"back","average":{"1min":1.806,"5min":1.679,"15min":1.8560000000000001},"min":{"1min":0.22600000000000001,"5min":0.20200000000000001,"15min":0.19900000000000001},"max":{"1min":8.577,"5min":14.208,"15min":17.547999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.373,"5min":0.94399999999999995,"15min":0.83999999999999997},"min":{"1min":0.24399999999999999,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":0.57999999999999996,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.29599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739475,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7384296,"kb_used_data":6143648,"kb_used_omap":1142,"kb_used_meta":1239497,"kb_avail":86987544,"statfs":{"total":96636764160,"available":89075245056,"internally_reserved":0,"allocated":6291095552,"data_stored":10186231871,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":1269245352},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:32:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.1679999999999999,"15min":0.97899999999999998},"min":{"1min":0.246,"5min":0.186,"15min":0.158},"max":{"1min":5.4749999999999996,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":0.97399999999999998},"min":{"1min":0.252,"5min":0.24099999999999999,"15min":0.20999999999999999},"max":{"1min":5.0599999999999996,"5min":8.3569999999999993,"15min":8.3569999999999993},"last":0.56499999999999995}]},{"osd":2,"last update":"Sat Oct 14 01:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.79000000000000004,"15min":0.81699999999999995},"min":{"1min":0.215,"5min":0.215,"15min":0.21199999999999999},"max":{"1min":1.089,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.2170000000000001,"15min":1.0980000000000001},"min":{"1min":0.27400000000000002,"5min":0.23100000000000001,"15min":0.187},"max":{"1min":5.085,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":0.92000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6290452480,"data_stored":10185947749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10209075200,"data_stored":16495321011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3921424384,"data_stored":6312174926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:32:32.221 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:32:32.222 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:32:32.222 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:32:33.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:33.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:33.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:33.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:33.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:33.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:33.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:33.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:35.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:35.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:35.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:35.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:35.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:35.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:35.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.631+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:35.635 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.631+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:35.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.659+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:35.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.695+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:35.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:35.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.703+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:35.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:32:35.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:32:35.746 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.739+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:35.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:35.774 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:35.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:35.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.791+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:35.808 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:35.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:35.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.819+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:35.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.823+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:35.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.863+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:35.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:35.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:35.863+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:36.113 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:32:36.111+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:32:37.355 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:32:37.355+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:32:38.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:38.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:38.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:38.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:38.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:38.967+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:38.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:38.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:38.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:38.991+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:39.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:39.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.079+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:39.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:39.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:39.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.135+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:32:39.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:32:39.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:39.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:39.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.171+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:39.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:39.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.203+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:39.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.231+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:39.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.235+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:39.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:39.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.235+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:39.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.247+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:39.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:39.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:39.247+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:42.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:42.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:42.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:42.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:42.937 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:42.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:42.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:42.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:42.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:42.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:42.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:42.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:42.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:42.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:42.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:42.987+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:43.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:42.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:43.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:43.027+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:43.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:43.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:43.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:43.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:45.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:45.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:45.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:45.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:45.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:45.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:45.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:45.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:45.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:45.103+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:45.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:45.107+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:45.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:45.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:45.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:45.123+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:45.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:45.159+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:45.177 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:45.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:45.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:45.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:46.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:46.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:32:46.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:46.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:46.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:46.935+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:46.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:46.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:46.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:46.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:46.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:46.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:46.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:46.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:46.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:46.991+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:47.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:47.007+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:47.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:47.019+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:47.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:47.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:47.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:47.019+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:51.009 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:32:51.007+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:32:51.401 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:32:51.399+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:32:52.224 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:32:52.601 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:32:52.599+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:32:53.109 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:32:53.110 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:32:53.158 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2952,"stamp":"2023-10-14T01:32:51.850118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30388498899,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2546130,"num_read_kb":9917636,"num_write":2502100,"num_write_kb":10006935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80492,"ondisk_log_size":80492,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24229948,"kb_used_data":20013604,"kb_used_omap":3020,"kb_used_meta":4213299,"kb_avail":258885572,"statfs":{"total":289910292480,"available":265098825728,"internally_reserved":0,"allocated":20493930496,"data_stored":33064812244,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3093466,"internal_metadata":4314418214},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,5,8,6,12,18,22],"upper_bound":256},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19996672,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4881,"num_read_kb":19468,"num_write":5125,"num_write_kb":20500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002126"},"pg_stats":[{"pgid":"2.7","version":"171'321399","reported_seq":629678,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:49.726523+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:32:49.726523+0000","last_peered":"2023-10-14T01:32:49.726523+0000","last_clean":"2023-10-14T01:32:49.726523+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:32:49.726523+0000","last_undegraded":"2023-10-14T01:32:49.726523+0000","last_fullsized":"2023-10-14T01:32:49.726523+0000","mapping_epoch":13,"log_start":"167'311317","ondisk_log_start":"167'311317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3697639960,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":309777,"num_read_kb":1205996,"num_write":303159,"num_write_kb":1212289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"171'338465","reported_seq":666234,"reported_epoch":171,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:32:49.696465+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:32:49.696465+0000","last_peered":"2023-10-14T01:32:49.696465+0000","last_clean":"2023-10-14T01:32:49.696465+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:32:49.696465+0000","last_undegraded":"2023-10-14T01:32:49.696465+0000","last_fullsized":"2023-10-14T01:32:49.696465+0000","mapping_epoch":13,"log_start":"168'328418","ondisk_log_start":"168'328418","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1479,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 515s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3910435034,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":330840,"num_read_kb":1279108,"num_write":320888,"num_write_kb":1283081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"171'315157","reported_seq":620268,"reported_epoch":171,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:32:49.722986+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:32:49.722986+0000","last_peered":"2023-10-14T01:32:49.722986+0000","last_clean":"2023-10-14T01:32:49.722986+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:32:49.722986+0000","last_undegraded":"2023-10-14T01:32:49.722986+0000","last_fullsized":"2023-10-14T01:32:49.722986+0000","mapping_epoch":13,"log_start":"168'305127","ondisk_log_start":"168'305127","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1822,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 504s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3671421632,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":306675,"num_read_kb":1197711,"num_write":302145,"num_write_kb":1208270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"171'313040","reported_seq":619363,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:49.697020+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:32:49.697020+0000","last_peered":"2023-10-14T01:32:49.697020+0000","last_clean":"2023-10-14T01:32:49.697020+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:32:49.697020+0000","last_undegraded":"2023-10-14T01:32:49.697020+0000","last_fullsized":"2023-10-14T01:32:49.697020+0000","mapping_epoch":13,"log_start":"167'303022","ondisk_log_start":"167'303022","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3689312938,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":307761,"num_read_kb":1205424,"num_write":304594,"num_write_kb":1218125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"171'317004","reported_seq":631964,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:50.642939+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:32:50.642939+0000","last_peered":"2023-10-14T01:32:50.642939+0000","last_clean":"2023-10-14T01:32:50.642939+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:32:50.642939+0000","last_undegraded":"2023-10-14T01:32:50.642939+0000","last_fullsized":"2023-10-14T01:32:50.642939+0000","mapping_epoch":13,"log_start":"167'306923","ondisk_log_start":"167'306923","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3763196425,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":316629,"num_read_kb":1228098,"num_write":310459,"num_write_kb":1241357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"171'319028","reported_seq":632514,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:51.377609+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:32:51.377609+0000","last_peered":"2023-10-14T01:32:51.377609+0000","last_clean":"2023-10-14T01:32:51.377609+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:32:51.377609+0000","last_undegraded":"2023-10-14T01:32:51.377609+0000","last_fullsized":"2023-10-14T01:32:51.377609+0000","mapping_epoch":13,"log_start":"167'309012","ondisk_log_start":"167'309012","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3807748414,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":314894,"num_read_kb":1236474,"num_write":313462,"num_write_kb":1253687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"171'321070","reported_seq":637401,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:51.373307+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:32:51.373307+0000","last_peered":"2023-10-14T01:32:51.373307+0000","last_clean":"2023-10-14T01:32:51.373307+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:32:51.373307+0000","last_undegraded":"2023-10-14T01:32:51.373307+0000","last_fullsized":"2023-10-14T01:32:51.373307+0000","mapping_epoch":13,"log_start":"167'311016","ondisk_log_start":"167'311016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10054,"log_dups_size":0,"ondisk_log_size":10054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3843486247,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":317531,"num_read_kb":1248288,"num_write":315458,"num_write_kb":1261695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"171'364381","reported_seq":704620,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:49.668852+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:32:49.668852+0000","last_peered":"2023-10-14T01:32:49.668852+0000","last_clean":"2023-10-14T01:32:49.668852+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:32:49.668852+0000","last_undegraded":"2023-10-14T01:32:49.668852+0000","last_fullsized":"2023-10-14T01:32:49.668852+0000","mapping_epoch":13,"log_start":"168'354316","ondisk_log_start":"168'354316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4004667881,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":341917,"num_read_kb":1316446,"num_write":331798,"num_write_kb":1326537,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":356,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:15.500537+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:32:15.500537+0000","last_peered":"2023-10-14T01:32:15.500537+0000","last_clean":"2023-10-14T01:32:15.500537+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:32:15.500537+0000","last_undegraded":"2023-10-14T01:32:15.500537+0000","last_fullsized":"2023-10-14T01:32:15.500537+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30387908531,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2546024,"num_read_kb":9917545,"num_write":2501963,"num_write_kb":10005041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20490395648,"data_stored":33062887270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80393,"ondisk_log_size":80393,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739480,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5097396,"kb_used_data":3843244,"kb_used_omap":726,"kb_used_meta":1253417,"kb_avail":89274444,"statfs":{"total":96636764160,"available":91417030656,"internally_reserved":0,"allocated":3935481856,"data_stored":6325340424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1283499900},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,2,1,3,5,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:32:12 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.60199999999999998,"15min":0.73999999999999999},"min":{"1min":0.21099999999999999,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":2.4449999999999998,"5min":8.0719999999999992,"15min":10.981999999999999},"last":4.8949999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.66600000000000004,"15min":0.79400000000000004},"min":{"1min":0.27400000000000002,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":2.48,"5min":8.0999999999999996,"15min":11.039},"last":4.9459999999999997}]},{"osd":1,"last update":"Sat Oct 14 01:32:12 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.96699999999999997,"15min":0.81299999999999994},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":6.0960000000000001,"5min":11.846,"15min":11.846},"last":5.1139999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67100000000000004,"15min":0.71299999999999997},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":4.0609999999999999,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":5.101}]}]},{"osd":1,"up_from":8,"seq":34359739459,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11623540,"kb_used_data":10005036,"kb_used_omap":1152,"kb_used_meta":1617343,"kb_avail":82748300,"statfs":{"total":96636764160,"available":84734259200,"internally_reserved":0,"allocated":10245156864,"data_stored":16531043725,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1179902,"internal_metadata":1656160002},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,4,2,5,9,19],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.69499999999999995,"15min":0.82199999999999995},"min":{"1min":0.215,"5min":0.215,"15min":0.183},"max":{"1min":3.758,"5min":5.3040000000000003,"15min":9.8879999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.69999999999999996,"15min":0.71399999999999997},"min":{"1min":0.23400000000000001,"5min":0.185,"15min":0.185},"max":{"1min":3.8090000000000002,"5min":5.3689999999999998,"15min":10.029999999999999},"last":0.33600000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:31:55 2023","interfaces":[{"interface":"back","average":{"1min":1.806,"5min":1.679,"15min":1.8560000000000001},"min":{"1min":0.22600000000000001,"5min":0.20200000000000001,"15min":0.19900000000000001},"max":{"1min":8.577,"5min":14.208,"15min":17.547999999999998},"last":1.272},{"interface":"front","average":{"1min":0.373,"5min":0.94399999999999995,"15min":0.83999999999999997},"min":{"1min":0.24399999999999999,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":0.57999999999999996,"5min":18.399999999999999,"15min":18.399999999999999},"last":0.53800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359739479,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7509012,"kb_used_data":6165324,"kb_used_omap":1142,"kb_used_meta":1342537,"kb_avail":86862828,"statfs":{"total":96636764160,"available":88947535872,"internally_reserved":0,"allocated":6313291776,"data_stored":10208428095,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":1374758312},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,1,2,6,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:32:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.1679999999999999,"15min":0.97899999999999998},"min":{"1min":0.246,"5min":0.186,"15min":0.158},"max":{"1min":5.4749999999999996,"5min":8.4009999999999998,"15min":8.4009999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.93400000000000005,"15min":0.97399999999999998},"min":{"1min":0.252,"5min":0.24099999999999999,"15min":0.20999999999999999},"max":{"1min":5.0599999999999996,"5min":8.3569999999999993,"15min":8.3569999999999993},"last":0.29799999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:32:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.79000000000000004,"15min":0.81699999999999995},"min":{"1min":0.215,"5min":0.215,"15min":0.21199999999999999},"max":{"1min":1.089,"5min":7.3499999999999996,"15min":7.3499999999999996},"last":0.377},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.2170000000000001,"15min":1.0980000000000001},"min":{"1min":0.27400000000000002,"5min":0.23100000000000001,"15min":0.187},"max":{"1min":5.085,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":0.36199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6311804928,"data_stored":10207300197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10244128768,"data_stored":16530374579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3934461952,"data_stored":6325212494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:32:53.159 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:32:53.160 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:32:53.160 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:32:53.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:53.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:53.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:53.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:53.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:53.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:53.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:53.463+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:53.483 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:53.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:53.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:53.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:53.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:53.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:53.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:53.495+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:53.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:53.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:53.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:53.495+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:54.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:32:54.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:32:54.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:54.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:54.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:54.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:54.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:54.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:54.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.418+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:54.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:54.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.434+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:54.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:54.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:54.434+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:32:55.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:55.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:32:55.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:55.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:32:55.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:55.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:32:55.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:55.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:32:55.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:55.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:32:55.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:55.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:32:55.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:55.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:32:55.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:55.874+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:32:55.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:55.882+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:32:55.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:55.882+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:32:55.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:32:55.882+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:00.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:00.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:00.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:00.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:00.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:00.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:00.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:00.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.146+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:00.151 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.146+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:00.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.154+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:00.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.170+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:00.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:00.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:00.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:01.509 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:01.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:33:01.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:01.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:01.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:01.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:01.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:01.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:01.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:01.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:01.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:01.634+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:01.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:01.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:01.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:01.634+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:01.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:01.646+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:01.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:01.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:01.649 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:01.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:02.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:02.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:02.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.126+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:02.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:02.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.162+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:02.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:02.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:02.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:02.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.238+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:02.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.238+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:02.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.238+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:02.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:02.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:02.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:02.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:02.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:02.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:02.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:02.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:04.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:04.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:04.079 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:04.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:04.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:04.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:04.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:04.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:04.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.170+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:04.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:04.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.170+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:04.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:04.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:04.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.482+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:04.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:04.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.562+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:04.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.562+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:04.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:04.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.582+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:04.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:04.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:04.582+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:06.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:06.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:33:06.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:06.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:06.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:06.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:06.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:06.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:06.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:06.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:06.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:06.214+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:06.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:06.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:06.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:06.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:06.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:06.242+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:06.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:06.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:06.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:06.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:06.307 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:33:06.302+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:33:07.800 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:33:07.798+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:33:08.680 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:33:08.678+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:33:10.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:10.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:10.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:10.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:10.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:10.273 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:10.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:10.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.274+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:10.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.282+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:10.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.346+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:10.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:10.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:11.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:11.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:11.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:10.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:11.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:11.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:11.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:11.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.030+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:11.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:11.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:11.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:11.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:11.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:11.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:11.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.446+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:11.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:11.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.446+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:11.746 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:33:11.742+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:33:11.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:11.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:11.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:11.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.946+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:11.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:11.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:12.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:11.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:12.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:12.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:12.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:12.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:12.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:12.014+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:13.161 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:33:13.728 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:33:13.729 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:33:13.747 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2962,"stamp":"2023-10-14T01:33:11.857632+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30421639635,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2554244,"num_read_kb":9950008,"num_write":2510607,"num_write_kb":10040963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80564,"ondisk_log_size":80564,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24561968,"kb_used_data":20081816,"kb_used_omap":3020,"kb_used_meta":4477107,"kb_avail":258553552,"statfs":{"total":289910292480,"available":264758837248,"internally_reserved":0,"allocated":20563779584,"data_stored":33134661332,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3093466,"internal_metadata":4584557606},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,9,8,17,12,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24813568,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6069,"num_read_kb":24220,"num_write":6358,"num_write_kb":25432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006163"},"pg_stats":[{"pgid":"2.7","version":"171'322502","reported_seq":631751,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:33:10.314971+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:33:10.314971+0000","last_peered":"2023-10-14T01:33:10.314971+0000","last_clean":"2023-10-14T01:33:10.314971+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:33:10.314971+0000","last_undegraded":"2023-10-14T01:33:10.314971+0000","last_fullsized":"2023-10-14T01:33:10.314971+0000","mapping_epoch":13,"log_start":"168'312417","ondisk_log_start":"168'312417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3701903896,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":310740,"num_read_kb":1209824,"num_write":304229,"num_write_kb":1216569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"171'339645","reported_seq":668551,"reported_epoch":171,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:33:10.336526+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:33:10.336526+0000","last_peered":"2023-10-14T01:33:10.336526+0000","last_clean":"2023-10-14T01:33:10.336526+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:33:10.336526+0000","last_undegraded":"2023-10-14T01:33:10.336526+0000","last_fullsized":"2023-10-14T01:33:10.336526+0000","mapping_epoch":13,"log_start":"168'329618","ondisk_log_start":"168'329618","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1508,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 535s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3914920154,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":331961,"num_read_kb":1283584,"num_write":322012,"num_write_kb":1287577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"171'316265","reported_seq":622375,"reported_epoch":171,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:33:10.307787+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:33:10.307787+0000","last_peered":"2023-10-14T01:33:10.307787+0000","last_clean":"2023-10-14T01:33:10.307787+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:33:10.307787+0000","last_undegraded":"2023-10-14T01:33:10.307787+0000","last_fullsized":"2023-10-14T01:33:10.307787+0000","mapping_epoch":13,"log_start":"168'306227","ondisk_log_start":"168'306227","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1884,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 524s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3675423424,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":307652,"num_read_kb":1201619,"num_write":303184,"num_write_kb":1212426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"171'314092","reported_seq":621399,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:33:10.308467+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:33:10.308467+0000","last_peered":"2023-10-14T01:33:10.308467+0000","last_clean":"2023-10-14T01:33:10.308467+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:33:10.308467+0000","last_undegraded":"2023-10-14T01:33:10.308467+0000","last_fullsized":"2023-10-14T01:33:10.308467+0000","mapping_epoch":13,"log_start":"168'304022","ondisk_log_start":"168'304022","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10070,"log_dups_size":0,"ondisk_log_size":10070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3693363882,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":308740,"num_read_kb":1209328,"num_write":305635,"num_write_kb":1222289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"171'317962","reported_seq":633916,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:33:10.772917+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:33:10.772917+0000","last_peered":"2023-10-14T01:33:10.772917+0000","last_clean":"2023-10-14T01:33:10.772917+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:33:10.772917+0000","last_undegraded":"2023-10-14T01:33:10.772917+0000","last_fullsized":"2023-10-14T01:33:10.772917+0000","mapping_epoch":13,"log_start":"168'307923","ondisk_log_start":"168'307923","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3766854153,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":317612,"num_read_kb":1232022,"num_write":311405,"num_write_kb":1245141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"171'320144","reported_seq":634650,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:33:11.502331+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:33:11.502331+0000","last_peered":"2023-10-14T01:33:11.502331+0000","last_clean":"2023-10-14T01:33:11.502331+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:33:11.502331+0000","last_undegraded":"2023-10-14T01:33:11.502331+0000","last_fullsized":"2023-10-14T01:33:11.502331+0000","mapping_epoch":13,"log_start":"168'310112","ondisk_log_start":"168'310112","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3812110654,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":315905,"num_read_kb":1240514,"num_write":314569,"num_write_kb":1258115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"171'322098","reported_seq":639424,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:33:11.488319+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:33:11.488319+0000","last_peered":"2023-10-14T01:33:11.488319+0000","last_clean":"2023-10-14T01:33:11.488319+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:33:11.488319+0000","last_undegraded":"2023-10-14T01:33:11.488319+0000","last_fullsized":"2023-10-14T01:33:11.488319+0000","mapping_epoch":13,"log_start":"168'312016","ondisk_log_start":"168'312016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3847418407,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":318523,"num_read_kb":1252232,"num_write":316477,"num_write_kb":1265771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"171'365608","reported_seq":706956,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:33:10.307492+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:33:10.307492+0000","last_peered":"2023-10-14T01:33:10.307492+0000","last_clean":"2023-10-14T01:33:10.307492+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:33:10.307492+0000","last_undegraded":"2023-10-14T01:33:10.307492+0000","last_fullsized":"2023-10-14T01:33:10.307492+0000","mapping_epoch":13,"log_start":"168'355516","ondisk_log_start":"168'355516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10092,"log_dups_size":0,"ondisk_log_size":10092,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4009054697,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":343005,"num_read_kb":1320794,"num_write":332959,"num_write_kb":1331181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":356,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:15.500537+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:32:15.500537+0000","last_peered":"2023-10-14T01:32:15.500537+0000","last_clean":"2023-10-14T01:32:15.500537+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:32:15.500537+0000","last_undegraded":"2023-10-14T01:32:15.500537+0000","last_fullsized":"2023-10-14T01:32:15.500537+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30421049267,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2554138,"num_read_kb":9949917,"num_write":2510470,"num_write_kb":10039069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20560105472,"data_stored":33132597094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80465,"ondisk_log_size":80465,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739484,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160444,"kb_used_data":3856308,"kb_used_omap":726,"kb_used_meta":1303401,"kb_avail":89211396,"statfs":{"total":96636764160,"available":91352469504,"internally_reserved":0,"allocated":3948859392,"data_stored":6338717960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1334683516},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,2,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:32:12 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.60199999999999998,"15min":0.73999999999999999},"min":{"1min":0.21099999999999999,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":2.4449999999999998,"5min":8.0719999999999992,"15min":10.981999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.66600000000000004,"15min":0.79400000000000004},"min":{"1min":0.27400000000000002,"5min":0.251,"15min":0.23699999999999999},"max":{"1min":2.48,"5min":8.0999999999999996,"15min":11.039},"last":0.40899999999999997}]},{"osd":1,"last update":"Sat Oct 14 01:32:12 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.96699999999999997,"15min":0.81299999999999994},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":6.0960000000000001,"5min":11.846,"15min":11.846},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.67100000000000004,"15min":0.71299999999999997},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":4.0609999999999999,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":0.34100000000000003}]}]},{"osd":1,"up_from":8,"seq":34359739463,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11787708,"kb_used_data":10039924,"kb_used_omap":1152,"kb_used_meta":1746623,"kb_avail":82584132,"statfs":{"total":96636764160,"available":84566151168,"internally_reserved":0,"allocated":10280882176,"data_stored":16566769037,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1179902,"internal_metadata":1788542722},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,4,3,9,11,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:32:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":0.77600000000000002,"15min":0.85599999999999998},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":5.6529999999999996,"5min":5.6529999999999996,"15min":9.8879999999999999},"last":0.374},{"interface":"front","average":{"1min":1.262,"5min":0.84099999999999997,"15min":0.75},"min":{"1min":0.247,"5min":0.224,"15min":0.185},"max":{"1min":7.9029999999999996,"5min":7.9029999999999996,"15min":10.029999999999999},"last":0.28599999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:32:59 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.5680000000000001,"15min":1.7729999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.19900000000000001},"max":{"1min":6.2329999999999997,"5min":14.208,"15min":17.547999999999998},"last":3.5249999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.84799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":3.8479999999999999,"5min":4.6269999999999998,"15min":18.399999999999999},"last":0.34000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739483,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7613816,"kb_used_data":6185584,"kb_used_omap":1142,"kb_used_meta":1427081,"kb_avail":86758024,"statfs":{"total":96636764160,"available":88840216576,"internally_reserved":0,"allocated":6334038016,"data_stored":10229174335,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":1461331368},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,3,4,1,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":1.0569999999999999,"15min":0.96999999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.158},"max":{"1min":1.5229999999999999,"5min":6.2149999999999999,"15min":8.4009999999999998},"last":0.625},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.79000000000000004,"15min":0.91100000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56499999999999995,"5min":7.641,"15min":8.3569999999999993},"last":0.47399999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.69199999999999995,"15min":0.82799999999999996},"min":{"1min":0.245,"5min":0.215,"15min":0.21199999999999999},"max":{"1min":6.1929999999999996,"5min":6.1929999999999996,"15min":7.3499999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.86799999999999999,"5min":1.1439999999999999,"15min":1.0920000000000001},"min":{"1min":0.27600000000000002,"5min":0.249,"15min":0.187},"max":{"1min":6.2190000000000003,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":0.51100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6332772352,"data_stored":10228267621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10279436288,"data_stored":16565682099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3947896832,"data_stored":6338647374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:33:13.748 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:33:13.749 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:33:13.749 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:33:14.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:14.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.082+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:14.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:14.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:14.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:14.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:14.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:14.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.262+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:14.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:14.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:14.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:14.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:14.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:14.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:14.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:14.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:14.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.942+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:14.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:14.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:14.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:15.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:15.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:15.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:15.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:15.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:15.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:16.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:15.998+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:16.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:15.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:16.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:16.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.014+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:16.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:16.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:16.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:16.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:16.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:16.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:16.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:16.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:16.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:16.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:16.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:16.846+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:17.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:17.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:17.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:17.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:17.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:17.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:17.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:17.106+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:17.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:17.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:17.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:17.150+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:17.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:17.150+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:17.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:17.150+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:17.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:17.150+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:17.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:17.150+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:17.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:17.150+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:19.002 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:33:18.998+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:33:19.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:33:19.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:33:19.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:19.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:19.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:19.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.218+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:19.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.226+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:19.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:19.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:19.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.262+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:19.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:19.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:19.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.278+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:19.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:19.282 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:19.278+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:20.580 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:33:20.578+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:33:20.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:20.798+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:20.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:20.838+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:20.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:20.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:20.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:20.910+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:20.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:20.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:20.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:20.938+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:21.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:21.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:21.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:21.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:21.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:21.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:21.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.374+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:21.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:21.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:21.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:21.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.414+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:21.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:21.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:21.414+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:22.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:22.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.298+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:22.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.310+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:22.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.310+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:22.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:22.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.334+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:22.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:22.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:22.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:22.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.606+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:22.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:22.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:22.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.642+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:22.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:22.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:22.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.682+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:22.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.694+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:22.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:22.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.694+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:22.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:22.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:22.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:22.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.982+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:23.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:22.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:23.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:23.010+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:23.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:23.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:23.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:23.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:24.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:24.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:24.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:24.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:24.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:24.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:24.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:24.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:24.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:24.522+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:24.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:24.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:24.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:24.522+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:24.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:24.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:25.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:25.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:25.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:25.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:25.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:25.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:25.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:25.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:25.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:25.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:25.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:25.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:25.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:25.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:25.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:25.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:25.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:25.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:25.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:25.594+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:25.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:25.594+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:25.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:25.594+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:26.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:26.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:26.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:26.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:26.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:26.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.370+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:26.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.426+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:26.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:26.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:26.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.950+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:26.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:26.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:26.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:26.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:26.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:27.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.010+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:27.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:27.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.030+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:27.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:27.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.030+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:27.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:27.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:27.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:27.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.182+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:27.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:27.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:27.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.230+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:27.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.230+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:27.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.238+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:27.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.242+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:27.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:27.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:27.242+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:28.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:28.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:28.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:28.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:28.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:28.122+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:28.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:28.122+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:28.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:28.122+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:28.133 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:28.122+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:29.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.282+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:29.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:29.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:29.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.322+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:29.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.326+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:29.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:29.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:29.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.338+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:29.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:29.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.346+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:29.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:29.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:29.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:29.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:29.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:29.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.986+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:29.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:29.986+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:30.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.018+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:30.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.034+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:30.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:30.053 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.034+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:30.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:30.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:30.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:30.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:30.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:30.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.610+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:30.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.614+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:30.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.646+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:30.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:30.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:30.646+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:31.064 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:33:31.058+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:33:33.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:33:33.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:33:33.666 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:33.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.662+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:33.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:33.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:33.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.674+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:33.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:33.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.682+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:33.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.686+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:33.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.686+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:33.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.698+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:33.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.706+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:33.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.706+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:33.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:33.706+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:33.750 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:33:34.576 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:33:34.577 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:33:34.625 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2974,"stamp":"2023-10-14T01:33:33.862235+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30453940691,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2562083,"num_read_kb":9981300,"num_write":2518878,"num_write_kb":10074047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80523,"ondisk_log_size":80523,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24937068,"kb_used_data":20147660,"kb_used_omap":3020,"kb_used_meta":4786355,"kb_avail":258178452,"statfs":{"total":289910292480,"available":264374734848,"internally_reserved":0,"allocated":20631203840,"data_stored":33202071182,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3093466,"internal_metadata":4901227558},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,3,13,12,15,48],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16252928,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3971,"num_read_kb":15852,"num_write":4156,"num_write_kb":16624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002627"},"pg_stats":[{"pgid":"2.7","version":"172'323623","reported_seq":633823,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:30.850145+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:33:30.850145+0000","last_peered":"2023-10-14T01:33:30.850145+0000","last_clean":"2023-10-14T01:33:30.850145+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:33:30.850145+0000","last_undegraded":"2023-10-14T01:33:30.850145+0000","last_fullsized":"2023-10-14T01:33:30.850145+0000","mapping_epoch":13,"log_start":"168'313617","ondisk_log_start":"168'313617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3706171928,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":311673,"num_read_kb":1213544,"num_write":305281,"num_write_kb":1220777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"172'340838","reported_seq":670779,"reported_epoch":172,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:33:30.827358+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:33:30.827358+0000","last_peered":"2023-10-14T01:33:30.827358+0000","last_clean":"2023-10-14T01:33:30.827358+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:33:30.827358+0000","last_undegraded":"2023-10-14T01:33:30.827358+0000","last_fullsized":"2023-10-14T01:33:30.827358+0000","mapping_epoch":13,"log_start":"168'330819","ondisk_log_start":"168'330819","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1554,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 556s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3919139034,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":332978,"num_read_kb":1287640,"num_write":323097,"num_write_kb":1291917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"172'317353","reported_seq":624383,"reported_epoch":172,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:33:30.814639+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:33:30.814639+0000","last_peered":"2023-10-14T01:33:30.814639+0000","last_clean":"2023-10-14T01:33:30.814639+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:33:30.814639+0000","last_undegraded":"2023-10-14T01:33:30.814639+0000","last_fullsized":"2023-10-14T01:33:30.814639+0000","mapping_epoch":13,"log_start":"168'307327","ondisk_log_start":"168'307327","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1967,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 545s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3679257280,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":308554,"num_read_kb":1205223,"num_write":304164,"num_write_kb":1216346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"172'315121","reported_seq":623383,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:30.768959+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:33:30.768959+0000","last_peered":"2023-10-14T01:33:30.768959+0000","last_clean":"2023-10-14T01:33:30.768959+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:33:30.768959+0000","last_undegraded":"2023-10-14T01:33:30.768959+0000","last_fullsized":"2023-10-14T01:33:30.768959+0000","mapping_epoch":13,"log_start":"168'305022","ondisk_log_start":"168'305022","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3697259178,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":309692,"num_read_kb":1213128,"num_write":306640,"num_write_kb":1226309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"172'318909","reported_seq":635802,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:30.931532+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:33:30.931532+0000","last_peered":"2023-10-14T01:33:30.931532+0000","last_clean":"2023-10-14T01:33:30.931532+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:33:30.931532+0000","last_undegraded":"2023-10-14T01:33:30.931532+0000","last_fullsized":"2023-10-14T01:33:30.931532+0000","mapping_epoch":13,"log_start":"168'308823","ondisk_log_start":"168'308823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3770429961,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":318536,"num_read_kb":1235714,"num_write":312334,"num_write_kb":1248857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"172'321244","reported_seq":636745,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:31.668859+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:33:31.668859+0000","last_peered":"2023-10-14T01:33:31.668859+0000","last_clean":"2023-10-14T01:33:31.668859+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:33:31.668859+0000","last_undegraded":"2023-10-14T01:33:31.668859+0000","last_fullsized":"2023-10-14T01:33:31.668859+0000","mapping_epoch":13,"log_start":"168'311212","ondisk_log_start":"168'311212","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10032,"log_dups_size":0,"ondisk_log_size":10032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3816407358,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":316898,"num_read_kb":1244478,"num_write":315657,"num_write_kb":1262467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"172'323184","reported_seq":641587,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:31.668489+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:33:31.668489+0000","last_peered":"2023-10-14T01:33:31.668489+0000","last_clean":"2023-10-14T01:33:31.668489+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:33:31.668489+0000","last_undegraded":"2023-10-14T01:33:31.668489+0000","last_fullsized":"2023-10-14T01:33:31.668489+0000","mapping_epoch":13,"log_start":"168'313116","ondisk_log_start":"168'313116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3851596327,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":319599,"num_read_kb":1256532,"num_write":317551,"num_write_kb":1270067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"172'366804","reported_seq":709222,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:30.809018+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:33:30.809018+0000","last_peered":"2023-10-14T01:33:30.809018+0000","last_clean":"2023-10-14T01:33:30.809018+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:33:30.809018+0000","last_undegraded":"2023-10-14T01:33:30.809018+0000","last_fullsized":"2023-10-14T01:33:30.809018+0000","mapping_epoch":13,"log_start":"168'356716","ondisk_log_start":"168'356716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4013089257,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":344047,"num_read_kb":1324950,"num_write":334017,"num_write_kb":1335413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":357,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:18.685298+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:32:18.685298+0000","last_peered":"2023-10-14T01:32:18.685298+0000","last_clean":"2023-10-14T01:32:18.685298+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:32:18.685298+0000","last_undegraded":"2023-10-14T01:32:18.685298+0000","last_fullsized":"2023-10-14T01:32:18.685298+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30453350323,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2561977,"num_read_kb":9981209,"num_write":2518741,"num_write_kb":10072153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20627529728,"data_stored":33200021350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80424,"ondisk_log_size":80424,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739488,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5217864,"kb_used_data":3869564,"kb_used_omap":726,"kb_used_meta":1347561,"kb_avail":89153976,"statfs":{"total":96636764160,"available":91293671424,"internally_reserved":0,"allocated":3962433536,"data_stored":6352287302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1379903356},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,2,1,1,9],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:33:13 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":0.79000000000000004,"15min":0.79100000000000004},"min":{"1min":0.28199999999999997,"5min":0.19600000000000001,"15min":0.17399999999999999},"max":{"1min":6.9279999999999999,"5min":8.0719999999999992,"15min":10.981999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.5169999999999999,"5min":0.85099999999999998,"15min":0.84399999999999997},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":6.9669999999999996,"5min":8.0999999999999996,"15min":11.039},"last":0.55600000000000005}]},{"osd":1,"last update":"Sat Oct 14 01:33:13 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.997,"15min":0.86299999999999999},"min":{"1min":0.20300000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":5.3179999999999996,"5min":6.4870000000000001,"15min":11.846},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68400000000000005,"15min":0.70899999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.222},"max":{"1min":5.101,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":0.30599999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739467,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11995560,"kb_used_data":10072928,"kb_used_omap":1152,"kb_used_meta":1921471,"kb_avail":82376280,"statfs":{"total":96636764160,"available":84353310720,"internally_reserved":0,"allocated":10314678272,"data_stored":16600560331,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1179902,"internal_metadata":1967587074},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,9,6,10,37],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:32:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":0.77600000000000002,"15min":0.85599999999999998},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":5.6529999999999996,"5min":5.6529999999999996,"15min":9.8879999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":1.262,"5min":0.84099999999999997,"15min":0.75},"min":{"1min":0.247,"5min":0.224,"15min":0.185},"max":{"1min":7.9029999999999996,"5min":7.9029999999999996,"15min":10.029999999999999},"last":0.377}]},{"osd":2,"last update":"Sat Oct 14 01:32:59 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.5680000000000001,"15min":1.7729999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.19900000000000001},"max":{"1min":6.2329999999999997,"5min":14.208,"15min":17.547999999999998},"last":4.6440000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.84799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":3.8479999999999999,"5min":4.6269999999999998,"15min":18.399999999999999},"last":0.24299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739487,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7723644,"kb_used_data":6205168,"kb_used_omap":1142,"kb_used_meta":1517321,"kb_avail":86648196,"statfs":{"total":96636764160,"available":88727752704,"internally_reserved":0,"allocated":6354092032,"data_stored":10249223549,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":1553737128},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,1,2,5,4,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":1.0569999999999999,"15min":0.96999999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.158},"max":{"1min":1.5229999999999999,"5min":6.2149999999999999,"15min":8.4009999999999998},"last":9.5030000000000001},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.79000000000000004,"15min":0.91100000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56499999999999995,"5min":7.641,"15min":8.3569999999999993},"last":9.5510000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.69199999999999995,"15min":0.82799999999999996},"min":{"1min":0.245,"5min":0.215,"15min":0.21199999999999999},"max":{"1min":6.1929999999999996,"5min":6.1929999999999996,"15min":7.3499999999999996},"last":0.245},{"interface":"front","average":{"1min":0.86799999999999999,"5min":1.1439999999999999,"15min":1.0920000000000001},"min":{"1min":0.27600000000000002,"5min":0.249,"15min":0.187},"max":{"1min":6.2190000000000003,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":0.32300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6353154048,"data_stored":10248649317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10313445376,"data_stored":16599691187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3960930304,"data_stored":6351680846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:33:34.627 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:33:34.627 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:33:34.628 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:33:35.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:35.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:35.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:35.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.174+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:35.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:35.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:35.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.206+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:35.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:35.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:35.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.206+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:35.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.218+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:35.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.234+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:35.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.386+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:35.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:35.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:35.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.406+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:35.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:35.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:35.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:35.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.454+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:35.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:35.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:35.454+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:36.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:36.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:36.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:36.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:36.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:36.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:36.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:36.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:36.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:36.378+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:36.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:36.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:36.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:36.382+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:36.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:36.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:36.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:36.386+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:36.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:36.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:36.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:36.386+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:37.408 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:33:37.406+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:33:39.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:39.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:39.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.166+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:39.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.166+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:39.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.178+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:39.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.186+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:39.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:39.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.186+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:39.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:39.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:39.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:39.285 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:39.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:39.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.318+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:39.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:39.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.322+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:39.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:39.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:39.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:39.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:39.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:39.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:39.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.966+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:39.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:39.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:39.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:40.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.022+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:40.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:40.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:40.511 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:40.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:40.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:40.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:40.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.554+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:40.560 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:40.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:40.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.574+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:40.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.574+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:40.580 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:40.574+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:41.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.530+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:41.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:41.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:41.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.578+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:41.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:41.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:41.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.602+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:41.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.618+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:41.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.618+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:41.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.626+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:41.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.638+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:41.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:41.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.638+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:41.735 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:41.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.750+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:41.758 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.754+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:41.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.758+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:41.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.758+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:41.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.798+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:41.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.834+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:41.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:41.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.834+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:41.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:41.866+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:43.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:43.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.434+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:43.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:43.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:43.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.470+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:43.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:43.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.506+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:43.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.534+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:43.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:43.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:43.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:43.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:43.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.718+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:43.732 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:43.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:43.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:43.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:33:43.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:43.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:43.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:43.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.854+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:43.889 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.886+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:43.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:43.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:43.902+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:46.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:46.722+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:46.734 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:46.730+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:46.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:46.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:46.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:46.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:46.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:46.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:46.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:46.842+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:46.868 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:46.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:46.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:46.866+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:46.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:46.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:46.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:46.866+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:47.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:47.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:47.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:47.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:47.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:47.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:47.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:47.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:47.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:47.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:47.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:47.342+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:47.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:47.362+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:47.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:47.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:47.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:47.362+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:48.815 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:48.818 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.814+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:48.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:48.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.826+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:48.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.846+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:48.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.862+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:48.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:48.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:48.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:48.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:48.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:48.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:48.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:48.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:48.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:48.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:49.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:49.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.038+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:49.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.062+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:49.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.066+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:49.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:49.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:49.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:49.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:49.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:49.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:49.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:49.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:49.321 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.318+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:49.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:49.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.334+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:49.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:49.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:49.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:50.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:50.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:50.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:50.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:50.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:50.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:50.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:50.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:50.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:50.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:50.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:50.430+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:53.575 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:33:53.574+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:33:54.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:54.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:54.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:54.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:54.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:54.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.478+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:54.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.502+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:54.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:54.505 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.502+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:54.629 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:33:54.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:33:54.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:54.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.874+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:54.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.910+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:54.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:54.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.926+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:54.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:54.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:54.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:54.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:54.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.970+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.978+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:54.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:54.978+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:55.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:33:55.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.170+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:55.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.190+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:55.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:55.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:55.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:55.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:55.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.266+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:55.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.286+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:55.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:55.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:55.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.322+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:55.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:55.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:55.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:55.379 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:33:55.380 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:33:55.465 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2984,"stamp":"2023-10-14T01:33:53.867814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30486716883,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2570125,"num_read_kb":10013376,"num_write":2527298,"num_write_kb":10107727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80448,"ondisk_log_size":80448,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25290344,"kb_used_data":20213776,"kb_used_omap":3020,"kb_used_meta":5073523,"kb_avail":257825176,"statfs":{"total":289910292480,"available":264012980224,"internally_reserved":0,"allocated":20698906624,"data_stored":33269773966,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3093466,"internal_metadata":5195287590},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,3,10,9,9,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16535552,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3988,"num_read_kb":15884,"num_write":4243,"num_write_kb":16972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004294"},"pg_stats":[{"pgid":"2.7","version":"172'324703","reported_seq":635923,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:51.457642+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:33:51.457642+0000","last_peered":"2023-10-14T01:33:51.457642+0000","last_clean":"2023-10-14T01:33:51.457642+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:33:51.457642+0000","last_undegraded":"2023-10-14T01:33:51.457642+0000","last_fullsized":"2023-10-14T01:33:51.457642+0000","mapping_epoch":13,"log_start":"168'314617","ondisk_log_start":"168'314617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3710218776,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":312681,"num_read_kb":1217576,"num_write":306304,"num_write_kb":1224869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"172'342054","reported_seq":673047,"reported_epoch":172,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:33:51.464627+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:33:51.464627+0000","last_peered":"2023-10-14T01:33:51.464627+0000","last_clean":"2023-10-14T01:33:51.464627+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:33:51.464627+0000","last_undegraded":"2023-10-14T01:33:51.464627+0000","last_fullsized":"2023-10-14T01:33:51.464627+0000","mapping_epoch":13,"log_start":"169'332019","ondisk_log_start":"169'332019","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1603,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 577s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3923493082,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":334009,"num_read_kb":1291748,"num_write":324217,"num_write_kb":1296397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"172'318450","reported_seq":626446,"reported_epoch":172,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:33:51.417139+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:33:51.417139+0000","last_peered":"2023-10-14T01:33:51.417139+0000","last_clean":"2023-10-14T01:33:51.417139+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:33:51.417139+0000","last_undegraded":"2023-10-14T01:33:51.417139+0000","last_fullsized":"2023-10-14T01:33:51.417139+0000","mapping_epoch":13,"log_start":"168'308427","ondisk_log_start":"168'308427","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2059,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 565s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3683066560,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":309501,"num_read_kb":1208995,"num_write":305151,"num_write_kb":1220294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"172'316138","reported_seq":625398,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:51.374530+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:33:51.374530+0000","last_peered":"2023-10-14T01:33:51.374530+0000","last_clean":"2023-10-14T01:33:51.374530+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:33:51.374530+0000","last_undegraded":"2023-10-14T01:33:51.374530+0000","last_fullsized":"2023-10-14T01:33:51.374530+0000","mapping_epoch":13,"log_start":"168'306122","ondisk_log_start":"168'306122","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3701076650,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":310685,"num_read_kb":1217096,"num_write":307637,"num_write_kb":1230297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"172'319881","reported_seq":637718,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:51.105753+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:33:51.105753+0000","last_peered":"2023-10-14T01:33:51.105753+0000","last_clean":"2023-10-14T01:33:51.105753+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:33:51.105753+0000","last_undegraded":"2023-10-14T01:33:51.105753+0000","last_fullsized":"2023-10-14T01:33:51.105753+0000","mapping_epoch":13,"log_start":"168'309823","ondisk_log_start":"168'309823","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10058,"log_dups_size":0,"ondisk_log_size":10058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3774190089,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":319467,"num_read_kb":1239430,"num_write":313294,"num_write_kb":1252697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"172'322372","reported_seq":638940,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:51.692728+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:33:51.692728+0000","last_peered":"2023-10-14T01:33:51.692728+0000","last_clean":"2023-10-14T01:33:51.692728+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:33:51.692728+0000","last_undegraded":"2023-10-14T01:33:51.692728+0000","last_fullsized":"2023-10-14T01:33:51.692728+0000","mapping_epoch":13,"log_start":"168'312312","ondisk_log_start":"168'312312","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3820773694,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":317958,"num_read_kb":1248710,"num_write":316784,"num_write_kb":1266975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"172'324252","reported_seq":643633,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:51.687018+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:33:51.687018+0000","last_peered":"2023-10-14T01:33:51.687018+0000","last_clean":"2023-10-14T01:33:51.687018+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:33:51.687018+0000","last_undegraded":"2023-10-14T01:33:51.687018+0000","last_fullsized":"2023-10-14T01:33:51.687018+0000","mapping_epoch":13,"log_start":"168'314216","ondisk_log_start":"168'314216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3855798823,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":320569,"num_read_kb":1260400,"num_write":318618,"num_write_kb":1274335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"172'368051","reported_seq":711595,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:51.384760+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:33:51.384760+0000","last_peered":"2023-10-14T01:33:51.384760+0000","last_clean":"2023-10-14T01:33:51.384760+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:33:51.384760+0000","last_undegraded":"2023-10-14T01:33:51.384760+0000","last_fullsized":"2023-10-14T01:33:51.384760+0000","mapping_epoch":13,"log_start":"170'358016","ondisk_log_start":"170'358016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10035,"log_dups_size":0,"ondisk_log_size":10035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4017508841,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":345149,"num_read_kb":1329330,"num_write":335156,"num_write_kb":1339969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":357,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:18.685298+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:32:18.685298+0000","last_peered":"2023-10-14T01:32:18.685298+0000","last_clean":"2023-10-14T01:32:18.685298+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:32:18.685298+0000","last_undegraded":"2023-10-14T01:32:18.685298+0000","last_fullsized":"2023-10-14T01:32:18.685298+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30486126515,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2570019,"num_read_kb":10013285,"num_write":2527161,"num_write_kb":10105833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20696465408,"data_stored":33268957030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80349,"ondisk_log_size":80349,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739492,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5297724,"kb_used_data":3882804,"kb_used_omap":726,"kb_used_meta":1414185,"kb_avail":89074116,"statfs":{"total":96636764160,"available":91211894784,"internally_reserved":0,"allocated":3975991296,"data_stored":6365845062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1448126332},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,2,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:33:13 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":0.79000000000000004,"15min":0.79100000000000004},"min":{"1min":0.28199999999999997,"5min":0.19600000000000001,"15min":0.17399999999999999},"max":{"1min":6.9279999999999999,"5min":8.0719999999999992,"15min":10.981999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":1.5169999999999999,"5min":0.85099999999999998,"15min":0.84399999999999997},"min":{"1min":0.309,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":6.9669999999999996,"5min":8.0999999999999996,"15min":11.039},"last":0.36599999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:33:13 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.997,"15min":0.86299999999999999},"min":{"1min":0.20300000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":5.3179999999999996,"5min":6.4870000000000001,"15min":11.846},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.68400000000000005,"15min":0.70899999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.222},"max":{"1min":5.101,"5min":8.0229999999999997,"15min":8.3699999999999992},"last":0.308}]}]},{"osd":1,"up_from":8,"seq":34359739471,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12164576,"kb_used_data":10105880,"kb_used_omap":1152,"kb_used_meta":2057535,"kb_avail":82207264,"statfs":{"total":96636764160,"available":84180238336,"internally_reserved":0,"allocated":10348421120,"data_stored":16634303179,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1179902,"internal_metadata":2106916610},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,1,7,6,9,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:32:59 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":0.77600000000000002,"15min":0.85599999999999998},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":5.6529999999999996,"5min":5.6529999999999996,"15min":9.8879999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.262,"5min":0.84099999999999997,"15min":0.75},"min":{"1min":0.247,"5min":0.224,"15min":0.185},"max":{"1min":7.9029999999999996,"5min":7.9029999999999996,"15min":10.029999999999999},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:32:59 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.5680000000000001,"15min":1.7729999999999999},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.19900000000000001},"max":{"1min":6.2329999999999997,"5min":14.208,"15min":17.547999999999998},"last":0.214},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64300000000000002,"15min":0.84799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23400000000000001,"15min":0.21199999999999999},"max":{"1min":3.8479999999999999,"5min":4.6269999999999998,"15min":18.399999999999999},"last":0.29099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739491,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7828044,"kb_used_data":6225092,"kb_used_omap":1142,"kb_used_meta":1601801,"kb_avail":86543796,"statfs":{"total":96636764160,"available":88620847104,"internally_reserved":0,"allocated":6374494208,"data_stored":10269625725,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":1640244648},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":1.0569999999999999,"15min":0.96999999999999997},"min":{"1min":0.186,"5min":0.186,"15min":0.158},"max":{"1min":1.5229999999999999,"5min":6.2149999999999999,"15min":8.4009999999999998},"last":1.284},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.79000000000000004,"15min":0.91100000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.56499999999999995,"5min":7.641,"15min":8.3569999999999993},"last":1.3109999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:33:10 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.69199999999999995,"15min":0.82799999999999996},"min":{"1min":0.245,"5min":0.215,"15min":0.21199999999999999},"max":{"1min":6.1929999999999996,"5min":6.1929999999999996,"15min":7.3499999999999996},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":1.1439999999999999,"15min":1.0920000000000001},"min":{"1min":0.27600000000000002,"5min":0.249,"15min":0.187},"max":{"1min":6.2190000000000003,"5min":8.8900000000000006,"15min":9.4649999999999999},"last":0.20399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6373613568,"data_stored":10269108837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10348335104,"data_stored":16634580915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3974516736,"data_stored":6365267278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:33:55.467 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:33:55.467 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:33:55.468 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:33:55.483 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:33:55.478+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:33:56.384 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:33:56.440 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-10-14T01:33:57.255 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-10-14T01:33:57.297 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:33:58.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:58.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:33:58.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:58.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:33:58.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:58.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:58.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:58.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:58.208 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:58.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:58.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:58.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:58.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:58.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:58.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:58.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:58.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:58.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:58.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:58.277+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:33:58.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:58.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:33:58.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:58.277+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:33:59.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:59.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:33:59.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:59.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:33:59.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:59.881+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:33:59.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:59.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:33:59.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:59.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:33:59.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:59.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:33:59.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:59.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:33:59.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:59.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:33:59.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:59.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:33:59.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:59.993+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:00.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:59.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:00.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:33:59.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:01.495 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:01.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:01.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:01.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:01.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:01.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:01.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:01.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:01.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:01.553+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:01.559 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:01.553+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:01.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:01.561+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:01.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:01.605+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:01.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:01.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:01.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:01.605+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:02.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:02.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:02.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:02.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:02.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:02.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:02.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:02.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:03.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:03.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:03.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:03.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:03.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:03.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:03.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:03.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:03.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:03.089+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:03.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:03.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:03.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:03.089+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:03.451 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:34:03.445+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:34:04.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:04.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:04.636 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:04.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:04.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:04.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:04.637 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:04.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:04.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:04.773+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:04.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:04.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:04.812 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:04.809+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:04.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:04.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:04.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:04.857+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:04.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:04.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:04.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:04.857+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:06.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:06.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:06.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:06.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:06.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:06.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:06.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:06.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:06.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:06.961+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:06.989 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:06.985+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:06.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:06.985+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:07.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:07.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:07.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:07.021+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:07.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:07.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:07.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:07.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:07.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:07.273+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:07.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:07.297+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:07.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:07.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:07.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:07.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:07.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:07.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:07.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:07.317+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:07.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:07.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:09.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:09.640 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:09.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:09.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.681+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:09.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.705+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:09.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.705+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:09.780 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.777+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:09.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.813+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:09.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:09.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.813+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:09.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:34:09.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:09.859 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:09.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:09.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:09.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:09.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:10.255 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:10.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:10.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:10.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.289+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:10.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:10.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:10.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.325+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:10.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:10.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:10.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:10.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:10.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:10.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:10.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:10.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:10.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.533+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:10.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:10.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:10.594 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.581+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:10.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.593+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:10.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:10.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:10.593+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:13.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:13.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:13.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:13.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:13.355 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:13.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:13.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:13.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:13.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.353+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:13.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:13.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:13.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.853+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:13.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:13.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:13.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:13.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.893+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:13.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:13.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:13.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:13.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.909+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:13.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:13.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:13.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:15.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:15.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:15.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:15.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:15.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:15.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:15.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.273+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:15.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.305+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:15.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.305+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:15.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:34:15.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:15.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:15.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:15.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:15.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:15.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:15.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:15.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:15.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.357+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:15.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:15.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:15.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:15.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:15.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:15.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.861+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:15.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.869+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:15.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.893+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:15.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:15.896 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:15.893+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:17.298 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:34:18.143 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:34:18.144 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:34:18.175 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":2996,"stamp":"2023-10-14T01:34:17.873836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30527394259,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2580260,"num_read_kb":10053808,"num_write":2537723,"num_write_kb":10149427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80547,"ondisk_log_size":80547,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25701192,"kb_used_data":20297452,"kb_used_omap":3020,"kb_used_meta":5400691,"kb_avail":257414328,"statfs":{"total":289910292480,"available":263592271872,"internally_reserved":0,"allocated":20784590848,"data_stored":33355458190,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3093466,"internal_metadata":5530307622},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,0,4,11,8,12,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24547328,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6150,"num_read_kb":24528,"num_write":6299,"num_write_kb":25196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004012"},"pg_stats":[{"pgid":"2.7","version":"172'326058","reported_seq":638533,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:34:17.229194+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:34:17.229194+0000","last_peered":"2023-10-14T01:34:17.229194+0000","last_clean":"2023-10-14T01:34:17.229194+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:34:17.229194+0000","last_undegraded":"2023-10-14T01:34:17.229194+0000","last_fullsized":"2023-10-14T01:34:17.229194+0000","mapping_epoch":13,"log_start":"170'316017","ondisk_log_start":"170'316017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10041,"log_dups_size":0,"ondisk_log_size":10041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3715318296,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":313921,"num_read_kb":1222528,"num_write":307602,"num_write_kb":1230061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"172'343587","reported_seq":675962,"reported_epoch":172,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:34:17.255651+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:34:17.255651+0000","last_peered":"2023-10-14T01:34:17.255651+0000","last_clean":"2023-10-14T01:34:17.255651+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:34:17.255651+0000","last_undegraded":"2023-10-14T01:34:17.255651+0000","last_fullsized":"2023-10-14T01:34:17.255651+0000","mapping_epoch":13,"log_start":"170'333519","ondisk_log_start":"170'333519","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1673,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 602s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3929051354,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":335366,"num_read_kb":1297168,"num_write":325644,"num_write_kb":1302105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"172'319803","reported_seq":628996,"reported_epoch":172,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:34:17.233851+0000","last_change":"2023-10-14T01:24:25.440295+0000","last_active":"2023-10-14T01:34:17.233851+0000","last_peered":"2023-10-14T01:34:17.233851+0000","last_clean":"2023-10-14T01:34:17.233851+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:34:17.233851+0000","last_undegraded":"2023-10-14T01:34:17.233851+0000","last_fullsized":"2023-10-14T01:34:17.233851+0000","mapping_epoch":13,"log_start":"170'309727","ondisk_log_start":"170'309727","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2210,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 591s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3687764672,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":310680,"num_read_kb":1213683,"num_write":306349,"num_write_kb":1225086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"172'317436","reported_seq":627959,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:34:17.228502+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:34:17.228502+0000","last_peered":"2023-10-14T01:34:17.228502+0000","last_clean":"2023-10-14T01:34:17.228502+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:34:17.228502+0000","last_undegraded":"2023-10-14T01:34:17.228502+0000","last_fullsized":"2023-10-14T01:34:17.228502+0000","mapping_epoch":13,"log_start":"169'307422","ondisk_log_start":"169'307422","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3706028714,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":311943,"num_read_kb":1222116,"num_write":308916,"num_write_kb":1235413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"172'321049","reported_seq":640109,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:34:16.349637+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:34:16.349637+0000","last_peered":"2023-10-14T01:34:16.349637+0000","last_clean":"2023-10-14T01:34:16.349637+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:34:16.349637+0000","last_undegraded":"2023-10-14T01:34:16.349637+0000","last_fullsized":"2023-10-14T01:34:16.349637+0000","mapping_epoch":13,"log_start":"169'311023","ondisk_log_start":"169'311023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3778789897,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":320675,"num_read_kb":1244250,"num_write":314450,"num_write_kb":1257321,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"172'323656","reported_seq":641490,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:34:16.901087+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:34:16.901087+0000","last_peered":"2023-10-14T01:34:16.901087+0000","last_clean":"2023-10-14T01:34:16.901087+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:34:16.901087+0000","last_undegraded":"2023-10-14T01:34:16.901087+0000","last_fullsized":"2023-10-14T01:34:16.901087+0000","mapping_epoch":13,"log_start":"170'313612","ondisk_log_start":"170'313612","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3825713470,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":319220,"num_read_kb":1253746,"num_write":318060,"num_write_kb":1272079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"172'325595","reported_seq":646224,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:34:16.824478+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:34:16.824478+0000","last_peered":"2023-10-14T01:34:16.824478+0000","last_clean":"2023-10-14T01:34:16.824478+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:34:16.824478+0000","last_undegraded":"2023-10-14T01:34:16.824478+0000","last_fullsized":"2023-10-14T01:34:16.824478+0000","mapping_epoch":13,"log_start":"170'315516","ondisk_log_start":"170'315516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3861066279,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":321811,"num_read_kb":1265360,"num_write":319953,"num_write_kb":1279675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"172'369616","reported_seq":714579,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:34:17.224803+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:34:17.224803+0000","last_peered":"2023-10-14T01:34:17.224803+0000","last_clean":"2023-10-14T01:34:17.224803+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:34:17.224803+0000","last_undegraded":"2023-10-14T01:34:17.224803+0000","last_fullsized":"2023-10-14T01:34:17.224803+0000","mapping_epoch":13,"log_start":"170'359516","ondisk_log_start":"170'359516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4023071209,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":346538,"num_read_kb":1334866,"num_write":336612,"num_write_kb":1345793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":357,"reported_epoch":171,"state":"active+clean","last_fresh":"2023-10-14T01:32:18.685298+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:32:18.685298+0000","last_peered":"2023-10-14T01:32:18.685298+0000","last_clean":"2023-10-14T01:32:18.685298+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:32:18.685298+0000","last_undegraded":"2023-10-14T01:32:18.685298+0000","last_fullsized":"2023-10-14T01:32:18.685298+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30526803891,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2580154,"num_read_kb":10053717,"num_write":2537586,"num_write_kb":10147533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14930,"num_omap_keys":235,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20781654016,"data_stored":33354145638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80448,"ondisk_log_size":80448,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739497,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5367716,"kb_used_data":3898652,"kb_used_omap":726,"kb_used_meta":1468329,"kb_avail":89004124,"statfs":{"total":96636764160,"available":91140222976,"internally_reserved":0,"allocated":3992219648,"data_stored":6382073414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1503569788},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,4,1,1,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.68799999999999994,"15min":0.77700000000000002},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":1.5469999999999999,"5min":6.9279999999999999,"15min":10.981999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.75,"15min":0.82999999999999996},"min":{"1min":0.317,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":1.5780000000000001,"5min":6.9669999999999996,"15min":11.039},"last":0.84999999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.94999999999999996,"15min":0.86799999999999999},"min":{"1min":0.223,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":4.0599999999999996,"5min":6.4870000000000001,"15min":11.846},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.53400000000000003,"15min":0.66800000000000004},"min":{"1min":0.25800000000000001,"5min":0.245,"15min":0.222},"max":{"1min":0.68700000000000006,"5min":5.101,"15min":8.1899999999999995},"last":0.308}]}]},{"osd":1,"up_from":8,"seq":34359739476,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12380564,"kb_used_data":10148808,"kb_used_omap":1152,"kb_used_meta":2230591,"kb_avail":81991276,"statfs":{"total":96636764160,"available":83959066624,"internally_reserved":0,"allocated":10392379392,"data_stored":16678261451,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1179902,"internal_metadata":2284125954},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,7,5,8,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.248,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.5779999999999998,"5min":5.6529999999999996,"15min":6.673},"last":0.308},{"interface":"front","average":{"1min":0.625,"5min":0.80800000000000005,"15min":0.72499999999999998},"min":{"1min":0.251,"5min":0.224,"15min":0.185},"max":{"1min":2.5379999999999998,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":0.31900000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:34:00 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.544,"15min":1.76},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":8.7170000000000005,"5min":14.208,"15min":17.547999999999998},"last":0.52000000000000002},{"interface":"front","average":{"1min":1.3600000000000001,"5min":0.76100000000000001,"15min":0.85599999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":15.897,"5min":15.897,"15min":18.399999999999999},"last":0.27200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739496,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7952912,"kb_used_data":6249992,"kb_used_omap":1142,"kb_used_meta":1701769,"kb_avail":86418928,"statfs":{"total":96636764160,"available":88492982272,"internally_reserved":0,"allocated":6399991808,"data_stored":10295123325,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":1742611880},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,0,0,0,2,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:34:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.0620000000000001,"15min":1.0169999999999999},"min":{"1min":0.247,"5min":0.186,"15min":0.158},"max":{"1min":9.5030000000000001,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.171,"5min":0.85899999999999999,"15min":0.89500000000000002},"min":{"1min":0.26900000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":9.5510000000000002,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":0.23100000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.62,"15min":0.80500000000000005},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.89900000000000002,"5min":6.1929999999999996,"15min":7.3499999999999996},"last":1.123},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.94499999999999995,"15min":1.022},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":0.93799999999999994,"5min":7.6189999999999998,"15min":9.4649999999999999},"last":1.1579999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6399217664,"data_stored":10294712933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10391429120,"data_stored":16677674931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3991007232,"data_stored":6381757774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:34:18.176 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:34:18.176 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:34:18.177 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:34:20.025 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:34:20.021+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:34:20.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:20.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:20.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:20.969+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:20.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:20.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:20.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:20.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:20.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:20.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:20.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:20.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:20.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:20.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:21.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:20.997+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:21.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:21.009+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:21.022 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:21.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:21.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:21.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:22.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:22.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:22.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:22.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:22.229 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:22.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:22.254 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:22.249+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:22.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:22.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:22.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:22.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:22.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:22.301+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:22.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:22.309+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:22.318 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:22.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:22.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:22.309+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:29.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:29.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:29.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:29.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:29.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:29.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:29.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:29.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:29.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:29.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.213+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:29.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:29.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:29.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:29.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:29.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:29.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:29.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:29.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:29.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:29.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:29.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:29.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.445+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:29.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:29.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:29.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:30.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:30.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:30.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:30.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:30.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:30.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:30.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:30.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.257+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:30.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:30.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:30.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.257+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:30.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:30.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:30.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:34:30.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.277+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:30.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:30.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:30.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:30.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.309+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:30.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:30.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:30.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:30.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:30.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:30.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.341+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:30.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:30.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:30.341+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:30.576 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:34:30.573+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:34:31.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:31.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:31.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:31.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:31.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:31.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:31.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:31.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:31.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:31.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:31.525 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:31.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:31.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:31.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:31.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:31.525+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:31.533 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:31.529+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:31.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:31.549+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:31.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:31.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:31.589 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:31.585+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:35.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:35.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:35.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:35.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:35.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:35.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:35.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:35.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:35.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:35.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:35.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:35.417+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:35.446 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:35.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:35.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:35.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:35.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:35.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:35.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:35.441+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:35.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:35.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:35.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:35.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:36.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:36.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:36.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:36.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:36.485 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:36.481+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:36.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:36.501+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:36.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:36.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:36.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:36.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:36.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:36.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:36.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:36.513+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:36.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:36.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:36.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:36.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:38.178 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:34:39.083 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:34:39.084 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:34:39.143 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3007,"stamp":"2023-10-14T01:34:37.880924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30555656659,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2587395,"num_read_kb":10082264,"num_write":2544954,"num_write_kb":10178351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80256,"ondisk_log_size":80256,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24369920,"kb_used_data":20356884,"kb_used_omap":3078,"kb_used_meta":4009913,"kb_avail":258745600,"statfs":{"total":289910292480,"available":264955494400,"internally_reserved":0,"allocated":20845449216,"data_stored":33416306868,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3152535,"internal_metadata":4106151273},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,8,8,17,8,6,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11493376,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2908,"num_read_kb":11596,"num_write":2951,"num_write_kb":11804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002958"},"pg_stats":[{"pgid":"2.7","version":"172'326853","reported_seq":640140,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:34:32.795714+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:34:32.795714+0000","last_peered":"2023-10-14T01:34:32.795714+0000","last_clean":"2023-10-14T01:34:32.795714+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:34:32.795714+0000","last_undegraded":"2023-10-14T01:34:32.795714+0000","last_fullsized":"2023-10-14T01:34:32.795714+0000","mapping_epoch":13,"log_start":"170'316817","ondisk_log_start":"170'316817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3718378008,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":314725,"num_read_kb":1225736,"num_write":308376,"num_write_kb":1233157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"172'344534","reported_seq":677801,"reported_epoch":172,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:34:32.796423+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:34:32.796423+0000","last_peered":"2023-10-14T01:34:32.796423+0000","last_clean":"2023-10-14T01:34:32.796423+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:34:32.796423+0000","last_undegraded":"2023-10-14T01:34:32.796423+0000","last_fullsized":"2023-10-14T01:34:32.796423+0000","mapping_epoch":13,"log_start":"170'334520","ondisk_log_start":"170'334520","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1697,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 618s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3932578010,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":336250,"num_read_kb":1300704,"num_write":326552,"num_write_kb":1305737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"172'320652","reported_seq":630654,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:34:32.762112+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:34:32.762112+0000","last_peered":"2023-10-14T01:34:32.762112+0000","last_clean":"2023-10-14T01:34:32.762112+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:34:32.762112+0000","last_undegraded":"2023-10-14T01:34:32.762112+0000","last_fullsized":"2023-10-14T01:34:32.762112+0000","mapping_epoch":13,"log_start":"170'310627","ondisk_log_start":"170'310627","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3690889920,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":311476,"num_read_kb":1216859,"num_write":307143,"num_write_kb":1228262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"172'318237","reported_seq":629507,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:34:32.735321+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:34:32.735321+0000","last_peered":"2023-10-14T01:34:32.735321+0000","last_clean":"2023-10-14T01:34:32.735321+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:34:32.735321+0000","last_undegraded":"2023-10-14T01:34:32.735321+0000","last_fullsized":"2023-10-14T01:34:32.735321+0000","mapping_epoch":13,"log_start":"170'308222","ondisk_log_start":"170'308222","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3709133482,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":312692,"num_read_kb":1225100,"num_write":309710,"num_write_kb":1238589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"173'322042","reported_seq":642126,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-14T01:34:36.470231+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:34:36.470231+0000","last_peered":"2023-10-14T01:34:36.470231+0000","last_clean":"2023-10-14T01:34:36.470231+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:34:36.470231+0000","last_undegraded":"2023-10-14T01:34:36.470231+0000","last_fullsized":"2023-10-14T01:34:36.470231+0000","mapping_epoch":13,"log_start":"170'312023","ondisk_log_start":"170'312023","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10019,"log_dups_size":0,"ondisk_log_size":10019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3782701577,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":321686,"num_read_kb":1248282,"num_write":315440,"num_write_kb":1261281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"173'324725","reported_seq":643604,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-14T01:34:37.010704+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:34:37.010704+0000","last_peered":"2023-10-14T01:34:37.010704+0000","last_clean":"2023-10-14T01:34:37.010704+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:34:37.010704+0000","last_undegraded":"2023-10-14T01:34:37.010704+0000","last_fullsized":"2023-10-14T01:34:37.010704+0000","mapping_epoch":13,"log_start":"170'314712","ondisk_log_start":"170'314712","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3829838142,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":320260,"num_read_kb":1257878,"num_write":319123,"num_write_kb":1276331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"173'326642","reported_seq":648295,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-14T01:34:37.000593+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:34:37.000593+0000","last_peered":"2023-10-14T01:34:37.000593+0000","last_clean":"2023-10-14T01:34:37.000593+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:34:37.000593+0000","last_undegraded":"2023-10-14T01:34:37.000593+0000","last_fullsized":"2023-10-14T01:34:37.000593+0000","mapping_epoch":13,"log_start":"170'316616","ondisk_log_start":"170'316616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10026,"log_dups_size":0,"ondisk_log_size":10026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3865166375,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":322830,"num_read_kb":1269428,"num_write":320994,"num_write_kb":1283839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"172'370525","reported_seq":716335,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:34:32.731347+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:34:32.731347+0000","last_peered":"2023-10-14T01:34:32.731347+0000","last_clean":"2023-10-14T01:34:32.731347+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:34:32.731347+0000","last_undegraded":"2023-10-14T01:34:32.731347+0000","last_fullsized":"2023-10-14T01:34:32.731347+0000","mapping_epoch":13,"log_start":"170'360516","ondisk_log_start":"170'360516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4026380777,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":347370,"num_read_kb":1338186,"num_write":337479,"num_write_kb":1349261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":358,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-10-14T01:33:25.534310+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:33:25.534310+0000","last_peered":"2023-10-14T01:33:25.534310+0000","last_clean":"2023-10-14T01:33:25.534310+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:33:25.534310+0000","last_undegraded":"2023-10-14T01:33:25.534310+0000","last_fullsized":"2023-10-14T01:33:25.534310+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30555066291,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2587289,"num_read_kb":10082173,"num_write":2544817,"num_write_kb":10176457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20843003904,"data_stored":33415495526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80157,"ondisk_log_size":80157,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739501,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5430664,"kb_used_data":3911608,"kb_used_omap":726,"kb_used_meta":1518313,"kb_avail":88941176,"statfs":{"total":96636764160,"available":91075764224,"internally_reserved":0,"allocated":4005486592,"data_stored":6395335513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1554753404},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,2,7],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.68799999999999994,"15min":0.77700000000000002},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":1.5469999999999999,"5min":6.9279999999999999,"15min":10.981999999999999},"last":0.377},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.75,"15min":0.82999999999999996},"min":{"1min":0.317,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":1.5780000000000001,"5min":6.9669999999999996,"15min":11.039},"last":0.44500000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.94999999999999996,"15min":0.86799999999999999},"min":{"1min":0.223,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":4.0599999999999996,"5min":6.4870000000000001,"15min":11.846},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.53400000000000003,"15min":0.66800000000000004},"min":{"1min":0.25800000000000001,"5min":0.245,"15min":0.222},"max":{"1min":0.68700000000000006,"5min":5.101,"15min":8.1899999999999995},"last":0.41399999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739479,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10875020,"kb_used_data":10174204,"kb_used_omap":1209,"kb_used_meta":699590,"kb_avail":83496820,"statfs":{"total":96636764160,"available":85500743680,"internally_reserved":0,"allocated":10418384896,"data_stored":16704266955,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1238971,"internal_metadata":716380229},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,7,3,10,8,6,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.248,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.5779999999999998,"5min":5.6529999999999996,"15min":6.673},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.80800000000000005,"15min":0.72499999999999998},"min":{"1min":0.251,"5min":0.224,"15min":0.185},"max":{"1min":2.5379999999999998,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":0.378}]},{"osd":2,"last update":"Sat Oct 14 01:34:00 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.544,"15min":1.76},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":8.7170000000000005,"5min":14.208,"15min":17.547999999999998},"last":3.008},{"interface":"front","average":{"1min":1.3600000000000001,"5min":0.76100000000000001,"15min":0.85599999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":15.897,"5min":15.897,"15min":18.399999999999999},"last":0.55100000000000005}]}]},{"osd":0,"up_from":8,"seq":34359739500,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064236,"kb_used_data":6271072,"kb_used_omap":1142,"kb_used_meta":1792009,"kb_avail":86307604,"statfs":{"total":96636764160,"available":88378986496,"internally_reserved":0,"allocated":6421577728,"data_stored":10316704400,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1170008,"internal_metadata":1835017640},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,0,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:34:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.0620000000000001,"15min":1.0169999999999999},"min":{"1min":0.247,"5min":0.186,"15min":0.158},"max":{"1min":9.5030000000000001,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":1.171,"5min":0.85899999999999999,"15min":0.89500000000000002},"min":{"1min":0.26900000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":9.5510000000000002,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":2.855}]},{"osd":2,"last update":"Sat Oct 14 01:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.62,"15min":0.80500000000000005},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.89900000000000002,"5min":6.1929999999999996,"15min":7.3499999999999996},"last":3.0190000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.94499999999999995,"15min":1.022},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":0.93799999999999994,"5min":7.6189999999999998,"15min":9.4649999999999999},"last":0.35899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6420746240,"data_stored":10316241509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10418024448,"data_stored":16704270259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4004233216,"data_stored":6394983758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:34:39.145 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:34:39.145 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:34:39.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:39.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:39.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:39.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:39.350 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:39.345+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:39.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:39.353+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:39.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:39.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:40.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:40.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:40.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:40.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:40.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:40.433+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:40.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:40.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:40.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:40.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:40.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:40.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:40.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:40.493+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:40.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:40.497+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:40.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:40.501+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:40.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:40.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:40.508 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:40.501+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:41.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:41.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:41.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:41.661+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:41.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:41.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:41.718 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:41.709+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:41.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:41.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:41.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:41.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:41.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:41.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:41.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:41.717+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:41.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:41.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:41.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:41.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:42.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:42.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.293+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:42.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:42.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:42.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:42.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:42.396 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:42.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:42.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.397+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:42.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:42.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.401+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:42.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:42.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:42.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:34:42.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.585+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:42.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:42.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:42.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:42.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:42.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.629+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:42.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:42.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:42.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.629+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:42.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:42.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:42.629+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:43.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:34:43.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:34:43.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:43.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.201+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:43.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:43.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:43.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:43.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:43.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:43.284 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.281+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:43.291 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.285+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:43.293 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:43.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.301+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:43.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.301+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:43.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.301+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:43.516 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:43.542 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:43.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:43.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.529+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:43.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:43.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:43.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:43.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.669+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:43.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.677+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:43.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:43.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:43.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:43.874 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:34:43.869+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:34:44.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:34:44.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:34:44.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:44.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:44.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:44.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.029+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:44.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:44.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:44.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:44.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:44.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:44.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.077+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:44.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.085+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:44.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:44.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:44.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:46.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:46.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:46.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:46.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:46.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:46.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:46.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:46.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:46.577 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:46.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:46.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:46.601+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:46.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:46.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:46.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:46.617+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:46.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:46.617+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:46.623 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:46.617+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:46.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:46.617+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:46.624 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:46.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:49.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:49.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:49.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:49.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:49.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:49.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:49.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:49.325+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:49.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:49.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:49.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:49.381+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:49.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:49.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:49.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:49.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:50.395 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:34:50.393+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:34:52.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:52.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.145+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:52.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:52.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:52.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:52.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:52.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:52.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.261+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:52.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.261+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:52.272 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.269+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:52.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.297+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:52.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:52.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.297+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:52.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:34:52.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:52.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:52.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:52.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:52.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:52.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:52.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:52.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:52.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:52.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.709+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:52.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:52.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:52.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:53.744 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:34:53.741+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:34:55.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:55.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:55.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:55.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:55.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:55.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:55.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.385+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:55.416 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.405+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:55.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.417+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:55.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.417+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:55.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:55.890 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.885+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:55.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:55.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:55.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:55.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:55.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:55.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:55.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:55.915 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:55.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.909+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:55.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:55.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:55.909+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:56.239 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:56.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:56.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.245+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:56.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.317+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:56.322 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.317+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:56.338 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.333+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:56.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.365+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:56.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:56.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.365+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:56.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:34:56.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:56.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:56.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:56.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:56.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:56.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.725+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:56.730 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.725+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:56.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.733+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:56.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.765+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:56.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:56.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:56.765+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:57.347 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:57.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:57.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:57.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:57.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:57.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:57.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:57.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:57.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:57.393+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:57.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:57.393+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:57.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:57.393+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:57.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:57.393+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:57.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:57.393+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:57.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:57.393+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:58.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.525+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:58.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:34:58.553 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:58.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:58.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:58.555 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.549+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:58.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:34:58.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:58.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:58.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:58.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.669+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:58.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.669+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:58.679 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.669+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:58.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:58.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:58.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:58.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:58.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:58.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.937+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:58.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.941+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:58.950 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.945+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:58.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:58.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:58.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:59.051 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:34:59.049+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:34:59.146 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:34:59.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:59.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:34:59.928 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:34:59.929 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:34:59.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:59.957+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:34:59.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:59.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:34:59.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:59.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:34:59.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:59.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:34:59.975 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:59.973+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:34:59.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:59.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:34:59.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:59.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:34:59.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:59.973+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:34:59.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:59.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:34:59.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:34:59.973+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:34:59.994 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3019,"stamp":"2023-10-14T01:34:59.888665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30595666387,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2597340,"num_read_kb":10121932,"num_write":2555277,"num_write_kb":10219643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80634,"ondisk_log_size":80634,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24462716,"kb_used_data":20437540,"kb_used_omap":3158,"kb_used_meta":4021993,"kb_avail":258652804,"statfs":{"total":289910292480,"available":264860471296,"internally_reserved":0,"allocated":20928040960,"data_stored":33498879103,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3234039,"internal_metadata":4118521609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,9,5,5,8,22,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17367040,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4390,"num_read_kb":17508,"num_write":4489,"num_write_kb":17956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.004674"},"pg_stats":[{"pgid":"2.7","version":"174'328316","reported_seq":642948,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:34:58.595453+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:34:58.595453+0000","last_peered":"2023-10-14T01:34:58.595453+0000","last_clean":"2023-10-14T01:34:58.595453+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:34:58.595453+0000","last_undegraded":"2023-10-14T01:34:58.595453+0000","last_fullsized":"2023-10-14T01:34:58.595453+0000","mapping_epoch":13,"log_start":"170'318217","ondisk_log_start":"170'318217","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10099,"log_dups_size":0,"ondisk_log_size":10099,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3723911704,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":316052,"num_read_kb":1231028,"num_write":309776,"num_write_kb":1238757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"174'346254","reported_seq":681115,"reported_epoch":174,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:34:58.585073+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:34:58.585073+0000","last_peered":"2023-10-14T01:34:58.585073+0000","last_clean":"2023-10-14T01:34:58.585073+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:34:58.585073+0000","last_undegraded":"2023-10-14T01:34:58.585073+0000","last_fullsized":"2023-10-14T01:34:58.585073+0000","mapping_epoch":13,"log_start":"170'336220","ondisk_log_start":"170'336220","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1726,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 644s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3939041498,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":337818,"num_read_kb":1306964,"num_write":328190,"num_write_kb":1312289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"174'322043","reported_seq":633425,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:34:58.571710+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:34:58.571710+0000","last_peered":"2023-10-14T01:34:58.571710+0000","last_clean":"2023-10-14T01:34:58.571710+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:34:58.571710+0000","last_undegraded":"2023-10-14T01:34:58.571710+0000","last_fullsized":"2023-10-14T01:34:58.571710+0000","mapping_epoch":13,"log_start":"170'312027","ondisk_log_start":"170'312027","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10016,"log_dups_size":0,"ondisk_log_size":10016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3696075456,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":312839,"num_read_kb":1222299,"num_write":308494,"num_write_kb":1233666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"174'319591","reported_seq":632177,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:34:58.538028+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:34:58.538028+0000","last_peered":"2023-10-14T01:34:58.538028+0000","last_clean":"2023-10-14T01:34:58.538028+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:34:58.538028+0000","last_undegraded":"2023-10-14T01:34:58.538028+0000","last_fullsized":"2023-10-14T01:34:58.538028+0000","mapping_epoch":13,"log_start":"170'309522","ondisk_log_start":"170'309522","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3714196138,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":313998,"num_read_kb":1230308,"num_write":311043,"num_write_kb":1243921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"174'323144","reported_seq":644194,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:34:56.745617+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:34:56.745617+0000","last_peered":"2023-10-14T01:34:56.745617+0000","last_clean":"2023-10-14T01:34:56.745617+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:34:56.745617+0000","last_undegraded":"2023-10-14T01:34:56.745617+0000","last_fullsized":"2023-10-14T01:34:56.745617+0000","mapping_epoch":13,"log_start":"170'313123","ondisk_log_start":"170'313123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10021,"log_dups_size":0,"ondisk_log_size":10021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3786908169,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":322640,"num_read_kb":1252074,"num_write":316527,"num_write_kb":1265629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"174'325812","reported_seq":645747,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:34:57.185996+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:34:57.185996+0000","last_peered":"2023-10-14T01:34:57.185996+0000","last_clean":"2023-10-14T01:34:57.185996+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:34:57.185996+0000","last_undegraded":"2023-10-14T01:34:57.185996+0000","last_fullsized":"2023-10-14T01:34:57.185996+0000","mapping_epoch":13,"log_start":"170'315712","ondisk_log_start":"170'315712","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3833999678,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":321312,"num_read_kb":1262070,"num_write":320203,"num_write_kb":1280651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"174'327714","reported_seq":650449,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:34:57.144530+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:34:57.144530+0000","last_peered":"2023-10-14T01:34:57.144530+0000","last_clean":"2023-10-14T01:34:57.144530+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:34:57.144530+0000","last_undegraded":"2023-10-14T01:34:57.144530+0000","last_fullsized":"2023-10-14T01:34:57.144530+0000","mapping_epoch":13,"log_start":"170'317616","ondisk_log_start":"170'317616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3869299239,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":323909,"num_read_kb":1273740,"num_write":322059,"num_write_kb":1288099,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"174'372014","reported_seq":719153,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:34:58.561605+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:34:58.561605+0000","last_peered":"2023-10-14T01:34:58.561605+0000","last_clean":"2023-10-14T01:34:58.561605+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:34:58.561605+0000","last_undegraded":"2023-10-14T01:34:58.561605+0000","last_fullsized":"2023-10-14T01:34:58.561605+0000","mapping_epoch":13,"log_start":"170'361916","ondisk_log_start":"170'361916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10098,"log_dups_size":0,"ondisk_log_size":10098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4031644137,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":348666,"num_read_kb":1343358,"num_write":338848,"num_write_kb":1354737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":360,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-14T01:34:35.582183+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:34:35.582183+0000","last_peered":"2023-10-14T01:34:35.582183+0000","last_clean":"2023-10-14T01:34:35.582183+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:34:35.582183+0000","last_undegraded":"2023-10-14T01:34:35.582183+0000","last_fullsized":"2023-10-14T01:34:35.582183+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30595076019,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2597234,"num_read_kb":10121841,"num_write":2555140,"num_write_kb":10217749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20925059072,"data_stored":33497550694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80535,"ondisk_log_size":80535,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739505,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5479528,"kb_used_data":3924384,"kb_used_omap":726,"kb_used_meta":1554409,"kb_avail":88892312,"statfs":{"total":96636764160,"available":91025727488,"internally_reserved":0,"allocated":4018569216,"data_stored":6408413249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1591715708},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,1,0,1,3,4,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.68799999999999994,"15min":0.77700000000000002},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":1.5469999999999999,"5min":6.9279999999999999,"15min":10.981999999999999},"last":4.2679999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.75,"15min":0.82999999999999996},"min":{"1min":0.317,"5min":0.27400000000000002,"15min":0.23699999999999999},"max":{"1min":1.5780000000000001,"5min":6.9669999999999996,"15min":11.039},"last":4.2949999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:34:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.94999999999999996,"15min":0.86799999999999999},"min":{"1min":0.223,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":4.0599999999999996,"5min":6.4870000000000001,"15min":11.846},"last":5.9450000000000003},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.53400000000000003,"15min":0.66800000000000004},"min":{"1min":0.25800000000000001,"5min":0.245,"15min":0.222},"max":{"1min":0.68700000000000006,"5min":5.101,"15min":8.1899999999999995},"last":6.593}]}]},{"osd":1,"up_from":8,"seq":34359739484,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11101308,"kb_used_data":10220020,"kb_used_omap":1209,"kb_used_meta":880070,"kb_avail":83270532,"statfs":{"total":96636764160,"available":85269024768,"internally_reserved":0,"allocated":10465300480,"data_stored":16751172806,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1238971,"internal_metadata":901191749},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,5,5,2,3,16,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.248,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.5779999999999998,"5min":5.6529999999999996,"15min":6.673},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.80800000000000005,"15min":0.72499999999999998},"min":{"1min":0.251,"5min":0.224,"15min":0.185},"max":{"1min":2.5379999999999998,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":0.25700000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:34:00 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.544,"15min":1.76},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":8.7170000000000005,"5min":14.208,"15min":17.547999999999998},"last":4.1950000000000003},{"interface":"front","average":{"1min":1.3600000000000001,"5min":0.76100000000000001,"15min":0.85599999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":15.897,"5min":15.897,"15min":18.399999999999999},"last":4.2690000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739504,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7881880,"kb_used_data":6293136,"kb_used_omap":1222,"kb_used_meta":1587513,"kb_avail":86489960,"statfs":{"total":96636764160,"available":88565719040,"internally_reserved":0,"allocated":6444171264,"data_stored":10339293048,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1251512,"internal_metadata":1625614152},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,0,2,2,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:34:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.0620000000000001,"15min":1.0169999999999999},"min":{"1min":0.247,"5min":0.186,"15min":0.158},"max":{"1min":9.5030000000000001,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":1.171,"5min":0.85899999999999999,"15min":0.89500000000000002},"min":{"1min":0.26900000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":9.5510000000000002,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":0.32200000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:34:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.62,"15min":0.80500000000000005},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.89900000000000002,"5min":6.1929999999999996,"15min":7.3499999999999996},"last":0.373},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.94499999999999995,"15min":1.022},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":0.93799999999999994,"5min":7.6189999999999998,"15min":9.4649999999999999},"last":0.35799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6443569152,"data_stored":10339064421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10464075776,"data_stored":16750321587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4017414144,"data_stored":6408164686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:34:59.995 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:34:59.996 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:35:00.176 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:35:00.173+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:35:00.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:00.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:00.497 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.493+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:00.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.513+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:00.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.517+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:00.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.517+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:00.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.545+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:00.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:00.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:00.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:00.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.925+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:00.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:00.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:00.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:00.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:00.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.953+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:00.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.989+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:00.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.993+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:00.998 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:00.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:00.993+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:01.002 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:35:00.997+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:35:01.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:01.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.265+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:01.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:01.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:01.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.269+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:01.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.285+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:01.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.337+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:01.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.337+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:01.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.349+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:01.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.421+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:01.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:01.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.421+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:01.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:01.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:01.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:01.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:01.466 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.461+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:01.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.469+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:01.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:01.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:01.476 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:01.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:01.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:01.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:01.477+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:02.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.776+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:02.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:02.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:02.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:02.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:02.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:02.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:02.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:02.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:02.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:02.883 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:02.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:02.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:02.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:02.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:03.122 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:03.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:03.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:03.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:03.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.196+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:03.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.208+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:03.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:03.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:03.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.240+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:03.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.244+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:03.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.256+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:03.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:03.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.256+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:03.287 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.284+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:03.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:35:03.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:03.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:03.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:03.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:03.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:03.353 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:03.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:03.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:03.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:03.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:03.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.396+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:03.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:03.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:03.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:04.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:04.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:04.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:04.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:04.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:04.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:04.972 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:04.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:04.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:04.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:05.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:04.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:05.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:04.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:05.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:04.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:05.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:04.992+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:05.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:04.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:05.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:04.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:05.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:05.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:35:05.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:05.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:05.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:05.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.104+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:05.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:05.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:05.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:05.123 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:05.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.116+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:05.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:05.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:05.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:05.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:05.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:05.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:05.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:05.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.640+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:05.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:05.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:05.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:09.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:09.704+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:09.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:09.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:09.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:09.728+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:09.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:09.760+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:09.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:09.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:09.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:09.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:09.852+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:09.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:09.872+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:09.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:09.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:09.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:09.876+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:11.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:11.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:11.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:11.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:11.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:11.844+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:11.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:11.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:12.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:12.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:12.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:12.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:12.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:12.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:12.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:12.016 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:12.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:12.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:12.017 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:12.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:12.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:12.018 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:12.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:12.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:12.019 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.008+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:12.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:12.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.380+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:12.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:12.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.388+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:12.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:12.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:12.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:12.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.400+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:12.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:12.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:12.400+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:13.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:13.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.444+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:13.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:13.465 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:13.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:13.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:13.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:13.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.516+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:13.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:13.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.516+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:13.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.532+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:13.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:13.543 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.540+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:13.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.552+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:13.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:13.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:13.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.588+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:13.598 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:35:13.592+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:35:13.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.676+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:13.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.708+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:13.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:13.712 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:13.708+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:14.112 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:14.108+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:14.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:14.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:14.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:14.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:14.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:14.152+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:14.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:14.152+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:14.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:14.152+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:14.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:14.152+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:14.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:14.152+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:15.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:15.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:15.916 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:15.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:15.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:15.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:15.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:15.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:16.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:15.992+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:16.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.024+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:16.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:16.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.040+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:16.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:16.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.040+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:16.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:16.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:16.360 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:16.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:16.383 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.384+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:16.397 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:35:16.396+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:35:16.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.420+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:16.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.460+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:16.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.468+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:16.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:16.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:16.468+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:17.400 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:17.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:17.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:17.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:17.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:17.400+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:17.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:17.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:17.445 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:17.440+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:17.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:17.464+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:17.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:17.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:17.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:17.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:17.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:17.488+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:17.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:17.500+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:17.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:17.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:17.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:17.500+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:19.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.088+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:19.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:19.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:19.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.172+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:19.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:19.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:19.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.196+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:19.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.216+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:19.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:19.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:19.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:19.696 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:19.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:19.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.712+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:19.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:19.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:19.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.728+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:19.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:19.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:19.728+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:19.997 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:35:20.671 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:35:20.672 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:35:20.711 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3029,"stamp":"2023-10-14T01:35:19.900708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30629564883,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2606014,"num_read_kb":10156536,"num_write":2563990,"num_write_kb":10254495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80559,"ondisk_log_size":80559,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24823904,"kb_used_data":20506500,"kb_used_omap":3158,"kb_used_meta":4314217,"kb_avail":258291616,"statfs":{"total":289910292480,"available":264490614784,"internally_reserved":0,"allocated":20998656000,"data_stored":33569494143,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3234039,"internal_metadata":4417758985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,6,0,5,11,7,33,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22376448,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5710,"num_read_kb":22780,"num_write":5755,"num_write_kb":23020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005030"},"pg_stats":[{"pgid":"2.7","version":"174'329482","reported_seq":645264,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:19.173587+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:35:19.173587+0000","last_peered":"2023-10-14T01:35:19.173587+0000","last_clean":"2023-10-14T01:35:19.173587+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:35:19.173587+0000","last_undegraded":"2023-10-14T01:35:19.173587+0000","last_fullsized":"2023-10-14T01:35:19.173587+0000","mapping_epoch":13,"log_start":"170'319417","ondisk_log_start":"170'319417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3728249368,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":317189,"num_read_kb":1235572,"num_write":310870,"num_write_kb":1243133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"174'347581","reported_seq":683689,"reported_epoch":174,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:35:19.169917+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:35:19.169917+0000","last_peered":"2023-10-14T01:35:19.169917+0000","last_clean":"2023-10-14T01:35:19.169917+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:35:19.169917+0000","last_undegraded":"2023-10-14T01:35:19.169917+0000","last_fullsized":"2023-10-14T01:35:19.169917+0000","mapping_epoch":13,"log_start":"171'337520","ondisk_log_start":"171'337520","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1775,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 664s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3943854298,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":339043,"num_read_kb":1311852,"num_write":329414,"num_write_kb":1317185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"174'323176","reported_seq":635724,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:19.113184+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:35:19.113184+0000","last_peered":"2023-10-14T01:35:19.113184+0000","last_clean":"2023-10-14T01:35:19.113184+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:35:19.113184+0000","last_undegraded":"2023-10-14T01:35:19.113184+0000","last_fullsized":"2023-10-14T01:35:19.113184+0000","mapping_epoch":13,"log_start":"170'313127","ondisk_log_start":"170'313127","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3700294336,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":313998,"num_read_kb":1226923,"num_write":309579,"num_write_kb":1238006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"174'320697","reported_seq":634333,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:19.147409+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:35:19.147409+0000","last_peered":"2023-10-14T01:35:19.147409+0000","last_clean":"2023-10-14T01:35:19.147409+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:35:19.147409+0000","last_undegraded":"2023-10-14T01:35:19.147409+0000","last_fullsized":"2023-10-14T01:35:19.147409+0000","mapping_epoch":13,"log_start":"170'310622","ondisk_log_start":"170'310622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3718353578,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":315043,"num_read_kb":1234484,"num_write":312124,"num_write_kb":1248245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"174'324223","reported_seq":646315,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:16.761496+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:35:16.761496+0000","last_peered":"2023-10-14T01:35:16.761496+0000","last_clean":"2023-10-14T01:35:16.761496+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:35:16.761496+0000","last_undegraded":"2023-10-14T01:35:16.761496+0000","last_fullsized":"2023-10-14T01:35:16.761496+0000","mapping_epoch":13,"log_start":"170'314123","ondisk_log_start":"170'314123","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3791069705,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":323669,"num_read_kb":1256174,"num_write":317597,"num_write_kb":1269909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"174'326912","reported_seq":647932,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:17.367439+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:35:17.367439+0000","last_peered":"2023-10-14T01:35:17.367439+0000","last_clean":"2023-10-14T01:35:17.367439+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:35:17.367439+0000","last_undegraded":"2023-10-14T01:35:17.367439+0000","last_fullsized":"2023-10-14T01:35:17.367439+0000","mapping_epoch":13,"log_start":"170'316812","ondisk_log_start":"170'316812","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10100,"log_dups_size":0,"ondisk_log_size":10100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3838206270,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":322393,"num_read_kb":1266374,"num_write":321293,"num_write_kb":1285011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"174'328723","reported_seq":652403,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:17.355259+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:35:17.355259+0000","last_peered":"2023-10-14T01:35:17.355259+0000","last_clean":"2023-10-14T01:35:17.355259+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:35:17.355259+0000","last_undegraded":"2023-10-14T01:35:17.355259+0000","last_fullsized":"2023-10-14T01:35:17.355259+0000","mapping_epoch":13,"log_start":"170'318716","ondisk_log_start":"170'318716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3873243687,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":324854,"num_read_kb":1277504,"num_write":323058,"num_write_kb":1292095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"174'373219","reported_seq":721433,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:19.145263+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:35:19.145263+0000","last_peered":"2023-10-14T01:35:19.145263+0000","last_clean":"2023-10-14T01:35:19.145263+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:35:19.145263+0000","last_undegraded":"2023-10-14T01:35:19.145263+0000","last_fullsized":"2023-10-14T01:35:19.145263+0000","mapping_epoch":13,"log_start":"171'363216","ondisk_log_start":"171'363216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10003,"log_dups_size":0,"ondisk_log_size":10003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4035703273,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":349719,"num_read_kb":1347562,"num_write":339918,"num_write_kb":1359017,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":360,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-14T01:34:35.582183+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:34:35.582183+0000","last_peered":"2023-10-14T01:34:35.582183+0000","last_clean":"2023-10-14T01:34:35.582183+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:34:35.582183+0000","last_undegraded":"2023-10-14T01:34:35.582183+0000","last_fullsized":"2023-10-14T01:34:35.582183+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30628974515,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2605908,"num_read_kb":10156445,"num_write":2563853,"num_write_kb":10252601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20996288512,"data_stored":33568780134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80460,"ondisk_log_size":80460,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739509,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5577876,"kb_used_data":3936652,"kb_used_omap":726,"kb_used_meta":1640489,"kb_avail":88793964,"statfs":{"total":96636764160,"available":90925019136,"internally_reserved":0,"allocated":4031131648,"data_stored":6420975681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1679861628},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,6,0,0,1,2,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:35:14 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.73799999999999999,"15min":0.77700000000000002},"min":{"1min":0.19800000000000001,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":4.2679999999999998,"5min":6.9279999999999999,"15min":10.981999999999999},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.78900000000000003,"15min":0.82999999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":4.2949999999999999,"5min":6.9669999999999996,"15min":11.039},"last":0.29499999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.016,"15min":0.92200000000000004},"min":{"1min":0.20599999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":7.5910000000000002,"5min":7.5910000000000002,"15min":11.846},"last":2.3969999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.59399999999999997,"15min":0.69399999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.222},"max":{"1min":6.593,"5min":6.593,"15min":8.1899999999999995},"last":2.3820000000000001}]}]},{"osd":1,"up_from":8,"seq":34359739488,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11239992,"kb_used_data":10254636,"kb_used_omap":1209,"kb_used_meta":984134,"kb_avail":83131848,"statfs":{"total":96636764160,"available":85127012352,"internally_reserved":0,"allocated":10500747264,"data_stored":16786619590,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1238971,"internal_metadata":1007753285},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,7,5,30,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.26900000000000002,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":4.3040000000000003,"5min":5.6529999999999996,"15min":6.673},"last":3.9969999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.83399999999999996,"15min":0.755},"min":{"1min":0.25700000000000001,"5min":0.224,"15min":0.185},"max":{"1min":6.5659999999999998,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":3.9529999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:35:04 2023","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.726,"15min":1.7809999999999999},"min":{"1min":0.23599999999999999,"5min":0.186,"15min":0.186},"max":{"1min":8.9819999999999993,"5min":14.208,"15min":17.547999999999998},"last":4.4930000000000003},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.82599999999999996,"15min":0.89500000000000002},"min":{"1min":0.23400000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":4.5540000000000003,"5min":15.897,"15min":18.399999999999999},"last":0.30599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739508,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8006036,"kb_used_data":6315212,"kb_used_omap":1222,"kb_used_meta":1689593,"kb_avail":86365804,"statfs":{"total":96636764160,"available":88438583296,"internally_reserved":0,"allocated":6466777088,"data_stored":10361898872,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1251512,"internal_metadata":1730144072},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,5,3,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:35:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.84099999999999997,"15min":1.006},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.158},"max":{"1min":1.0149999999999999,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.78400000000000003,"15min":0.88400000000000001},"min":{"1min":0.221,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.855,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":0.29799999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:35:12 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.66000000000000003,"15min":0.83099999999999996},"min":{"1min":0.32500000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":4.3659999999999997,"5min":6.1929999999999996,"15min":7.3499999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.0569999999999999,"5min":0.77700000000000002,"15min":1.038},"min":{"1min":0.246,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":4.4569999999999999,"5min":6.2190000000000003,"15min":9.4649999999999999},"last":0.49199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6466019328,"data_stored":10361514597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10500063232,"data_stored":16786309043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4030205952,"data_stored":6420956494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:35:20.712 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:35:20.713 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:35:20.944 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:20.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:20.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:20.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:20.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:20.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:20.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:20.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:20.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:20.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:20.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:20.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:20.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:20.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:20.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:20.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:20.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:20.984+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:20.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:20.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:20.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:20.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:22.994 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:35:22.992+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:35:22.994 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:35:22.992+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:35:23.116 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:23.149 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:23.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:23.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:23.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:23.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:23.182 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.180+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:23.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.200+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:23.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.208+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:23.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.208+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:23.209 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.208+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:23.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:23.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:23.871 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:23.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.900+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:23.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:23.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:23.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.932+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:23.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.932+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:23.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:23.932+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:25.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:25.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:25.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:25.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:25.800 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:25.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:25.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:25.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:25.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:25.852+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:25.870 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:25.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:25.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:25.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:25.894 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:25.892+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:25.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:25.896+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:25.943 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:25.936+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:25.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:25.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:25.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:25.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:26.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:26.448+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:26.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:26.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:26.469 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:26.460+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:26.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:26.472+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:26.477 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:26.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:26.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:26.480+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:26.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:26.480+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:26.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:26.480+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:26.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:26.480+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:27.118 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:27.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:27.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:27.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:27.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:27.156+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:27.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:27.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:27.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:27.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:27.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:27.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:27.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:27.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:27.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:27.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:27.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:27.184+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:27.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:27.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:27.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:27.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:30.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:30.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:30.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:30.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:30.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:30.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:30.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:30.908+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:30.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:30.952+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:30.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:30.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:30.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:30.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:30.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:30.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:30.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:30.992+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:31.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:31.028+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:31.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:31.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:31.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:31.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:32.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:32.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:32.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:32.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:32.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:32.904+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:32.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:32.912+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:32.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:32.944+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:32.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:32.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:32.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:32.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:34.427 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:34.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.436+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:34.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:34.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:34.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.456+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:34.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:34.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:34.571 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:34.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:34.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:34.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.564+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:34.572 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:34.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:34.564+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:36.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:36.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:36.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:36.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:36.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:36.320+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:36.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:36.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:36.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:36.336+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:36.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:36.336+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:36.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:36.372+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:36.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:36.372+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:36.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:36.372+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:36.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:36.372+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:37.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:37.240+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:37.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:37.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:37.288 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:37.288+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:37.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:37.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:37.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:37.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:37.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:37.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:37.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:37.312+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:37.314 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:37.312+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:37.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:37.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:37.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:37.320+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:37.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:37.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:37.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:37.320+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:39.157 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:35:39.152+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:35:40.518 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:40.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.556+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:40.578 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:40.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:40.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:40.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:40.585 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.572+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:40.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:40.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.592+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:40.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.600+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:40.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.608+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:40.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:40.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:40.608+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:40.715 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:35:41.499 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:35:41.500 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:35:41.559 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3039,"stamp":"2023-10-14T01:35:39.909463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30664053203,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2614770,"num_read_kb":10191476,"num_write":2572849,"num_write_kb":10289931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80454,"ondisk_log_size":80454,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25262276,"kb_used_data":20576804,"kb_used_omap":3158,"kb_used_meta":4682281,"kb_avail":257853244,"statfs":{"total":289910292480,"available":264041721856,"internally_reserved":0,"allocated":21070647296,"data_stored":33641485439,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3234039,"internal_metadata":4794656521},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1,8,12,9,11,27],"upper_bound":256},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22257664,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5628,"num_read_kb":22464,"num_write":5733,"num_write_kb":22932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002683"},"pg_stats":[{"pgid":"2.7","version":"174'330527","reported_seq":647307,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:39.522259+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:35:39.522259+0000","last_peered":"2023-10-14T01:35:39.522259+0000","last_clean":"2023-10-14T01:35:39.522259+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:35:39.522259+0000","last_undegraded":"2023-10-14T01:35:39.522259+0000","last_fullsized":"2023-10-14T01:35:39.522259+0000","mapping_epoch":13,"log_start":"171'320517","ondisk_log_start":"171'320517","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10010,"log_dups_size":0,"ondisk_log_size":10010,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3732214296,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":318178,"num_read_kb":1239520,"num_write":311879,"num_write_kb":1247169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"174'348814","reported_seq":686102,"reported_epoch":174,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:35:39.533275+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:35:39.533275+0000","last_peered":"2023-10-14T01:35:39.533275+0000","last_clean":"2023-10-14T01:35:39.533275+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:35:39.533275+0000","last_undegraded":"2023-10-14T01:35:39.533275+0000","last_fullsized":"2023-10-14T01:35:39.533275+0000","mapping_epoch":13,"log_start":"171'338720","ondisk_log_start":"171'338720","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1815,"log_size":10094,"log_dups_size":0,"ondisk_log_size":10094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 685s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3948306650,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":340212,"num_read_kb":1316520,"num_write":330577,"num_write_kb":1321837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"174'324315","reported_seq":637998,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:39.522002+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:35:39.522002+0000","last_peered":"2023-10-14T01:35:39.522002+0000","last_clean":"2023-10-14T01:35:39.522002+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:35:39.522002+0000","last_undegraded":"2023-10-14T01:35:39.522002+0000","last_fullsized":"2023-10-14T01:35:39.522002+0000","mapping_epoch":13,"log_start":"171'314227","ondisk_log_start":"171'314227","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3704615616,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":315126,"num_read_kb":1231415,"num_write":310694,"num_write_kb":1242466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"174'321823","reported_seq":636524,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:39.509472+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:35:39.509472+0000","last_peered":"2023-10-14T01:35:39.509472+0000","last_clean":"2023-10-14T01:35:39.509472+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:35:39.509472+0000","last_undegraded":"2023-10-14T01:35:39.509472+0000","last_fullsized":"2023-10-14T01:35:39.509472+0000","mapping_epoch":13,"log_start":"171'311822","ondisk_log_start":"171'311822","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3722695338,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":316104,"num_read_kb":1238720,"num_write":313238,"num_write_kb":1252701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"174'325253","reported_seq":648410,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:36.928231+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:35:36.928231+0000","last_peered":"2023-10-14T01:35:36.928231+0000","last_clean":"2023-10-14T01:35:36.928231+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:35:36.928231+0000","last_undegraded":"2023-10-14T01:35:36.928231+0000","last_fullsized":"2023-10-14T01:35:36.928231+0000","mapping_epoch":13,"log_start":"171'315223","ondisk_log_start":"171'315223","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3795116553,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":324722,"num_read_kb":1260374,"num_write":318621,"num_write_kb":1274005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"174'328123","reported_seq":650226,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:37.516285+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:35:37.516285+0000","last_peered":"2023-10-14T01:35:37.516285+0000","last_clean":"2023-10-14T01:35:37.516285+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:35:37.516285+0000","last_undegraded":"2023-10-14T01:35:37.516285+0000","last_fullsized":"2023-10-14T01:35:37.516285+0000","mapping_epoch":13,"log_start":"171'318112","ondisk_log_start":"171'318112","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3842859326,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":323473,"num_read_kb":1270686,"num_write":322496,"num_write_kb":1289823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"174'329907","reported_seq":654800,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:37.510892+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:35:37.510892+0000","last_peered":"2023-10-14T01:35:37.510892+0000","last_clean":"2023-10-14T01:35:37.510892+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:35:37.510892+0000","last_undegraded":"2023-10-14T01:35:37.510892+0000","last_fullsized":"2023-10-14T01:35:37.510892+0000","mapping_epoch":13,"log_start":"171'319816","ondisk_log_start":"171'319816","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10091,"log_dups_size":0,"ondisk_log_size":10091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3877909031,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":326058,"num_read_kb":1282308,"num_write":324234,"num_write_kb":1296799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"174'374346","reported_seq":723656,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:39.469794+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:35:39.469794+0000","last_peered":"2023-10-14T01:35:39.469794+0000","last_clean":"2023-10-14T01:35:39.469794+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:35:39.469794+0000","last_undegraded":"2023-10-14T01:35:39.469794+0000","last_fullsized":"2023-10-14T01:35:39.469794+0000","mapping_epoch":13,"log_start":"171'364316","ondisk_log_start":"171'364316","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10030,"log_dups_size":0,"ondisk_log_size":10030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4039746025,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":350791,"num_read_kb":1351842,"num_write":340973,"num_write_kb":1363237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":360,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-14T01:34:35.582183+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:34:35.582183+0000","last_peered":"2023-10-14T01:34:35.582183+0000","last_clean":"2023-10-14T01:34:35.582183+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:34:35.582183+0000","last_undegraded":"2023-10-14T01:34:35.582183+0000","last_fullsized":"2023-10-14T01:34:35.582183+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30663462835,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2614664,"num_read_kb":10191385,"num_write":2572712,"num_write_kb":10288037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21068656640,"data_stored":33641148262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80355,"ondisk_log_size":80355,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739513,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5647148,"kb_used_data":3950244,"kb_used_omap":726,"kb_used_meta":1696169,"kb_avail":88724692,"statfs":{"total":96636764160,"available":90854084608,"internally_reserved":0,"allocated":4045049856,"data_stored":6434893889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1736877948},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1,0,2,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:35:14 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.73799999999999999,"15min":0.77700000000000002},"min":{"1min":0.19800000000000001,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":4.2679999999999998,"5min":6.9279999999999999,"15min":10.981999999999999},"last":4.8410000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.78900000000000003,"15min":0.82999999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":4.2949999999999999,"5min":6.9669999999999996,"15min":11.039},"last":4.8810000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.016,"15min":0.92200000000000004},"min":{"1min":0.20599999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":7.5910000000000002,"5min":7.5910000000000002,"15min":11.846},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.59399999999999997,"15min":0.69399999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.222},"max":{"1min":6.593,"5min":6.593,"15min":8.1899999999999995},"last":0.39400000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739492,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11502016,"kb_used_data":10289588,"kb_used_omap":1209,"kb_used_meta":1211206,"kb_avail":82869824,"statfs":{"total":96636764160,"available":84858699776,"internally_reserved":0,"allocated":10536538112,"data_stored":16822410438,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1238971,"internal_metadata":1240275013},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,5,8,8,7,22],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.26900000000000002,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":4.3040000000000003,"5min":5.6529999999999996,"15min":6.673},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.83399999999999996,"15min":0.755},"min":{"1min":0.25700000000000001,"5min":0.224,"15min":0.185},"max":{"1min":6.5659999999999998,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":0.27900000000000003}]},{"osd":2,"last update":"Sat Oct 14 01:35:04 2023","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.726,"15min":1.7809999999999999},"min":{"1min":0.23599999999999999,"5min":0.186,"15min":0.186},"max":{"1min":8.9819999999999993,"5min":14.208,"15min":17.547999999999998},"last":0.313},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.82599999999999996,"15min":0.89500000000000002},"min":{"1min":0.23400000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":4.5540000000000003,"5min":15.897,"15min":18.399999999999999},"last":0.52500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739512,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8113112,"kb_used_data":6336972,"kb_used_omap":1222,"kb_used_meta":1774905,"kb_avail":86258728,"statfs":{"total":96636764160,"available":88328937472,"internally_reserved":0,"allocated":6489059328,"data_stored":10384181112,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1251512,"internal_metadata":1817503560},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,3,1,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:35:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.84099999999999997,"15min":1.006},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.158},"max":{"1min":1.0149999999999999,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.307},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.78400000000000003,"15min":0.88400000000000001},"min":{"1min":0.221,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.855,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":0.29099999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:35:12 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.66000000000000003,"15min":0.83099999999999996},"min":{"1min":0.32500000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":4.3659999999999997,"5min":6.1929999999999996,"15min":7.3499999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":1.0569999999999999,"5min":0.77700000000000002,"15min":1.038},"min":{"1min":0.246,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":4.4569999999999999,"5min":6.2190000000000003,"15min":9.4649999999999999},"last":0.33200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6488121344,"data_stored":10383616613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10536357888,"data_stored":16822603699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4044177408,"data_stored":6434927950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:35:41.561 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:35:41.562 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:35:42.598 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:35:42.596+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:35:42.602 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:35:42.600+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:35:43.323 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.316+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:43.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:43.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:43.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:43.379 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:43.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:43.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.404+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:43.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:43.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.416+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:43.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:43.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:43.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.416+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:43.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:43.420 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.416+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:43.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.824+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:35:43.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:43.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:43.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:43.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:43.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:43.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.876+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:43.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.880+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:43.893 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:43.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:43.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:43.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.900+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:43.900 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:43.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:43.900+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:44.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:44.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.280+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:44.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:44.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:44.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:44.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:44.331 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:44.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:44.374 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.372+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:44.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:44.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:44.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.408+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:44.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:44.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.408+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:44.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:44.512 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.512+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:44.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:44.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.536+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:44.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:44.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:44.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.556+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:44.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:44.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:44.556+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:45.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:45.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:45.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:45.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:45.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:45.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:45.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:45.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:45.352 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:45.352+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:45.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:45.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:45.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:45.392+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:45.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:45.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:45.392 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:45.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:45.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:45.396+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:45.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:45.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:45.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:45.396+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:45.490 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:35:45.488+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:35:46.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:46.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.452+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:46.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:46.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.468+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:46.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.480+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:46.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:46.484 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.484+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:46.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:46.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.508+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:46.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:46.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.508+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:46.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:46.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.796+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:46.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:46.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.804+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:46.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:46.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.836+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:46.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:46.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:46.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.836+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:46.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:46.840 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.836+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:46.897 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.892+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:46.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:46.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.912+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:46.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.916+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:46.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:46.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:46.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:46.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.988+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:46.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:46.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:46.988+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:47.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:47.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:47.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.120+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:47.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.124+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:47.150 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:47.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:47.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:47.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.164+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:47.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.164+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:47.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:47.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:47.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:47.988 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.988+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:47.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:47.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:47.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:48.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:48.008+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:48.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:48.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:48.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:48.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:48.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:48.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:48.028+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:50.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:50.432+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:50.520 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:50.516+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:50.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:50.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:50.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:50.520+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:50.532 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:50.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:50.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:50.536+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:50.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:50.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:50.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:50.536+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:53.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:53.276+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:53.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:53.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:53.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:53.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:53.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:53.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:53.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:53.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:53.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:53.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:53.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:53.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:53.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:53.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:53.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:53.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:53.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:53.308+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:53.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:53.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:53.310 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:53.308+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:54.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:54.099 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.100+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:54.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.112+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:54.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.116+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:54.154 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.148+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:54.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:54.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:54.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:54.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:54.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.220+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:54.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.224+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:54.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:54.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.224+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:54.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.872+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:54.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:54.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:54.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:54.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:54.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:54.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.904+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:54.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:54.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:54.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:54.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.920+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:54.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:54.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.920+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:55.006 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:54.996+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:35:55.021 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.020+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:35:55.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.048+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:35:55.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:55.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:55.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.056+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:55.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:55.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:55.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:55.069 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.068+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:55.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.072+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:55.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.088+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:55.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.092+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:55.107 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:55.108+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:55.379 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:35:55.376+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:35:56.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:56.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:56.294 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:56.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:56.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:56.292+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:56.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:56.300+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:56.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:56.328+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:56.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:56.340+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:56.351 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:56.352+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:56.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:56.360+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:56.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:56.360+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:56.369 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:56.364+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:58.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:58.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:58.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:58.831+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:58.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:58.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:58.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:58.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:58.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:58.839+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:58.856 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:58.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:58.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:58.859+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:58.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:58.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:58.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:58.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:35:59.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:59.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:35:59.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:59.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:35:59.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:59.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:35:59.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:59.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:35:59.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:59.023+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:35:59.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:59.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:35:59.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:59.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:35:59.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:59.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:35:59.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:59.055+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:35:59.058 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:59.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:35:59.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:35:59.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:00.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:00.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:00.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:00.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:00.588 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:00.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:00.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:00.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:00.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:00.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:00.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:00.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:00.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:00.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:00.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:00.627+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:00.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:00.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:00.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:00.627+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:01.563 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:36:02.384 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:36:02.385 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:36:02.449 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3050,"stamp":"2023-10-14T01:36:01.923335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30697968083,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2623423,"num_read_kb":10226032,"num_write":2581617,"num_write_kb":10325003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80512,"ondisk_log_size":80512,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25466016,"kb_used_data":20647040,"kb_used_omap":3158,"kb_used_meta":4815785,"kb_avail":257649504,"statfs":{"total":289910292480,"available":263833092096,"internally_reserved":0,"allocated":21142568960,"data_stored":33713403007,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3234039,"internal_metadata":4931364617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,3,7,8,10,17,11],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":16920576,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4274,"num_read_kb":17072,"num_write":4364,"num_write_kb":17456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004766"},"pg_stats":[{"pgid":"2.7","version":"174'331632","reported_seq":649441,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:59.918460+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:35:59.918460+0000","last_peered":"2023-10-14T01:35:59.918460+0000","last_clean":"2023-10-14T01:35:59.918460+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:35:59.918460+0000","last_undegraded":"2023-10-14T01:35:59.918460+0000","last_fullsized":"2023-10-14T01:35:59.918460+0000","mapping_epoch":13,"log_start":"171'321617","ondisk_log_start":"171'321617","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10015,"log_dups_size":0,"ondisk_log_size":10015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3736240664,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":319202,"num_read_kb":1243600,"num_write":312921,"num_write_kb":1251337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"174'350064","reported_seq":688512,"reported_epoch":174,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:35:59.942587+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:35:59.942587+0000","last_peered":"2023-10-14T01:35:59.942587+0000","last_clean":"2023-10-14T01:35:59.942587+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:35:59.942587+0000","last_undegraded":"2023-10-14T01:35:59.942587+0000","last_fullsized":"2023-10-14T01:35:59.942587+0000","mapping_epoch":13,"log_start":"171'340020","ondisk_log_start":"171'340020","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1869,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 705s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3952726234,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":341347,"num_read_kb":1321056,"num_write":331721,"num_write_kb":1326413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"174'325420","reported_seq":640148,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:59.868137+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:35:59.868137+0000","last_peered":"2023-10-14T01:35:59.868137+0000","last_clean":"2023-10-14T01:35:59.868137+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:35:59.868137+0000","last_undegraded":"2023-10-14T01:35:59.868137+0000","last_fullsized":"2023-10-14T01:35:59.868137+0000","mapping_epoch":13,"log_start":"171'315327","ondisk_log_start":"171'315327","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3708662464,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":316164,"num_read_kb":1235563,"num_write":311757,"num_write_kb":1246718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"174'322961","reported_seq":638787,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:59.864983+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:35:59.864983+0000","last_peered":"2023-10-14T01:35:59.864983+0000","last_clean":"2023-10-14T01:35:59.864983+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:35:59.864983+0000","last_undegraded":"2023-10-14T01:35:59.864983+0000","last_fullsized":"2023-10-14T01:35:59.864983+0000","mapping_epoch":13,"log_start":"171'312922","ondisk_log_start":"171'312922","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3726967466,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":317224,"num_read_kb":1243192,"num_write":314355,"num_write_kb":1257169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"174'326324","reported_seq":650474,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:57.165224+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:35:57.165224+0000","last_peered":"2023-10-14T01:35:57.165224+0000","last_clean":"2023-10-14T01:35:57.165224+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:35:57.165224+0000","last_undegraded":"2023-10-14T01:35:57.165224+0000","last_fullsized":"2023-10-14T01:35:57.165224+0000","mapping_epoch":13,"log_start":"171'316323","ondisk_log_start":"171'316323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10001,"log_dups_size":0,"ondisk_log_size":10001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3799286281,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":325706,"num_read_kb":1264294,"num_write":319680,"num_write_kb":1278241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"174'329208","reported_seq":652452,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:57.596045+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:35:57.596045+0000","last_peered":"2023-10-14T01:35:57.596045+0000","last_clean":"2023-10-14T01:35:57.596045+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:35:57.596045+0000","last_undegraded":"2023-10-14T01:35:57.596045+0000","last_fullsized":"2023-10-14T01:35:57.596045+0000","mapping_epoch":13,"log_start":"171'319112","ondisk_log_start":"171'319112","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3847082302,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":324607,"num_read_kb":1275218,"num_write":323571,"num_write_kb":1294123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"174'331076","reported_seq":657168,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:57.566414+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:35:57.566414+0000","last_peered":"2023-10-14T01:35:57.566414+0000","last_clean":"2023-10-14T01:35:57.566414+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:35:57.566414+0000","last_undegraded":"2023-10-14T01:35:57.566414+0000","last_fullsized":"2023-10-14T01:35:57.566414+0000","mapping_epoch":13,"log_start":"171'321016","ondisk_log_start":"171'321016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10060,"log_dups_size":0,"ondisk_log_size":10060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3882467879,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":327253,"num_read_kb":1287088,"num_write":325393,"num_write_kb":1301435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"174'375581","reported_seq":725934,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:35:59.871992+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:35:59.871992+0000","last_peered":"2023-10-14T01:35:59.871992+0000","last_clean":"2023-10-14T01:35:59.871992+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:35:59.871992+0000","last_undegraded":"2023-10-14T01:35:59.871992+0000","last_fullsized":"2023-10-14T01:35:59.871992+0000","mapping_epoch":13,"log_start":"171'365516","ondisk_log_start":"171'365516","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4043944425,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":351814,"num_read_kb":1355930,"num_write":342082,"num_write_kb":1367673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":360,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-14T01:34:35.582183+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:34:35.582183+0000","last_peered":"2023-10-14T01:34:35.582183+0000","last_clean":"2023-10-14T01:34:35.582183+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:34:35.582183+0000","last_undegraded":"2023-10-14T01:34:35.582183+0000","last_fullsized":"2023-10-14T01:34:35.582183+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30697377715,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2623317,"num_read_kb":10225941,"num_write":2581480,"num_write_kb":10323109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21140381696,"data_stored":33712844646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80413,"ondisk_log_size":80413,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739517,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5727764,"kb_used_data":3964228,"kb_used_omap":726,"kb_used_meta":1762793,"kb_avail":88644076,"statfs":{"total":96636764160,"available":90771533824,"internally_reserved":0,"allocated":4059369472,"data_stored":6449213505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1805100924},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,4,3,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:35:14 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.73799999999999999,"15min":0.77700000000000002},"min":{"1min":0.19800000000000001,"5min":0.17699999999999999,"15min":0.17399999999999999},"max":{"1min":4.2679999999999998,"5min":6.9279999999999999,"15min":10.981999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.78900000000000003,"15min":0.82999999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.23699999999999999},"max":{"1min":4.2949999999999999,"5min":6.9669999999999996,"15min":11.039},"last":0.40100000000000002}]},{"osd":1,"last update":"Sat Oct 14 01:35:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.016,"15min":0.92200000000000004},"min":{"1min":0.20599999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":7.5910000000000002,"5min":7.5910000000000002,"15min":11.846},"last":1.367},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.59399999999999997,"15min":0.69399999999999995},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.222},"max":{"1min":6.593,"5min":6.593,"15min":8.1899999999999995},"last":0.372}]}]},{"osd":1,"up_from":8,"seq":34359739496,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11527672,"kb_used_data":10324720,"kb_used_omap":1209,"kb_used_meta":1201734,"kb_avail":82844168,"statfs":{"total":96636764160,"available":84832428032,"internally_reserved":0,"allocated":10572513280,"data_stored":16858381510,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1238971,"internal_metadata":1230575685},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,2,3,5,5,4,8],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:35:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.26900000000000002,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":4.3040000000000003,"5min":5.6529999999999996,"15min":6.673},"last":0.315},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.83399999999999996,"15min":0.755},"min":{"1min":0.25700000000000001,"5min":0.224,"15min":0.185},"max":{"1min":6.5659999999999998,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":0.29699999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:35:04 2023","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.726,"15min":1.7809999999999999},"min":{"1min":0.23599999999999999,"5min":0.186,"15min":0.186},"max":{"1min":8.9819999999999993,"5min":14.208,"15min":17.547999999999998},"last":0.25},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.82599999999999996,"15min":0.89500000000000002},"min":{"1min":0.23400000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":4.5540000000000003,"5min":15.897,"15min":18.399999999999999},"last":0.45000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359739516,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8210580,"kb_used_data":6358092,"kb_used_omap":1222,"kb_used_meta":1851257,"kb_avail":86161260,"statfs":{"total":96636764160,"available":88229130240,"internally_reserved":0,"allocated":6510686208,"data_stored":10405807992,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1251512,"internal_metadata":1895688008},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,3,2,6,10],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:35:12 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.84099999999999997,"15min":1.006},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.158},"max":{"1min":1.0149999999999999,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":5.2439999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.78400000000000003,"15min":0.88400000000000001},"min":{"1min":0.221,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":2.855,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":0.23699999999999999}]},{"osd":2,"last update":"Sat Oct 14 01:35:12 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.66000000000000003,"15min":0.83099999999999996},"min":{"1min":0.32500000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":4.3659999999999997,"5min":6.1929999999999996,"15min":7.3499999999999996},"last":5.5099999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":0.77700000000000002,"15min":1.038},"min":{"1min":0.246,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":4.4569999999999999,"5min":6.2190000000000003,"15min":9.4649999999999999},"last":2.7130000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6509912064,"data_stored":10405407333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10572603392,"data_stored":16858820531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4057866240,"data_stored":6448616782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:36:02.451 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:36:02.452 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:36:02.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:02.551+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:02.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:02.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:02.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:02.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:02.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:02.615+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:02.629 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:02.627+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:02.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:02.643+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:02.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:02.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:02.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:02.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:02.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:02.643+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:02.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:02.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:02.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:02.643+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:03.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:03.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:03.256 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:03.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:03.258 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:03.259 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:03.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:03.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:03.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:03.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.303+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:03.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:03.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.303+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:03.324 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:03.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:03.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:03.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:03.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:03.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.399+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:03.417 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.415+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:03.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.415+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:03.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:03.452 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.451+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:03.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:03.453 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:03.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:04.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:04.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:04.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:04.397 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:04.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:04.409 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:04.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:04.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:04.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.403+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:04.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:04.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:04.880 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:04.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:04.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:04.913 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:04.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:04.925 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:04.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.923+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:04.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:04.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:04.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.939+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:04.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:04.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:04.939+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:06.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:06.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:06.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:06.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:06.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:06.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:07.062 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:07.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.055+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:07.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:07.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.103+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:07.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.103+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:07.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.103+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:07.295 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.291+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:07.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.303+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:07.317 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.315+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:07.339 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.335+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:07.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.367+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:07.368 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.367+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:07.373 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.371+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:07.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.391+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:07.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.391+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:07.393 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.391+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:07.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:07.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.447+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:07.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:07.462 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:07.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:07.463 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.459+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:07.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:07.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:07.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:07.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.479+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:07.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:07.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.479+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:07.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:07.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:07.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.767+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:07.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.771+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:07.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:07.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.807+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:07.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.807+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:07.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:07.822 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.815+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:07.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:07.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:07.815+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:08.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:08.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:08.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:08.487+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:08.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:08.511+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:08.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:08.511+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:08.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:08.515+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:08.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:08.535+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:08.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:08.535+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:08.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:08.535+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:08.971 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:08.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:09.023 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.019+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:09.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:09.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:09.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:09.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.035+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:09.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:09.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.047+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:09.054 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:09.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.047+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:09.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:09.459 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:09.460 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.455+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:09.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.495+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:09.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.515+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:09.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.515+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:09.547 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.547+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:09.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.591+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:09.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:09.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:09.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:09.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:09.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:09.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.931+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:09.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:09.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.975+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:09.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.995+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:09.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.995+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:10.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:09.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:10.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:10.027+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:10.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:10.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:10.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:10.027+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:10.183 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:10.179+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:10.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:10.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:10.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:10.211+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:10.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:10.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:10.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:10.215+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:10.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:10.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:10.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:10.215+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:11.169 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:11.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:11.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:11.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:11.170 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:11.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:11.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:11.167+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:11.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:11.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:11.220 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:11.219+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:11.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:11.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:11.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:11.231+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:11.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:11.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:11.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:11.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:11.355 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:36:11.351+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:36:12.836 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:36:12.835+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:36:12.856 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:36:12.855+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:36:13.019 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:36:13.015+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:36:15.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:15.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:15.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:15.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:15.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:15.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:15.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:15.243+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:15.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:15.259+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:15.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:15.271+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:15.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:15.275+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:15.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:15.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:15.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:15.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:15.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:15.275+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:15.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:15.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:15.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:15.275+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:16.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:16.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:16.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:16.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:16.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:16.951+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:16.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:16.955+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:16.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:16.975+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:16.981 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:16.979+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:17.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:17.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:17.039 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:17.035+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:17.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:17.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:17.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:17.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:17.049 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:17.047+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:17.061 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:17.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:17.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:17.083+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:17.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:17.115+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:17.130 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:17.127+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:18.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.675+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:18.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:18.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:18.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:18.709 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:18.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:18.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:18.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.727+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:18.767 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.763+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:18.768 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.767+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:18.775 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.771+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:18.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:18.776 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.775+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:18.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:18.991+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:19.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:19.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.011+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:19.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:19.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.059+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:19.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.063+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:19.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.071+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:19.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:19.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:19.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:19.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.071+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:19.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:19.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:19.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:19.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:19.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:19.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:19.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.087+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:19.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.087+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:19.108 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.107+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:19.115 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.115+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:19.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:19.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:19.821 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.819+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:19.827 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:19.854 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:19.855 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:19.857 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.855+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:19.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:19.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:19.855+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:21.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:21.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:21.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:21.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:21.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:21.567+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:21.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:21.595+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:21.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:21.599+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:21.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:21.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:21.625 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:21.619+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:21.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:21.651+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:21.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:21.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:21.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:21.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:21.670 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:21.663+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:21.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:21.727+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:22.454 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:36:23.388 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:36:23.388 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:36:23.441 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3061,"stamp":"2023-10-14T01:36:21.932867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30731846099,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2632288,"num_read_kb":10261408,"num_write":2590520,"num_write_kb":10360615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80509,"ondisk_log_size":80509,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24629564,"kb_used_data":20717220,"kb_used_omap":3159,"kb_used_meta":3909160,"kb_avail":258485956,"statfs":{"total":289910292480,"available":264689618944,"internally_reserved":0,"allocated":21214433280,"data_stored":33784679094,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3235719,"internal_metadata":4002979961},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5,1,4,7,2,13,11,5],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22192128,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5911,"num_read_kb":23600,"num_write":5843,"num_write_kb":23372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008269"},"pg_stats":[{"pgid":"2.7","version":"175'332803","reported_seq":651763,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:20.392588+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:36:20.392588+0000","last_peered":"2023-10-14T01:36:20.392588+0000","last_clean":"2023-10-14T01:36:20.392588+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:36:20.392588+0000","last_undegraded":"2023-10-14T01:36:20.392588+0000","last_fullsized":"2023-10-14T01:36:20.392588+0000","mapping_epoch":13,"log_start":"171'322717","ondisk_log_start":"171'322717","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10086,"log_dups_size":0,"ondisk_log_size":10086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3740480024,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":320336,"num_read_kb":1248112,"num_write":314022,"num_write_kb":1255741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"175'351307","reported_seq":690954,"reported_epoch":175,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:36:20.399522+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:36:20.399522+0000","last_peered":"2023-10-14T01:36:20.399522+0000","last_clean":"2023-10-14T01:36:20.399522+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:36:20.399522+0000","last_undegraded":"2023-10-14T01:36:20.399522+0000","last_fullsized":"2023-10-14T01:36:20.399522+0000","mapping_epoch":13,"log_start":"172'341220","ondisk_log_start":"172'341220","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1913,"log_size":10087,"log_dups_size":0,"ondisk_log_size":10087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 725s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3957166298,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":342528,"num_read_kb":1325772,"num_write":332869,"num_write_kb":1331005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"175'326605","reported_seq":642328,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:20.367769+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:36:20.367769+0000","last_peered":"2023-10-14T01:36:20.367769+0000","last_clean":"2023-10-14T01:36:20.367769+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:36:20.367769+0000","last_undegraded":"2023-10-14T01:36:20.367769+0000","last_fullsized":"2023-10-14T01:36:20.367769+0000","mapping_epoch":13,"log_start":"171'316527","ondisk_log_start":"171'316527","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10078,"log_dups_size":0,"ondisk_log_size":10078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3712824000,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":317149,"num_read_kb":1239503,"num_write":312896,"num_write_kb":1251274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"175'324049","reported_seq":641045,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:20.368072+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:36:20.368072+0000","last_peered":"2023-10-14T01:36:20.368072+0000","last_clean":"2023-10-14T01:36:20.368072+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:36:20.368072+0000","last_undegraded":"2023-10-14T01:36:20.368072+0000","last_fullsized":"2023-10-14T01:36:20.368072+0000","mapping_epoch":13,"log_start":"171'314022","ondisk_log_start":"171'314022","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3730969258,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":318394,"num_read_kb":1247864,"num_write":315418,"num_write_kb":1261421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"175'327351","reported_seq":652540,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:17.346592+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:36:17.346592+0000","last_peered":"2023-10-14T01:36:17.346592+0000","last_clean":"2023-10-14T01:36:17.346592+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:36:17.346592+0000","last_undegraded":"2023-10-14T01:36:17.346592+0000","last_fullsized":"2023-10-14T01:36:17.346592+0000","mapping_epoch":13,"log_start":"171'317323","ondisk_log_start":"171'317323","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3803185673,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":326735,"num_read_kb":1268402,"num_write":320695,"num_write_kb":1282301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"175'330420","reported_seq":654771,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:17.818611+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:36:17.818611+0000","last_peered":"2023-10-14T01:36:17.818611+0000","last_clean":"2023-10-14T01:36:17.818611+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:36:17.818611+0000","last_undegraded":"2023-10-14T01:36:17.818611+0000","last_fullsized":"2023-10-14T01:36:17.818611+0000","mapping_epoch":13,"log_start":"171'320412","ondisk_log_start":"171'320412","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3851747646,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":325709,"num_read_kb":1279618,"num_write":324776,"num_write_kb":1298943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"175'332247","reported_seq":659503,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:17.808632+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:36:17.808632+0000","last_peered":"2023-10-14T01:36:17.808632+0000","last_clean":"2023-10-14T01:36:17.808632+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:36:17.808632+0000","last_undegraded":"2023-10-14T01:36:17.808632+0000","last_fullsized":"2023-10-14T01:36:17.808632+0000","mapping_epoch":13,"log_start":"171'322216","ondisk_log_start":"171'322216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3886977575,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":328422,"num_read_kb":1291752,"num_write":326557,"num_write_kb":1306091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"175'376781","reported_seq":728256,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:20.388999+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:36:20.388999+0000","last_peered":"2023-10-14T01:36:20.388999+0000","last_clean":"2023-10-14T01:36:20.388999+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:36:20.388999+0000","last_undegraded":"2023-10-14T01:36:20.388999+0000","last_fullsized":"2023-10-14T01:36:20.388999+0000","mapping_epoch":13,"log_start":"172'366716","ondisk_log_start":"172'366716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10065,"log_dups_size":0,"ondisk_log_size":10065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4047905257,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":352909,"num_read_kb":1360294,"num_write":343150,"num_write_kb":1371945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":361,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-14T01:34:50.592011+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:34:50.592011+0000","last_peered":"2023-10-14T01:34:50.592011+0000","last_clean":"2023-10-14T01:34:50.592011+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:34:50.592011+0000","last_undegraded":"2023-10-14T01:34:50.592011+0000","last_fullsized":"2023-10-14T01:34:50.592011+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30731255731,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2632182,"num_read_kb":10261317,"num_write":2590383,"num_write_kb":10358721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21211987968,"data_stored":33783885670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80410,"ondisk_log_size":80410,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739521,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5800276,"kb_used_data":3977164,"kb_used_omap":726,"kb_used_meta":1822377,"kb_avail":88571564,"statfs":{"total":96636764160,"available":90697281536,"internally_reserved":0,"allocated":4072615936,"data_stored":6462340350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1866114940},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,0,2,4,0,7,6,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:36:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.79700000000000004,"15min":0.77400000000000002},"min":{"1min":0.23000000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.8410000000000002,"5min":6.9279999999999999,"15min":10.981999999999999},"last":0.373},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.84299999999999997,"15min":0.82699999999999996},"min":{"1min":0.29499999999999998,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":4.8810000000000002,"5min":6.9669999999999996,"15min":11.039},"last":0.40400000000000003}]},{"osd":1,"last update":"Sat Oct 14 01:36:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.012,"15min":0.91900000000000004},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":4.6310000000000002,"5min":7.5910000000000002,"15min":11.846},"last":1.601},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59799999999999998,"15min":0.67800000000000005},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.3820000000000001,"5min":6.593,"15min":8.1899999999999995},"last":1.6379999999999999}]}]},{"osd":1,"up_from":8,"seq":34359739500,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11693872,"kb_used_data":10360424,"kb_used_omap":1209,"kb_used_meta":1332230,"kb_avail":82677968,"statfs":{"total":96636764160,"available":84662239232,"internally_reserved":0,"allocated":10609074176,"data_stored":16894630275,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1238971,"internal_metadata":1364203589},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,2,2,6,5,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.19700000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":4.1929999999999996,"5min":5.6529999999999996,"15min":6.673},"last":0.318},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.86499999999999999,"15min":0.77200000000000002},"min":{"1min":0.27000000000000002,"5min":0.23400000000000001,"15min":0.185},"max":{"1min":3.9529999999999998,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":0.27700000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:36:07 2023","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.694,"15min":1.738},"min":{"1min":0.24399999999999999,"5min":0.186,"15min":0.186},"max":{"1min":11.292,"5min":11.292,"15min":17.547999999999998},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.80900000000000005,"15min":0.90100000000000002},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":5.141,"5min":15.897,"15min":18.399999999999999},"last":0.35199999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739520,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7135416,"kb_used_data":6379632,"kb_used_omap":1223,"kb_used_meta":754552,"kb_avail":87236424,"statfs":{"total":96636764160,"available":89330098176,"internally_reserved":0,"allocated":6532743168,"data_stored":10427708469,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1253192,"internal_metadata":772661432},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:36:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79700000000000004,"15min":0.97999999999999998},"min":{"1min":0.20799999999999999,"5min":0.186,"15min":0.158},"max":{"1min":5.2439999999999998,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.66300000000000003,"15min":0.84599999999999997},"min":{"1min":0.23699999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":0.35199999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:36:17 2023","interfaces":[{"interface":"back","average":{"1min":2.1509999999999998,"5min":0.96999999999999997,"15min":0.875},"min":{"1min":0.30099999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":10.576000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":1.7889999999999999,"5min":1.028,"15min":1.0780000000000001},"min":{"1min":0.29799999999999999,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":10.375999999999999,"5min":10.375999999999999,"15min":10.375999999999999},"last":0.38300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6531837952,"data_stored":10427173477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10608472064,"data_stored":16894398387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4071677952,"data_stored":6462313806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:36:23.443 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:36:23.443 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:36:24.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:24.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:24.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:24.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:24.912 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:24.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:24.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:24.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:24.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:24.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:24.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:24.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:24.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:24.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:24.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:24.919+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:24.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:24.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:24.923 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:24.919+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:25.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:25.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:25.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:25.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:25.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:25.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:25.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:25.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:25.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:25.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:25.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:25.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:25.458 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:25.451+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:25.467 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:25.467+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:25.475 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:25.475+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:25.492 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:25.491+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:25.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:25.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:25.493 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:25.491+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:27.675 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:36:27.675+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:36:28.117 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:28.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:28.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.183+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:28.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.191+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:28.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:28.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:28.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.223+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:28.226 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.223+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:28.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.239+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:28.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.243+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:28.244 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.243+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:28.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.251+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:28.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:28.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:36:28.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:28.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:28.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:28.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:28.268 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:28.281 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.279+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:28.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:28.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:28.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:28.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:28.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.299+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:28.301 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:28.302 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.299+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:28.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:28.386 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.379+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:28.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.387+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:28.391 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.391+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:28.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:28.438 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.435+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:28.455 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.451+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:28.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:28.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:28.451+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:29.362 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:36:29.359+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:36:30.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:30.205 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.199+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:30.246 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.239+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:30.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.267+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:30.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:30.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:30.297 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:30.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:30.298 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:30.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:30.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:30.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:30.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:30.295+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:31.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:31.987+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:36:32.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.039+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:32.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:32.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:32.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.055+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:32.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.071+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:32.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:32.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.079+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:32.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.079+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:32.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:32.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.163+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:32.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:32.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:32.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.195+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:32.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.219+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:32.252 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:32.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:32.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:32.253 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.251+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:32.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:32.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:32.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.331+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:32.335 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.331+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:32.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:32.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.339+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:32.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:32.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:32.339+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:33.669 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:33.663+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:36:33.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:33.671+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:33.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:33.679+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:33.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:33.699+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:33.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:33.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:33.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:33.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:33.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:33.715+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:33.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:33.723+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:33.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:33.735+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:33.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:33.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:34.307 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:34.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:34.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.295+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:34.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.307+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:34.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.327+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:34.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.375+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:34.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.375+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:34.389 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.387+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:34.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.395+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:34.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:34.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.395+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:34.408 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:34.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:34.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:34.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:34.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.431+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:34.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.491+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:34.506 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.503+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:34.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.503+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:34.521 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:34.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.519+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:34.523 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:34.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:34.519+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:37.439 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:37.435+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:37.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:37.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:37.442 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:37.439+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:37.481 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:37.479+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:37.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:37.483+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:37.544 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:37.543+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:37.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:37.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:37.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:37.563+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:37.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:37.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:37.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:37.571+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:37.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:37.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:37.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:37.571+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:39.037 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:36:39.035+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:36:39.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:39.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:39.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:39.979+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:40.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:39.999+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:40.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.007+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:40.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:40.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.095+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:40.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:40.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:40.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.095+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:40.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:40.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.095+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:40.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.839+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:40.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:40.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:40.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:40.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.907+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:40.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.911+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:40.919 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:40.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.915+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:40.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.923+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:40.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:40.923+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:41.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:41.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:41.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.027+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:41.059 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.059+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:41.129 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.115+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:41.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:41.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:41.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:41.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.179+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:41.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:41.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:41.563 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:41.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:41.564 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.563+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:41.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.571+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:41.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:41.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.575+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:41.579 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.575+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:41.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:41.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.579+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:41.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:41.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.579+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:41.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.687+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:41.713 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.707+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:41.714 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.711+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:41.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:41.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.715+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:41.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:41.736 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.735+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:41.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:41.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:41.738 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.735+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:41.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:41.739 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:41.735+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:42.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:42.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:42.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:42.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.159+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:42.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.163+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:42.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:42.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.755+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:42.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.759+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:42.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.763+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:42.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.835+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:42.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.847+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:42.850 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.847+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:42.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.851+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:42.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.863+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:42.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.919+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:36:42.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:36:42.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:42.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.939+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:42.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:42.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:42.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:42.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.963+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:43.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:42.999+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:43.094 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.091+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:36:43.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.111+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:43.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.119+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:43.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:43.124 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:43.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:43.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.123+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:43.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.143+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:43.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.147+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:43.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.147+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:43.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.155+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:43.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.179+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:43.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:43.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:43.179+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:43.445 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:36:44.205 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:36:44.206 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:36:44.251 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3072,"stamp":"2023-10-14T01:36:43.941679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30767571411,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2641530,"num_read_kb":10298292,"num_write":2600005,"num_write_kb":10398555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80599,"ondisk_log_size":80599,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":24859572,"kb_used_data":20793872,"kb_used_omap":3159,"kb_used_meta":4062504,"kb_avail":258255948,"statfs":{"total":289910292480,"available":264454090752,"internally_reserved":0,"allocated":21292924928,"data_stored":33861872310,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3235719,"internal_metadata":4160004217},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2,6,17,22,20,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19140608,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4941,"num_read_kb":19724,"num_write":5145,"num_write_kb":20580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007206"},"pg_stats":[{"pgid":"2.7","version":"175'333912","reported_seq":653968,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:40.815868+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:36:40.815868+0000","last_peered":"2023-10-14T01:36:40.815868+0000","last_clean":"2023-10-14T01:36:40.815868+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:36:40.815868+0000","last_undegraded":"2023-10-14T01:36:40.815868+0000","last_fullsized":"2023-10-14T01:36:40.815868+0000","mapping_epoch":13,"log_start":"172'323817","ondisk_log_start":"172'323817","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10095,"log_dups_size":0,"ondisk_log_size":10095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3744485912,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":321419,"num_read_kb":1252420,"num_write":315085,"num_write_kb":1259993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"175'352508","reported_seq":693273,"reported_epoch":175,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:36:40.757419+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:36:40.757419+0000","last_peered":"2023-10-14T01:36:40.757419+0000","last_clean":"2023-10-14T01:36:40.757419+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:36:40.757419+0000","last_undegraded":"2023-10-14T01:36:40.757419+0000","last_fullsized":"2023-10-14T01:36:40.757419+0000","mapping_epoch":13,"log_start":"172'342420","ondisk_log_start":"172'342420","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":1969,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 746s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3961483482,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":343626,"num_read_kb":1330156,"num_write":333984,"num_write_kb":1335465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"175'327741","reported_seq":644563,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:40.754579+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:36:40.754579+0000","last_peered":"2023-10-14T01:36:40.754579+0000","last_clean":"2023-10-14T01:36:40.754579+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:36:40.754579+0000","last_undegraded":"2023-10-14T01:36:40.754579+0000","last_fullsized":"2023-10-14T01:36:40.754579+0000","mapping_epoch":13,"log_start":"172'317727","ondisk_log_start":"172'317727","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3716989632,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":318239,"num_read_kb":1243855,"num_write":314001,"num_write_kb":1255694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"175'325071","reported_seq":643054,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:40.760363+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:36:40.760363+0000","last_peered":"2023-10-14T01:36:40.760363+0000","last_clean":"2023-10-14T01:36:40.760363+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:36:40.760363+0000","last_undegraded":"2023-10-14T01:36:40.760363+0000","last_fullsized":"2023-10-14T01:36:40.760363+0000","mapping_epoch":13,"log_start":"172'315022","ondisk_log_start":"172'315022","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10049,"log_dups_size":0,"ondisk_log_size":10049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3734659754,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":319372,"num_read_kb":1251776,"num_write":316425,"num_write_kb":1265449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"175'328574","reported_seq":654964,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:42.515129+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:36:42.515129+0000","last_peered":"2023-10-14T01:36:42.515129+0000","last_clean":"2023-10-14T01:36:42.515129+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:36:42.515129+0000","last_undegraded":"2023-10-14T01:36:42.515129+0000","last_fullsized":"2023-10-14T01:36:42.515129+0000","mapping_epoch":13,"log_start":"171'318523","ondisk_log_start":"171'318523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3807842825,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":327917,"num_read_kb":1273118,"num_write":321897,"num_write_kb":1287109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"175'331851","reported_seq":657581,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:42.955617+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:36:42.955617+0000","last_peered":"2023-10-14T01:36:42.955617+0000","last_clean":"2023-10-14T01:36:42.955617+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:36:42.955617+0000","last_undegraded":"2023-10-14T01:36:42.955617+0000","last_fullsized":"2023-10-14T01:36:42.955617+0000","mapping_epoch":13,"log_start":"172'321812","ondisk_log_start":"172'321812","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10039,"log_dups_size":0,"ondisk_log_size":10039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3857056062,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":327083,"num_read_kb":1285094,"num_write":326198,"num_write_kb":1304631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"175'333692","reported_seq":662299,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:42.961035+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:36:42.961035+0000","last_peered":"2023-10-14T01:36:42.961035+0000","last_clean":"2023-10-14T01:36:42.961035+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:36:42.961035+0000","last_undegraded":"2023-10-14T01:36:42.961035+0000","last_fullsized":"2023-10-14T01:36:42.961035+0000","mapping_epoch":13,"log_start":"172'323616","ondisk_log_start":"172'323616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10076,"log_dups_size":0,"ondisk_log_size":10076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3892347431,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":329761,"num_read_kb":1297104,"num_write":327993,"num_write_kb":1311835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"175'378004","reported_seq":730597,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:40.773974+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:36:40.773974+0000","last_peered":"2023-10-14T01:36:40.773974+0000","last_clean":"2023-10-14T01:36:40.773974+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:36:40.773974+0000","last_undegraded":"2023-10-14T01:36:40.773974+0000","last_fullsized":"2023-10-14T01:36:40.773974+0000","mapping_epoch":13,"log_start":"172'367916","ondisk_log_start":"172'367916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10088,"log_dups_size":0,"ondisk_log_size":10088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4052115945,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":354007,"num_read_kb":1364678,"num_write":344285,"num_write_kb":1376485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":362,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:05.641995+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:36:05.641995+0000","last_peered":"2023-10-14T01:36:05.641995+0000","last_clean":"2023-10-14T01:36:05.641995+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:36:05.641995+0000","last_undegraded":"2023-10-14T01:36:05.641995+0000","last_fullsized":"2023-10-14T01:36:05.641995+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30766981043,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2641424,"num_read_kb":10298201,"num_write":2599868,"num_write_kb":10396661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21289459712,"data_stored":33860013926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80500,"ondisk_log_size":80500,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739526,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5895120,"kb_used_data":3994376,"kb_used_omap":726,"kb_used_meta":1900009,"kb_avail":88476720,"statfs":{"total":96636764160,"available":90600161280,"internally_reserved":0,"allocated":4090241024,"data_stored":6479658238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1945610108},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,3,2,4,7],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:36:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.79700000000000004,"15min":0.77400000000000002},"min":{"1min":0.23000000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.8410000000000002,"5min":6.9279999999999999,"15min":10.981999999999999},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.84299999999999997,"15min":0.82699999999999996},"min":{"1min":0.29499999999999998,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":4.8810000000000002,"5min":6.9669999999999996,"15min":11.039},"last":0.34999999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:36:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.012,"15min":0.91900000000000004},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":4.6310000000000002,"5min":7.5910000000000002,"15min":11.846},"last":0.216},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59799999999999998,"15min":0.67800000000000005},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.3820000000000001,"5min":6.593,"15min":8.1899999999999995},"last":0.317}]}]},{"osd":1,"up_from":8,"seq":34359739504,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11732428,"kb_used_data":10394044,"kb_used_omap":1209,"kb_used_meta":1337158,"kb_avail":82639412,"statfs":{"total":96636764160,"available":84622757888,"internally_reserved":0,"allocated":10643501056,"data_stored":16928524675,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1238971,"internal_metadata":1369249861},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,8,17,13,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.19700000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":4.1929999999999996,"5min":5.6529999999999996,"15min":6.673},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.86499999999999999,"15min":0.77200000000000002},"min":{"1min":0.27000000000000002,"5min":0.23400000000000001,"15min":0.185},"max":{"1min":3.9529999999999998,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":0.51000000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:36:07 2023","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.694,"15min":1.738},"min":{"1min":0.24399999999999999,"5min":0.186,"15min":0.186},"max":{"1min":11.292,"5min":11.292,"15min":17.547999999999998},"last":6.7060000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.80900000000000005,"15min":0.90100000000000002},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":5.141,"5min":15.897,"15min":18.399999999999999},"last":0.371}]}]},{"osd":0,"up_from":8,"seq":34359739525,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7232024,"kb_used_data":6405452,"kb_used_omap":1223,"kb_used_meta":825336,"kb_avail":87139816,"statfs":{"total":96636764160,"available":89231171584,"internally_reserved":0,"allocated":6559182848,"data_stored":10453689397,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1253192,"internal_metadata":845144248},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,3,7,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:36:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79700000000000004,"15min":0.97999999999999998},"min":{"1min":0.20799999999999999,"5min":0.186,"15min":0.158},"max":{"1min":5.2439999999999998,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.66300000000000003,"15min":0.84599999999999997},"min":{"1min":0.23699999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":7.0720000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:36:17 2023","interfaces":[{"interface":"back","average":{"1min":2.1509999999999998,"5min":0.96999999999999997,"15min":0.875},"min":{"1min":0.30099999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":10.576000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.7889999999999999,"5min":1.028,"15min":1.0780000000000001},"min":{"1min":0.29799999999999999,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":10.375999999999999,"5min":10.375999999999999,"15min":10.375999999999999},"last":1.528}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6557569024,"data_stored":10452453989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10643206144,"data_stored":16928546739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4088684544,"data_stored":6479013198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:36:44.253 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:36:44.253 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:36:45.071 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:36:45.123 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:36:46.303 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:46.299+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:36:46.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:46.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:46.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:46.323+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:46.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:46.339+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:46.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:46.347+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:46.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:46.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:46.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:46.351+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:46.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:46.351+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:46.364 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:46.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:46.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:46.363+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:46.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:46.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:46.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:46.363+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:47.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:47.795+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:47.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:47.799+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:47.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:47.859+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:47.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:47.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:47.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:47.859+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:48.724 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:48.723+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:48.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:48.747+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:48.750 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:48.747+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:48.759 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:48.751+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:48.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:48.783+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:48.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:48.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:48.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:48.783+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:49.556 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:49.557 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:49.558 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.555+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:49.565 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.559+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:49.595 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.587+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:49.596 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.587+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:49.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.599+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:49.632 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.619+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:49.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:49.633 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.619+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:49.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.903+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:36:49.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:49.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.927+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:49.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.943+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:49.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.947+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:49.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:49.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.947+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:49.953 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:49.947+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:50.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:50.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:50.826 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:50.823+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:50.879 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:50.871+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:50.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:50.879+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:50.895 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:50.887+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:50.904 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:50.899+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:50.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:50.899+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:50.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:50.911+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:50.933 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:50.931+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:50.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:50.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:50.934 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:50.931+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:36:51.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:51.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:51.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:51.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:51.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:51.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:36:51.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:51.163+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:51.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:51.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:51.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:51.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:51.187+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:55.963 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:55.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:36:55.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:55.962+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:36:56.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:56.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:36:56.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:56.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:36:56.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:56.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:36:56.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:56.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:36:56.102 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:56.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:36:56.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:56.106+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:36:56.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:56.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:36:56.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:36:56.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:03.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:03.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:03.959 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:03.954+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:03.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:03.978+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:04.007 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:03.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:04.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:04.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:04.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.022+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:04.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.050+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:04.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.082+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:04.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.082+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:04.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.082+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:04.096 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.094+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:04.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.138+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:37:04.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:04.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:04.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:04.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:04.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:04.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:04.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:04.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:04.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.214+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:04.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.262+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:04.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:04.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.262+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:04.634 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.626+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:04.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.666+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:04.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:04.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.678+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:04.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:04.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:04.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.678+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:04.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:04.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:04.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:05.124 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:37:05.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:05.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:05.277 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:05.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.318+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:05.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:05.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.350+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:05.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.366+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:05.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.398+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:05.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:05.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.398+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:05.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:05.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:05.615 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.610+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:05.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.614+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:05.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.638+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:05.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.654+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:05.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.654+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:05.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:05.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.678+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:05.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:05.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:05.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:05.928 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:37:05.929 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:37:05.964 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3082,"stamp":"2023-10-14T01:37:03.944864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30798447059,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2649979,"num_read_kb":10332048,"num_write":2608638,"num_write_kb":10433087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80582,"ondisk_log_size":80582,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25262980,"kb_used_data":20857576,"kb_used_omap":3159,"kb_used_meta":4402216,"kb_avail":257852540,"statfs":{"total":289910292480,"available":264041000960,"internally_reserved":0,"allocated":21358157824,"data_stored":33924229814,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3235719,"internal_metadata":4507869305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,6,0,8,9,7,10,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18427904,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5127,"num_read_kb":20488,"num_write":5171,"num_write_kb":20684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001966"},"pg_stats":[{"pgid":"2.7","version":"175'335088","reported_seq":656283,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:37:01.289668+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:37:01.289668+0000","last_peered":"2023-10-14T01:37:01.289668+0000","last_clean":"2023-10-14T01:37:01.289668+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:37:01.289668+0000","last_undegraded":"2023-10-14T01:37:01.289668+0000","last_fullsized":"2023-10-14T01:37:01.289668+0000","mapping_epoch":13,"log_start":"172'325017","ondisk_log_start":"172'325017","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3748475416,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":322546,"num_read_kb":1256928,"num_write":316210,"num_write_kb":1264493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"175'353693","reported_seq":695498,"reported_epoch":175,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:37:01.287973+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:37:01.287973+0000","last_peered":"2023-10-14T01:37:01.287973+0000","last_clean":"2023-10-14T01:37:01.287973+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:37:01.287973+0000","last_undegraded":"2023-10-14T01:37:01.287973+0000","last_fullsized":"2023-10-14T01:37:01.287973+0000","mapping_epoch":13,"log_start":"172'343620","ondisk_log_start":"172'343620","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2062,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 766s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3965300954,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":344642,"num_read_kb":1334216,"num_write":335040,"num_write_kb":1339689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"175'328901","reported_seq":646864,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:37:01.220610+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:37:01.220610+0000","last_peered":"2023-10-14T01:37:01.220610+0000","last_clean":"2023-10-14T01:37:01.220610+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:37:01.220610+0000","last_undegraded":"2023-10-14T01:37:01.220610+0000","last_fullsized":"2023-10-14T01:37:01.220610+0000","mapping_epoch":13,"log_start":"172'318827","ondisk_log_start":"172'318827","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10074,"log_dups_size":0,"ondisk_log_size":10074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3721069248,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":319372,"num_read_kb":1248379,"num_write":315127,"num_write_kb":1260198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"175'326074","reported_seq":645061,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:37:01.240296+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:37:01.240296+0000","last_peered":"2023-10-14T01:37:01.240296+0000","last_clean":"2023-10-14T01:37:01.240296+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:37:01.240296+0000","last_undegraded":"2023-10-14T01:37:01.240296+0000","last_fullsized":"2023-10-14T01:37:01.240296+0000","mapping_epoch":13,"log_start":"172'316022","ondisk_log_start":"172'316022","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10052,"log_dups_size":0,"ondisk_log_size":10052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3738124970,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":320373,"num_read_kb":1255772,"num_write":317411,"num_write_kb":1269393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"175'329632","reported_seq":657070,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:37:02.790981+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:37:02.790981+0000","last_peered":"2023-10-14T01:37:02.790981+0000","last_clean":"2023-10-14T01:37:02.790981+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:37:02.790981+0000","last_undegraded":"2023-10-14T01:37:02.790981+0000","last_fullsized":"2023-10-14T01:37:02.790981+0000","mapping_epoch":13,"log_start":"172'319623","ondisk_log_start":"172'319623","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3811627529,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":328953,"num_read_kb":1277262,"num_write":322946,"num_write_kb":1291305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"175'332939","reported_seq":659684,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:37:03.068267+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:37:03.068267+0000","last_peered":"2023-10-14T01:37:03.068267+0000","last_clean":"2023-10-14T01:37:03.068267+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:37:03.068267+0000","last_undegraded":"2023-10-14T01:37:03.068267+0000","last_fullsized":"2023-10-14T01:37:03.068267+0000","mapping_epoch":13,"log_start":"172'322912","ondisk_log_start":"172'322912","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10027,"log_dups_size":0,"ondisk_log_size":10027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3860889918,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":328093,"num_read_kb":1289134,"num_write":327279,"num_write_kb":1308955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"175'334800","reported_seq":664473,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:37:03.060374+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:37:03.060374+0000","last_peered":"2023-10-14T01:37:03.060374+0000","last_clean":"2023-10-14T01:37:03.060374+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:37:03.060374+0000","last_undegraded":"2023-10-14T01:37:03.060374+0000","last_fullsized":"2023-10-14T01:37:03.060374+0000","mapping_epoch":13,"log_start":"172'324716","ondisk_log_start":"172'324716","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10084,"log_dups_size":0,"ondisk_log_size":10084,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3896394279,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":330819,"num_read_kb":1301332,"num_write":329094,"num_write_kb":1316239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"175'379209","reported_seq":732897,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:37:01.234478+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:37:01.234478+0000","last_peered":"2023-10-14T01:37:01.234478+0000","last_clean":"2023-10-14T01:37:01.234478+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:37:01.234478+0000","last_undegraded":"2023-10-14T01:37:01.234478+0000","last_fullsized":"2023-10-14T01:37:01.234478+0000","mapping_epoch":13,"log_start":"172'369116","ondisk_log_start":"172'369116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4055974377,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":355075,"num_read_kb":1368934,"num_write":345394,"num_write_kb":1380921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":362,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:05.641995+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:36:05.641995+0000","last_peered":"2023-10-14T01:36:05.641995+0000","last_clean":"2023-10-14T01:36:05.641995+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:36:05.641995+0000","last_undegraded":"2023-10-14T01:36:05.641995+0000","last_fullsized":"2023-10-14T01:36:05.641995+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30797856691,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2649873,"num_read_kb":10331957,"num_write":2608501,"num_write_kb":10431193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21354893312,"data_stored":33922518886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80483,"ondisk_log_size":80483,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739530,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5956956,"kb_used_data":4006228,"kb_used_omap":726,"kb_used_meta":1949993,"kb_avail":88414884,"statfs":{"total":96636764160,"available":90536841216,"internally_reserved":0,"allocated":4102377472,"data_stored":6491221246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":1996793724},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,1,1,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:36:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.79700000000000004,"15min":0.77400000000000002},"min":{"1min":0.23000000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":4.8410000000000002,"5min":6.9279999999999999,"15min":10.981999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.84299999999999997,"15min":0.82699999999999996},"min":{"1min":0.29499999999999998,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":4.8810000000000002,"5min":6.9669999999999996,"15min":11.039},"last":0.42399999999999999}]},{"osd":1,"last update":"Sat Oct 14 01:36:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":1.012,"15min":0.91900000000000004},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":4.6310000000000002,"5min":7.5910000000000002,"15min":11.846},"last":0.315},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.59799999999999998,"15min":0.67800000000000005},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":2.3820000000000001,"5min":6.593,"15min":8.1899999999999995},"last":0.39200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359739508,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11917068,"kb_used_data":10425984,"kb_used_omap":1209,"kb_used_meta":1489862,"kb_avail":82454772,"statfs":{"total":96636764160,"available":84433686528,"internally_reserved":0,"allocated":10676207616,"data_stored":16959818115,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1238971,"internal_metadata":1525618757},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,6,0,7,5,2,9,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.19700000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":4.1929999999999996,"5min":5.6529999999999996,"15min":6.673},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.86499999999999999,"15min":0.77200000000000002},"min":{"1min":0.27000000000000002,"5min":0.23400000000000001,"15min":0.185},"max":{"1min":3.9529999999999998,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":0.26800000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:36:07 2023","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":1.694,"15min":1.738},"min":{"1min":0.24399999999999999,"5min":0.186,"15min":0.186},"max":{"1min":11.292,"5min":11.292,"15min":17.547999999999998},"last":2.7690000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.80900000000000005,"15min":0.90100000000000002},"min":{"1min":0.224,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":5.141,"5min":15.897,"15min":18.399999999999999},"last":0.255}]}]},{"osd":0,"up_from":8,"seq":34359739529,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7388956,"kb_used_data":6425364,"kb_used_omap":1223,"kb_used_meta":962360,"kb_avail":86982884,"statfs":{"total":96636764160,"available":89070473216,"internally_reserved":0,"allocated":6579572736,"data_stored":10473190453,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1253192,"internal_metadata":985456824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:36:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79700000000000004,"15min":0.97999999999999998},"min":{"1min":0.20799999999999999,"5min":0.186,"15min":0.158},"max":{"1min":5.2439999999999998,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.19700000000000001},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.66300000000000003,"15min":0.84599999999999997},"min":{"1min":0.23699999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.48899999999999999,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":0.28299999999999997}]},{"osd":2,"last update":"Sat Oct 14 01:36:17 2023","interfaces":[{"interface":"back","average":{"1min":2.1509999999999998,"5min":0.96999999999999997,"15min":0.875},"min":{"1min":0.30099999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":10.576000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.23499999999999999},{"interface":"front","average":{"1min":1.7889999999999999,"5min":1.028,"15min":1.0780000000000001},"min":{"1min":0.29799999999999999,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":10.375999999999999,"5min":10.375999999999999,"15min":10.375999999999999},"last":0.32100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6577946624,"data_stored":10471942757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10676101120,"data_stored":16959975347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4100845568,"data_stored":6490600782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:37:05.966 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:37:05.967 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:37:08.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.382+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:37:08.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:08.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:08.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:08.434 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:08.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.450+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:08.473 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.466+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:08.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:08.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.498+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:08.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.498+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:08.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.518+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:08.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.558+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:08.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:08.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:08.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:09.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.090+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:09.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.130+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:37:09.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.134+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:09.158 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:09.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:09.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.154+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:09.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:09.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:09.202 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:09.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.222+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:09.227 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:09.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.222+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:09.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.226+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:09.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:09.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.226+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:09.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:09.236 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:37:09.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:09.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:09.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:09.274 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.270+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:09.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:09.306 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.302+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:09.319 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.314+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:09.320 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.314+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:09.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.322+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:09.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.334+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:09.336 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:09.337 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:09.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:09.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:09.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:09.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:09.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:09.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:09.468 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.462+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:09.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.494+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:09.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.494+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:09.541 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.538+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:09.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.578+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:09.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:09.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:09.578+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:12.287 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:37:12.286+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:37:13.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:13.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:13.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:13.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:13.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:13.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:13.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:13.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:13.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:13.858+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:13.884 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:13.882+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:13.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:13.882+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:13.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:13.882+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:13.885 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:13.882+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:13.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:13.882+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:13.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:13.882+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:15.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:15.186+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:15.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:15.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:15.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:15.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:15.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:15.198+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:15.204 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:15.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:15.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:15.242+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:15.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:15.258+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:15.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:15.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:15.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:15.266+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:15.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:15.306+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:15.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:15.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:15.313 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:15.306+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:16.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:16.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:16.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:16.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:16.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:16.846+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:16.858 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:16.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:16.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:16.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:16.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:16.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:16.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:16.942+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:16.962 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:16.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:16.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:16.982+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:16.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:16.982+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:16.984 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:16.982+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:18.248 INFO:tasks.ceph.osd.0.smithi191.stderr:2023-10-14T01:37:18.246+0000 7f30478aa640 -1 reset not still connected to 0x55c894026750 2023-10-14T01:37:18.402 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:18.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:18.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:18.398+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:18.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:18.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:18.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:18.410+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:18.418 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:18.414+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:18.424 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:18.422+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:18.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:18.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:18.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:18.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:18.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:18.422+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:18.425 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:18.422+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:20.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:20.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.006+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:20.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.018+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:20.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:20.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:20.033 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:20.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.054+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:20.057 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.054+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:20.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.066+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:20.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.086+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:20.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:20.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:20.357 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.350+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:20.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:20.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:20.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.354+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:20.366 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.358+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:20.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.390+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:20.422 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:20.447 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.442+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:20.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.450+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:20.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.466+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:20.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.470+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:20.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:20.472 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:20.470+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:21.041 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:21.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:21.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:21.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:21.073 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:21.076 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.074+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:21.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:21.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:21.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.078+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:21.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:21.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.078+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:21.881 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.878+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:21.898 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.890+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:37:21.899 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.898+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:21.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:21.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:21.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:21.910 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:21.929 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.922+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:21.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:22.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:22.003 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:21.994+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:22.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:22.002+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:22.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:22.006+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:22.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:22.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:22.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:22.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:23.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:23.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:23.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:23.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:23.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:23.110+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:23.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:23.114+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:23.126 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:23.122+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:23.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:23.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:23.162 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:23.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:23.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:23.198+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:23.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:23.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:23.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:23.198+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:25.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:25.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:25.278 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:25.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:25.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:25.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:25.279 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:25.274+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:25.280 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:25.278+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:25.296 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:25.290+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:25.342 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:25.334+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:25.343 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:25.334+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:25.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:25.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:25.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:25.346+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:25.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:25.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:25.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:25.346+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:25.968 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:37:26.734 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:37:26.735 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:37:26.778 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3094,"stamp":"2023-10-14T01:37:25.948556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30827962835,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2658249,"num_read_kb":10365060,"num_write":2617321,"num_write_kb":10467819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80404,"ondisk_log_size":80404,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25672132,"kb_used_data":20921176,"kb_used_omap":3159,"kb_used_meta":4747752,"kb_avail":257443388,"statfs":{"total":289910292480,"available":263622029312,"internally_reserved":0,"allocated":21423284224,"data_stored":33984782444,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3235719,"internal_metadata":4861698169},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,5,6,6,10,14,9,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14434304,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4126,"num_read_kb":16476,"num_write":4378,"num_write_kb":17512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.330577"},"pg_stats":[{"pgid":"2.7","version":"176'336179","reported_seq":658417,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:21.855844+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:37:21.855844+0000","last_peered":"2023-10-14T01:37:21.855844+0000","last_clean":"2023-10-14T01:37:21.855844+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:37:21.855844+0000","last_undegraded":"2023-10-14T01:37:21.855844+0000","last_fullsized":"2023-10-14T01:37:21.855844+0000","mapping_epoch":13,"log_start":"172'326117","ondisk_log_start":"172'326117","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10062,"log_dups_size":0,"ondisk_log_size":10062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3752043032,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":323576,"num_read_kb":1261044,"num_write":317250,"num_write_kb":1268653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"176'354828","reported_seq":697570,"reported_epoch":176,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:37:21.821999+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:37:21.821999+0000","last_peered":"2023-10-14T01:37:21.821999+0000","last_clean":"2023-10-14T01:37:21.821999+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:37:21.821999+0000","last_undegraded":"2023-10-14T01:37:21.821999+0000","last_fullsized":"2023-10-14T01:37:21.821999+0000","mapping_epoch":13,"log_start":"173'344820","ondisk_log_start":"173'344820","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2144,"log_size":10008,"log_dups_size":0,"ondisk_log_size":10008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 787s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3968655578,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":345562,"num_read_kb":1337876,"num_write":336052,"num_write_kb":1343737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"176'330083","reported_seq":649132,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:21.822303+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:37:21.822303+0000","last_peered":"2023-10-14T01:37:21.822303+0000","last_clean":"2023-10-14T01:37:21.822303+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:37:21.822303+0000","last_undegraded":"2023-10-14T01:37:21.822303+0000","last_fullsized":"2023-10-14T01:37:21.822303+0000","mapping_epoch":13,"log_start":"172'320027","ondisk_log_start":"172'320027","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3725148864,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":320453,"num_read_kb":1252695,"num_write":316277,"num_write_kb":1264798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"176'327133","reported_seq":647100,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:21.759553+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:37:21.759553+0000","last_peered":"2023-10-14T01:37:21.759553+0000","last_clean":"2023-10-14T01:37:21.759553+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:37:21.759553+0000","last_undegraded":"2023-10-14T01:37:21.759553+0000","last_fullsized":"2023-10-14T01:37:21.759553+0000","mapping_epoch":13,"log_start":"172'317122","ondisk_log_start":"172'317122","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3741643434,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":321346,"num_read_kb":1259660,"num_write":318454,"num_write_kb":1273565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"176'330704","reported_seq":659159,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:25.147060+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:37:25.147060+0000","last_peered":"2023-10-14T01:37:25.147060+0000","last_clean":"2023-10-14T01:37:25.147060+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:37:25.147060+0000","last_undegraded":"2023-10-14T01:37:25.147060+0000","last_fullsized":"2023-10-14T01:37:25.147060+0000","mapping_epoch":13,"log_start":"172'320623","ondisk_log_start":"172'320623","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10081,"log_dups_size":0,"ondisk_log_size":10081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3815154185,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":329957,"num_read_kb":1281266,"num_write":324009,"num_write_kb":1295557,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"176'333940","reported_seq":661589,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:23.145334+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:37:23.145334+0000","last_peered":"2023-10-14T01:37:23.145334+0000","last_clean":"2023-10-14T01:37:23.145334+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:37:23.145334+0000","last_undegraded":"2023-10-14T01:37:23.145334+0000","last_fullsized":"2023-10-14T01:37:23.145334+0000","mapping_epoch":13,"log_start":"172'323912","ondisk_log_start":"172'323912","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10028,"log_dups_size":0,"ondisk_log_size":10028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3864084798,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":328993,"num_read_kb":1292718,"num_write":328274,"num_write_kb":1312935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"176'336050","reported_seq":666986,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:23.131473+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:37:23.131473+0000","last_peered":"2023-10-14T01:37:23.131473+0000","last_clean":"2023-10-14T01:37:23.131473+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:37:23.131473+0000","last_undegraded":"2023-10-14T01:37:23.131473+0000","last_fullsized":"2023-10-14T01:37:23.131473+0000","mapping_epoch":13,"log_start":"172'326016","ondisk_log_start":"172'326016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10034,"log_dups_size":0,"ondisk_log_size":10034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3900830247,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":332076,"num_read_kb":1306356,"num_write":330338,"num_write_kb":1321215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"176'380441","reported_seq":735260,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:21.789664+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:37:21.789664+0000","last_peered":"2023-10-14T01:37:21.789664+0000","last_clean":"2023-10-14T01:37:21.789664+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:37:21.789664+0000","last_undegraded":"2023-10-14T01:37:21.789664+0000","last_fullsized":"2023-10-14T01:37:21.789664+0000","mapping_epoch":13,"log_start":"172'370416","ondisk_log_start":"172'370416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4059812329,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":356180,"num_read_kb":1373354,"num_write":346530,"num_write_kb":1385465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":363,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:25.443859+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:36:25.443859+0000","last_peered":"2023-10-14T01:36:25.443859+0000","last_clean":"2023-10-14T01:36:25.443859+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:36:25.443859+0000","last_undegraded":"2023-10-14T01:36:25.443859+0000","last_fullsized":"2023-10-14T01:36:25.443859+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30827372467,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2658143,"num_read_kb":10364969,"num_write":2617184,"num_write_kb":10465925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21419114496,"data_stored":33982242662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80305,"ondisk_log_size":80305,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739534,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6022868,"kb_used_data":4017988,"kb_used_omap":726,"kb_used_meta":2004137,"kb_avail":88348972,"statfs":{"total":96636764160,"available":90469347328,"internally_reserved":0,"allocated":4114419712,"data_stored":6502484368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":743556,"internal_metadata":2052237180},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,3,3,4,5,7,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.90600000000000003,"15min":0.73799999999999999},"min":{"1min":0.21199999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":5.819,"5min":6.9279999999999999,"15min":8.0719999999999992},"last":3.5209999999999999},{"interface":"front","average":{"1min":1.083,"5min":0.94699999999999995,"15min":0.79000000000000004},"min":{"1min":0.28599999999999998,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":5.8540000000000001,"5min":6.9669999999999996,"15min":8.0999999999999996},"last":3.569}]},{"osd":1,"last update":"Sat Oct 14 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.90600000000000003,"15min":0.877},"min":{"1min":0.216,"5min":0.19,"15min":0.19},"max":{"1min":1.7809999999999999,"5min":7.5910000000000002,"15min":11.846},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.57299999999999995,"15min":0.626},"min":{"1min":0.255,"5min":0.222,"15min":0.222},"max":{"1min":2.3900000000000001,"5min":6.593,"15min":8.0229999999999997},"last":3.609}]}]},{"osd":1,"up_from":8,"seq":34359739512,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12103084,"kb_used_data":10457884,"kb_used_omap":1209,"kb_used_meta":1643974,"kb_avail":82268756,"statfs":{"total":96636764160,"available":84243206144,"internally_reserved":0,"allocated":10708873216,"data_stored":16990246421,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1238971,"internal_metadata":1683429445},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3,2,6,9,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.23599999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.83399999999999996,"5min":5.6529999999999996,"15min":6.673},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.81000000000000005,"15min":0.76000000000000001},"min":{"1min":0.248,"5min":0.247,"15min":0.185},"max":{"1min":2.0070000000000001,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":0.39100000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:37:07 2023","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":1.7330000000000001,"15min":1.6759999999999999},"min":{"1min":0.20999999999999999,"5min":0.186,"15min":0.186},"max":{"1min":6.7060000000000004,"5min":11.292,"15min":17.547999999999998},"last":0.214},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.81200000000000006,"15min":0.86599999999999999},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.97999999999999998,"5min":15.897,"15min":18.399999999999999},"last":0.24399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739534,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7546180,"kb_used_data":6445304,"kb_used_omap":1223,"kb_used_meta":1099640,"kb_avail":86825660,"statfs":{"total":96636764160,"available":88909475840,"internally_reserved":0,"allocated":6599991296,"data_stored":10492051655,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1253192,"internal_metadata":1126031544},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.80500000000000005,"15min":0.96799999999999997},"min":{"1min":0.19700000000000001,"5min":0.186,"15min":0.158},"max":{"1min":6.1070000000000002,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":4.1980000000000004},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.71499999999999997,"15min":0.82299999999999995},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":7.0720000000000001,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":0.26900000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.99199999999999999,"15min":0.84899999999999998},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":2.9540000000000002,"5min":10.576000000000001,"15min":10.576000000000001},"last":4.2400000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.96699999999999997,"15min":1.0740000000000001},"min":{"1min":0.22600000000000001,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":3.3820000000000001,"5min":10.375999999999999,"15min":10.375999999999999},"last":0.44}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6598524928,"data_stored":10490964581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10707636224,"data_stored":16989351859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4112953344,"data_stored":6501926222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:37:26.779 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:37:26.780 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:37:27.005 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:27.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:27.064 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:27.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.058+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:27.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:27.066 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:27.080 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.078+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:27.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:27.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.086+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:27.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.090+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:27.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.142+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:27.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:27.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.142+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:27.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.762+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:27.794 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.782+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:27.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.786+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:27.795 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.790+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:27.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:27.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:27.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:27.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.822+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:27.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:27.830 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.822+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:27.945 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:27.942+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:28.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.026+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:37:28.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.038+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:28.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:28.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:28.071 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.066+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:28.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:28.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:28.101 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.098+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:28.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.158+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:28.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.158+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:28.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.174+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:28.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.206+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:28.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:28.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:28.814 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.810+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:28.825 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.822+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:28.834 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:28.835 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.830+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:28.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:28.836 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:28.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.842+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:28.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.850+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:28.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:28.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:28.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.850+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:28.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:28.853 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.850+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:28.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:28.995 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:28.996 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:28.997 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:28.994+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:29.004 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.002+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:29.030 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.026+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:29.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.038+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:29.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.042+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:29.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.042+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:29.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.338+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:29.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.346+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:29.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:29.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:29.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.354+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:29.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.354+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:29.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:29.399 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:29.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.402+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:29.404 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:29.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.402+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:29.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.402+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:29.907 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:37:29.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.906+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:29.939 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.934+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:29.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.970+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:29.982 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:29.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:29.983 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.974+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:29.990 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.982+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:29.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.990+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:30.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.990+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:30.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:29.998+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:30.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.006+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:30.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:30.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.006+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:30.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.046+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:30.067 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.062+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:30.092 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:30.093 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.086+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:30.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.118+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:30.134 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.130+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:30.141 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:30.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.138+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:30.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:30.142 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.138+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:30.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.178+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:30.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:30.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:30.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:30.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:30.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:30.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.194+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:30.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:30.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.194+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:30.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.194+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:30.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.206+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:30.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:30.210+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:31.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.438+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:31.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:31.449 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:31.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:31.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:31.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.502+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:31.522 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.518+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:31.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:31.539 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.534+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:31.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:31.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.558+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:31.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.574+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:31.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:31.574+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:32.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:32.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:32.940 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:32.930+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:32.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:32.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:32.941 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:32.938+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:32.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:32.958+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:32.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:32.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:32.960 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:32.958+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:32.968 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:32.966+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:32.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:32.966+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:32.969 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:32.966+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:34.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:34.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:34.591 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:34.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:34.602 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:34.598+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:34.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:34.646+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:34.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:34.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:34.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:34.658+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:34.662 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:34.658+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:34.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:34.674+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:34.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:34.678+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:34.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:34.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:34.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:34.678+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:35.114 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:37:35.110+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:37:35.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.506+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:35.514 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.510+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:35.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:35.531 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:35.540 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:35.546 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.538+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:35.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:35.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.570+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:35.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:35.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:35.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.570+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:35.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:35.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:35.570+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:37.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.342+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:37.377 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.366+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:37:37.401 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.394+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:37.423 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.418+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:37.440 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.430+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:37.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:37.448 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.446+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:37.457 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.454+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:37.482 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.478+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:37.488 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:37.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:37.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:37.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.486+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:37.489 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:37.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.486+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:37.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.486+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:37.515 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.514+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:37.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:37.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:37.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.522+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:37.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.526+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:37.538 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.534+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:37.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.550+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:37.552 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:37.554 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.550+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:37.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.558+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:37.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:37.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:37.558+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:41.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:41.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:41.797 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:41.794+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:41.813 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:41.806+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:41.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:41.826+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:41.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:41.834+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:41.865 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:41.862+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:41.866 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:41.862+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:41.872 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:41.870+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:41.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:41.926+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:41.930 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:41.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:41.931 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:41.926+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:43.025 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.014+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:43.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.022+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:43.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:43.034 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:43.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.030+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:43.047 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.042+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:43.074 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:43.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.070+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:43.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.070+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:43.089 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.074+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:43.090 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.082+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:43.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:43.109 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.106+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:43.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.558+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:43.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.566+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:43.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.582+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:43.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.586+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:43.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:43.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:43.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.586+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:43.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:43.593 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:43.586+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:44.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:44.202+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:44.238 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:44.234+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:44.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:44.238+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:44.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:44.250+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:44.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:44.254+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:44.299 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:44.294+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:44.300 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:44.294+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:44.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:44.302+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:44.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:44.326+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:44.329 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:44.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:44.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:44.326+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:46.781 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:37:46.932 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:46.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:46.954 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:46.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:46.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:46.949+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:46.980 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:46.977+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:46.987 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:46.981+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:47.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:46.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:47.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.005+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:47.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:47.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:47.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.025+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:47.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:47.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.025+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:47.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:47.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:47.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:47.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:47.441 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.437+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:47.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:47.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:47.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:47.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.445+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:47.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:47.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:47.445+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:47.472 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:37:47.473 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:37:47.510 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3104,"stamp":"2023-10-14T01:37:45.951912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30855463379,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2666615,"num_read_kb":10398484,"num_write":2625799,"num_write_kb":10501731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80508,"ondisk_log_size":80508,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25589092,"kb_used_data":20976952,"kb_used_omap":3161,"kb_used_meta":4608934,"kb_avail":257526428,"statfs":{"total":289910292480,"available":263707062272,"internally_reserved":0,"allocated":21480398848,"data_stored":34035859564,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3237399,"internal_metadata":4719548905},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,6,7,12,19,12,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14450688,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4362,"num_read_kb":17428,"num_write":4452,"num_write_kb":17808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001976"},"pg_stats":[{"pgid":"2.7","version":"176'337326","reported_seq":660632,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:42.423189+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:37:42.423189+0000","last_peered":"2023-10-14T01:37:42.423189+0000","last_clean":"2023-10-14T01:37:42.423189+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:37:42.423189+0000","last_undegraded":"2023-10-14T01:37:42.423189+0000","last_fullsized":"2023-10-14T01:37:42.423189+0000","mapping_epoch":13,"log_start":"173'327317","ondisk_log_start":"173'327317","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10009,"log_dups_size":0,"ondisk_log_size":10009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3755643416,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":324630,"num_read_kb":1265260,"num_write":318344,"num_write_kb":1273029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"176'356091","reported_seq":700019,"reported_epoch":176,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:37:42.414658+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:37:42.414658+0000","last_peered":"2023-10-14T01:37:42.414658+0000","last_clean":"2023-10-14T01:37:42.414658+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:37:42.414658+0000","last_undegraded":"2023-10-14T01:37:42.414658+0000","last_fullsized":"2023-10-14T01:37:42.414658+0000","mapping_epoch":13,"log_start":"174'346020","ondisk_log_start":"174'346020","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2176,"log_size":10071,"log_dups_size":0,"ondisk_log_size":10071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 808s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3972624602,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":346727,"num_read_kb":1342524,"num_write":337233,"num_write_kb":1348461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"176'331170","reported_seq":651300,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:42.439326+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:37:42.439326+0000","last_peered":"2023-10-14T01:37:42.439326+0000","last_clean":"2023-10-14T01:37:42.439326+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:37:42.439326+0000","last_undegraded":"2023-10-14T01:37:42.439326+0000","last_fullsized":"2023-10-14T01:37:42.439326+0000","mapping_epoch":13,"log_start":"173'321127","ondisk_log_start":"173'321127","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3728495296,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":321526,"num_read_kb":1256979,"num_write":317324,"num_write_kb":1268986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"176'328228","reported_seq":649239,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:42.430961+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:37:42.430961+0000","last_peered":"2023-10-14T01:37:42.430961+0000","last_clean":"2023-10-14T01:37:42.430961+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:37:42.430961+0000","last_undegraded":"2023-10-14T01:37:42.430961+0000","last_fullsized":"2023-10-14T01:37:42.430961+0000","mapping_epoch":13,"log_start":"172'318222","ondisk_log_start":"172'318222","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10006,"log_dups_size":0,"ondisk_log_size":10006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3745039018,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":322387,"num_read_kb":1263816,"num_write":319530,"num_write_kb":1277869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"176'331671","reported_seq":661116,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:45.303669+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:37:45.303669+0000","last_peered":"2023-10-14T01:37:45.303669+0000","last_clean":"2023-10-14T01:37:45.303669+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:37:45.303669+0000","last_undegraded":"2023-10-14T01:37:45.303669+0000","last_fullsized":"2023-10-14T01:37:45.303669+0000","mapping_epoch":13,"log_start":"172'321623","ondisk_log_start":"172'321623","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3818230281,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":330938,"num_read_kb":1285190,"num_write":324967,"num_write_kb":1299389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"176'334897","reported_seq":663563,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:43.241764+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:37:43.241764+0000","last_peered":"2023-10-14T01:37:43.241764+0000","last_clean":"2023-10-14T01:37:43.241764+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:37:43.241764+0000","last_undegraded":"2023-10-14T01:37:43.241764+0000","last_fullsized":"2023-10-14T01:37:43.241764+0000","mapping_epoch":13,"log_start":"173'324812","ondisk_log_start":"173'324812","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10085,"log_dups_size":0,"ondisk_log_size":10085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3867185470,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":330006,"num_read_kb":1296766,"num_write":329228,"num_write_kb":1316751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"176'337095","reported_seq":668994,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:43.261020+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:37:43.261020+0000","last_peered":"2023-10-14T01:37:43.261020+0000","last_clean":"2023-10-14T01:37:43.261020+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:37:43.261020+0000","last_undegraded":"2023-10-14T01:37:43.261020+0000","last_fullsized":"2023-10-14T01:37:43.261020+0000","mapping_epoch":13,"log_start":"173'327016","ondisk_log_start":"173'327016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10079,"log_dups_size":0,"ondisk_log_size":10079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3904201255,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":333036,"num_read_kb":1310192,"num_write":331380,"num_write_kb":1325383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"176'381684","reported_seq":737606,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:37:42.432969+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:37:42.432969+0000","last_peered":"2023-10-14T01:37:42.432969+0000","last_clean":"2023-10-14T01:37:42.432969+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:37:42.432969+0000","last_undegraded":"2023-10-14T01:37:42.432969+0000","last_fullsized":"2023-10-14T01:37:42.432969+0000","mapping_epoch":13,"log_start":"174'371616","ondisk_log_start":"174'371616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4063453673,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":357259,"num_read_kb":1377666,"num_write":347656,"num_write_kb":1389969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":363,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:25.443859+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:36:25.443859+0000","last_peered":"2023-10-14T01:36:25.443859+0000","last_clean":"2023-10-14T01:36:25.443859+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:36:25.443859+0000","last_undegraded":"2023-10-14T01:36:25.443859+0000","last_fullsized":"2023-10-14T01:36:25.443859+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30854873011,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2666509,"num_read_kb":10398393,"num_write":2625662,"num_write_kb":10499837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21477011456,"data_stored":34033938278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80409,"ondisk_log_size":80409,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739538,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5632340,"kb_used_data":4028364,"kb_used_omap":727,"kb_used_meta":1603240,"kb_avail":88739500,"statfs":{"total":96636764160,"available":90869248000,"internally_reserved":0,"allocated":4125044736,"data_stored":6512023952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":745236,"internal_metadata":1641717996},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.90600000000000003,"15min":0.73799999999999999},"min":{"1min":0.21199999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":5.819,"5min":6.9279999999999999,"15min":8.0719999999999992},"last":0.32800000000000001},{"interface":"front","average":{"1min":1.083,"5min":0.94699999999999995,"15min":0.79000000000000004},"min":{"1min":0.28599999999999998,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":5.8540000000000001,"5min":6.9669999999999996,"15min":8.0999999999999996},"last":0.35799999999999998}]},{"osd":1,"last update":"Sat Oct 14 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.90600000000000003,"15min":0.877},"min":{"1min":0.216,"5min":0.19,"15min":0.19},"max":{"1min":1.7809999999999999,"5min":7.5910000000000002,"15min":11.846},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.57299999999999995,"15min":0.626},"min":{"1min":0.255,"5min":0.222,"15min":0.222},"max":{"1min":2.3900000000000001,"5min":6.593,"15min":8.0229999999999997},"last":0.28799999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739516,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12298960,"kb_used_data":10486004,"kb_used_omap":1209,"kb_used_meta":1811718,"kb_avail":82072880,"statfs":{"total":96636764160,"available":84042629120,"internally_reserved":0,"allocated":10737668096,"data_stored":17016071701,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1238971,"internal_metadata":1855199301},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,6,4,5,12,10,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.23599999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.83399999999999996,"5min":5.6529999999999996,"15min":6.673},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.81000000000000005,"15min":0.76000000000000001},"min":{"1min":0.248,"5min":0.247,"15min":0.185},"max":{"1min":2.0070000000000001,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":0.23000000000000001}]},{"osd":2,"last update":"Sat Oct 14 01:37:07 2023","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":1.7330000000000001,"15min":1.6759999999999999},"min":{"1min":0.20999999999999999,"5min":0.186,"15min":0.186},"max":{"1min":6.7060000000000004,"5min":11.292,"15min":17.547999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.81200000000000006,"15min":0.86599999999999999},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.97999999999999998,"5min":15.897,"15min":18.399999999999999},"last":0.85299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359739538,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7657792,"kb_used_data":6462584,"kb_used_omap":1223,"kb_used_meta":1193976,"kb_avail":86714048,"statfs":{"total":96636764160,"available":88795185152,"internally_reserved":0,"allocated":6617686016,"data_stored":10507763911,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1253192,"internal_metadata":1222631608},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,3,7,7,2],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.80500000000000005,"15min":0.96799999999999997},"min":{"1min":0.19700000000000001,"5min":0.186,"15min":0.158},"max":{"1min":6.1070000000000002,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.71499999999999997,"15min":0.82299999999999995},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":7.0720000000000001,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":0.35699999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.99199999999999999,"15min":0.84899999999999998},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":2.9540000000000002,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.96699999999999997,"15min":1.0740000000000001},"min":{"1min":0.22600000000000001,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":3.3820000000000001,"5min":10.375999999999999,"15min":10.375999999999999},"last":0.40200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6616285184,"data_stored":10506713701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10737115136,"data_stored":17015734195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4123611136,"data_stored":6511490382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:37:47.511 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:37:47.512 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:37:48.614 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:37:48.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.637+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:48.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:48.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:48.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:48.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:48.675 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.669+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:48.693 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:48.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:48.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.697+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:48.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.717+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:48.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:48.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:48.717+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:49.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:49.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:37:49.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:49.589+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:49.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:49.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:49.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:49.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:49.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:49.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:49.681 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:49.673+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:49.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:49.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:49.695 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:49.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:49.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:49.713+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:49.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:49.721+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:49.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:49.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:49.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:49.721+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:50.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:50.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:50.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:50.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:50.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:50.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:50.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:50.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:50.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:50.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:50.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:50.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:50.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:50.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:50.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:50.193+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:52.680 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.677+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:52.692 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.685+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:52.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.741+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:52.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.757+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:52.803 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.797+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:52.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:52.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:52.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:52.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:52.905 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.901+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:52.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:52.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.921+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:52.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:52.927 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:52.921+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:53.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.025+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:53.063 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:53.091 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:53.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.089+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:53.106 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:53.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:53.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.109+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:53.121 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.117+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:53.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.153+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:53.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:53.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.153+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:53.755 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:53.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.749+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:53.793 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.789+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:53.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.797+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:53.801 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.797+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:53.802 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:53.797+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:54.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:54.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:37:54.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:54.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:54.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:54.053+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:37:54.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:54.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:54.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:54.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:54.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:54.085+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:54.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:54.093+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:54.103 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:54.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:54.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:54.093+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:57.001 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:56.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:57.002 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:56.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:57.035 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.033+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:57.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:57.037 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.033+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:57.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.065+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:57.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:57.070 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.065+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:57.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:57.243 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.233+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:57.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:57.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:57.263 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:57.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.301+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:57.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.301+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:57.312 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:57.301+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:58.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:58.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:58.159 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.153+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:58.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:58.167 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.161+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:58.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:58.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:58.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:58.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.185+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:58.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:58.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.185+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:37:58.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:37:58.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:58.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:58.221 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:58.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:58.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:58.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:58.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.221+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:58.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.221+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:58.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:37:58.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:37:58.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:37:58.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:37:58.922 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.917+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:37:58.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:37:58.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:37:58.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:37:58.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.945+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:37:58.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:37:58.949 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:37:58.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:00.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:00.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.197+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:00.262 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.253+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:00.269 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.265+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:00.286 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.281+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:00.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.289+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:00.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:00.292 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.289+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:00.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:00.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:00.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:00.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.605+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:00.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.689+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:00.694 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.689+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:00.720 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:00.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.709+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:00.721 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:00.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:00.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:01.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:01.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:01.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:01.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:01.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:01.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:01.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:01.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:01.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:01.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:01.656 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:01.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:01.667 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:01.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:01.683 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:01.677+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:01.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:01.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:01.684 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:01.677+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:03.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:03.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:03.197 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:03.198 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:03.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:03.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.241+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:03.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:03.248 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:03.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.241+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:03.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:03.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.241+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:03.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:03.599 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:03.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:03.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:03.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:03.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.645+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:03.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.645+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:03.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.661+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:03.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.709+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:03.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:03.717 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.709+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:03.725 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.721+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:38:03.763 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.761+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:38:03.789 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:03.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:03.792 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.789+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:03.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:03.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:03.839 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:03.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:03.844 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.841+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:03.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:03.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.905+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:03.911 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:03.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.913+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:03.918 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:38:03.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.921+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:38:03.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.929+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:38:03.948 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:03.991 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:03.992 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:03.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:04.028 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.017+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:04.029 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:04.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:04.055 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.049+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:04.056 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.049+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:04.075 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.069+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:04.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.081+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:04.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:04.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:04.100 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:38:04.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:04.168 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.165+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:04.174 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:04.175 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:04.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:04.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:04.223 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.213+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:04.231 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.217+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:04.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:04.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.217+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:04.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:38:04.232 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:04.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.221+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:04.233 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.225+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:04.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.237+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:04.245 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:04.257 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.253+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:04.270 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.265+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:04.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:04.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:04.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.857+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:04.882 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:04.906 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.901+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:04.917 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.913+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:04.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.933+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:04.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.933+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:04.952 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:04.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:05.009 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.005+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:05.010 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.005+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:05.024 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:05.026 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:38:05.027 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.021+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:38:05.042 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:38:05.043 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.037+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:05.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:05.045 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.041+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:05.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:05.084 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:05.085 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:05.086 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.081+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:05.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:05.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:05.087 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.081+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:05.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:05.088 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:05.081+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:06.315 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:06.316 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.313+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:06.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.321+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:06.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.333+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:06.346 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:06.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.361+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:06.365 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.361+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:06.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:06.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.381+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:06.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:06.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.381+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:06.832 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:06.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:06.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:06.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:06.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:06.864 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.861+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:06.908 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.905+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:06.909 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.905+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:06.921 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.917+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:06.935 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.933+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:06.936 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:06.933+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:07.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:07.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:07.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:07.384 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:07.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.421+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:07.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:07.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:07.444 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.441+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:07.456 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.453+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:07.470 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.465+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:07.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:07.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.465+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:07.513 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:38:07.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:07.993 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:07.994 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.989+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:07.999 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:07.997+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:08.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:08.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.073+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:08.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:08.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:08.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.073+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:08.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:08.083 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.073+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:08.405 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:38:08.406 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:38:08.461 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3115,"stamp":"2023-10-14T01:38:07.955498+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30880661971,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2674609,"num_read_kb":10430420,"num_write":2634114,"num_write_kb":10534991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80367,"ondisk_log_size":80367,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25985992,"kb_used_data":21029472,"kb_used_omap":3161,"kb_used_meta":4953318,"kb_avail":257129528,"statfs":{"total":289910292480,"available":263300636672,"internally_reserved":0,"allocated":21534179328,"data_stored":34081706092,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3237399,"internal_metadata":5072198121},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,2,4,15,9,11,8,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12259328,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4034,"num_read_kb":16108,"num_write":4117,"num_write_kb":16468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001891"},"pg_stats":[{"pgid":"2.7","version":"176'338454","reported_seq":662722,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:02.917792+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:38:02.917792+0000","last_peered":"2023-10-14T01:38:02.917792+0000","last_clean":"2023-10-14T01:38:02.917792+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:38:02.917792+0000","last_undegraded":"2023-10-14T01:38:02.917792+0000","last_fullsized":"2023-10-14T01:38:02.917792+0000","mapping_epoch":13,"log_start":"174'328417","ondisk_log_start":"174'328417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3758707224,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":325579,"num_read_kb":1269056,"num_write":319412,"num_write_kb":1277301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"176'357351","reported_seq":702481,"reported_epoch":176,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:38:02.904482+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:38:02.904482+0000","last_peered":"2023-10-14T01:38:02.904482+0000","last_clean":"2023-10-14T01:38:02.904482+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:38:02.904482+0000","last_undegraded":"2023-10-14T01:38:02.904482+0000","last_fullsized":"2023-10-14T01:38:02.904482+0000","mapping_epoch":13,"log_start":"174'347320","ondisk_log_start":"174'347320","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2209,"log_size":10031,"log_dups_size":0,"ondisk_log_size":10031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 828s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3976270042,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":347913,"num_read_kb":1347256,"num_write":338408,"num_write_kb":1353161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"176'332238","reported_seq":653375,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:02.875270+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:38:02.875270+0000","last_peered":"2023-10-14T01:38:02.875270+0000","last_clean":"2023-10-14T01:38:02.875270+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:38:02.875270+0000","last_undegraded":"2023-10-14T01:38:02.875270+0000","last_fullsized":"2023-10-14T01:38:02.875270+0000","mapping_epoch":13,"log_start":"174'322227","ondisk_log_start":"174'322227","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10011,"log_dups_size":0,"ondisk_log_size":10011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3731706560,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":322522,"num_read_kb":1260959,"num_write":318353,"num_write_kb":1273102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"176'329273","reported_seq":651300,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:02.889604+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:38:02.889604+0000","last_peered":"2023-10-14T01:38:02.889604+0000","last_clean":"2023-10-14T01:38:02.889604+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:38:02.889604+0000","last_undegraded":"2023-10-14T01:38:02.889604+0000","last_fullsized":"2023-10-14T01:38:02.889604+0000","mapping_epoch":13,"log_start":"174'319222","ondisk_log_start":"174'319222","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10051,"log_dups_size":0,"ondisk_log_size":10051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3748090538,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":323403,"num_read_kb":1267876,"num_write":320555,"num_write_kb":1281969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"176'332570","reported_seq":662881,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:05.436487+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:38:05.436487+0000","last_peered":"2023-10-14T01:38:05.436487+0000","last_clean":"2023-10-14T01:38:05.436487+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:38:05.436487+0000","last_undegraded":"2023-10-14T01:38:05.436487+0000","last_fullsized":"2023-10-14T01:38:05.436487+0000","mapping_epoch":13,"log_start":"173'322523","ondisk_log_start":"173'322523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10047,"log_dups_size":0,"ondisk_log_size":10047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3820835337,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":331797,"num_read_kb":1288622,"num_write":325854,"num_write_kb":1302937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"176'335937","reported_seq":665611,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:03.442470+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:38:03.442470+0000","last_peered":"2023-10-14T01:38:03.442470+0000","last_clean":"2023-10-14T01:38:03.442470+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:38:03.442470+0000","last_undegraded":"2023-10-14T01:38:03.442470+0000","last_fullsized":"2023-10-14T01:38:03.442470+0000","mapping_epoch":13,"log_start":"174'325912","ondisk_log_start":"174'325912","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10025,"log_dups_size":0,"ondisk_log_size":10025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3870257470,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":331010,"num_read_kb":1300778,"num_write":330263,"num_write_kb":1320891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"176'338077","reported_seq":670922,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:03.437530+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:38:03.437530+0000","last_peered":"2023-10-14T01:38:03.437530+0000","last_clean":"2023-10-14T01:38:03.437530+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:38:03.437530+0000","last_undegraded":"2023-10-14T01:38:03.437530+0000","last_fullsized":"2023-10-14T01:38:03.437530+0000","mapping_epoch":13,"log_start":"174'328016","ondisk_log_start":"174'328016","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3907183143,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":333978,"num_read_kb":1313960,"num_write":332357,"num_write_kb":1329291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"176'382921","reported_seq":739910,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:02.889173+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:38:02.889173+0000","last_peered":"2023-10-14T01:38:02.889173+0000","last_clean":"2023-10-14T01:38:02.889173+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:38:02.889173+0000","last_undegraded":"2023-10-14T01:38:02.889173+0000","last_fullsized":"2023-10-14T01:38:02.889173+0000","mapping_epoch":13,"log_start":"174'372916","ondisk_log_start":"174'372916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10005,"log_dups_size":0,"ondisk_log_size":10005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4067021289,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":358301,"num_read_kb":1381822,"num_write":348775,"num_write_kb":1394445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":363,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:25.443859+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:36:25.443859+0000","last_peered":"2023-10-14T01:36:25.443859+0000","last_clean":"2023-10-14T01:36:25.443859+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:36:25.443859+0000","last_undegraded":"2023-10-14T01:36:25.443859+0000","last_fullsized":"2023-10-14T01:36:25.443859+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30880071603,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2674503,"num_read_kb":10430329,"num_write":2633977,"num_write_kb":10533097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21530189824,"data_stored":34079268710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80268,"ondisk_log_size":80268,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739542,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5710016,"kb_used_data":4038004,"kb_used_omap":727,"kb_used_meta":1671272,"kb_avail":88661824,"statfs":{"total":96636764160,"available":90789707776,"internally_reserved":0,"allocated":4134916096,"data_stored":6520474000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":745236,"internal_metadata":1711382764},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,4,7,1,7],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.90600000000000003,"15min":0.73799999999999999},"min":{"1min":0.21199999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":5.819,"5min":6.9279999999999999,"15min":8.0719999999999992},"last":0.26000000000000001},{"interface":"front","average":{"1min":1.083,"5min":0.94699999999999995,"15min":0.79000000000000004},"min":{"1min":0.28599999999999998,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":5.8540000000000001,"5min":6.9669999999999996,"15min":8.0999999999999996},"last":0.38100000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.90600000000000003,"15min":0.877},"min":{"1min":0.216,"5min":0.19,"15min":0.19},"max":{"1min":1.7809999999999999,"5min":7.5910000000000002,"15min":11.846},"last":1.677},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.57299999999999995,"15min":0.626},"min":{"1min":0.255,"5min":0.222,"15min":0.222},"max":{"1min":2.3900000000000001,"5min":6.593,"15min":8.0229999999999997},"last":1.661}]}]},{"osd":1,"up_from":8,"seq":34359739520,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12471900,"kb_used_data":10513036,"kb_used_omap":1209,"kb_used_meta":1957638,"kb_avail":81899940,"statfs":{"total":96636764160,"available":83865538560,"internally_reserved":0,"allocated":10765348864,"data_stored":17039730197,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1238971,"internal_metadata":2004621381},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,7,7,4,8,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.23599999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.83399999999999996,"5min":5.6529999999999996,"15min":6.673},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.81000000000000005,"15min":0.76000000000000001},"min":{"1min":0.248,"5min":0.247,"15min":0.185},"max":{"1min":2.0070000000000001,"5min":7.9029999999999996,"15min":7.9029999999999996},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:37:07 2023","interfaces":[{"interface":"back","average":{"1min":2.004,"5min":1.7330000000000001,"15min":1.6759999999999999},"min":{"1min":0.20999999999999999,"5min":0.186,"15min":0.186},"max":{"1min":6.7060000000000004,"5min":11.292,"15min":17.547999999999998},"last":2.948},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.81200000000000006,"15min":0.86599999999999999},"min":{"1min":0.255,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.97999999999999998,"5min":15.897,"15min":18.399999999999999},"last":0.371}]}]},{"osd":0,"up_from":8,"seq":34359739542,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7804076,"kb_used_data":6478432,"kb_used_omap":1223,"kb_used_meta":1324408,"kb_avail":86567764,"statfs":{"total":96636764160,"available":88645390336,"internally_reserved":0,"allocated":6633914368,"data_stored":10521501895,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1253192,"internal_metadata":1356193976},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,2,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.80500000000000005,"15min":0.96799999999999997},"min":{"1min":0.19700000000000001,"5min":0.186,"15min":0.158},"max":{"1min":6.1070000000000002,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.71499999999999997,"15min":0.82299999999999995},"min":{"1min":0.251,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":7.0720000000000001,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":0.315}]},{"osd":2,"last update":"Sat Oct 14 01:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.99199999999999999,"15min":0.84899999999999998},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":2.9540000000000002,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.96699999999999997,"15min":1.0740000000000001},"min":{"1min":0.22600000000000001,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":3.3820000000000001,"5min":10.375999999999999,"15min":10.375999999999999},"last":0.35099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6632591360,"data_stored":10520529509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10764009472,"data_stored":17038716851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4133588992,"data_stored":6520022350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:38:08.462 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:38:08.463 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:38:08.545 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.541+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:38:08.569 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:08.570 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.561+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:08.573 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:08.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:08.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:08.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:08.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:08.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.597+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:08.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:08.605 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:08.597+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:09.559 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:38:09.553+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:38:10.166 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:10.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:10.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.181+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:10.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.181+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:10.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.189+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:10.207 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.205+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:10.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:10.218 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:10.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:10.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:10.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:10.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:10.655 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:10.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.653+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:10.658 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:10.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.653+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:10.659 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:10.653+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:12.104 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.097+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:12.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:12.105 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:12.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:12.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:12.119 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.113+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:12.127 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.125+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:12.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.125+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:12.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.133+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:12.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.141+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:12.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:12.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:12.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:12.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:12.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.345+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:12.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.357+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:12.382 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:12.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.401+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:12.433 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.429+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:12.436 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:12.437 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:12.433+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:13.065 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:13.057+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:13.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:13.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:13.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:13.085+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:13.156 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:13.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:13.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:13.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:13.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:13.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:13.157 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:13.117+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:14.036 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:38:14.033+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:38:14.111 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.101+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:14.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:14.113 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.105+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:14.143 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:14.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:14.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:14.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:14.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:14.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:14.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.141+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:14.147 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:14.849 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:14.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:14.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:14.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.877+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:14.892 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.889+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:14.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:14.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.897+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:14.901 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:14.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:14.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.897+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:14.902 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:14.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:14.897+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:17.537 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:38:17.533+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:38:19.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:19.841+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:19.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:19.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:19.869 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:19.865+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:19.914 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:19.909+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:19.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:19.941+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:19.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:19.945+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:19.951 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:19.945+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:19.973 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:19.969+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:19.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:19.981+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:19.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:19.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:19.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:19.981+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:20.000 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:19.993+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:38:20.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:20.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:38:20.082 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:20.077+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:20.097 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:20.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:20.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:20.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:20.098 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:20.093+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:20.125 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:20.121+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:20.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:20.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:20.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:20.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:20.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:20.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:20.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:20.141+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:20.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:20.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:20.146 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:20.141+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:21.128 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.117+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:21.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:21.135 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:21.136 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.133+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:21.173 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.169+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:21.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:21.201 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:21.235 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:21.250 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.245+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:21.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:21.251 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:21.823 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:21.824 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.821+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:21.833 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.829+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:21.852 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.845+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:21.877 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.873+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:21.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:21.878 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.873+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:21.886 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.881+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:21.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:21.887 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:21.881+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:22.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.141+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:38:22.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:38:22.215 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:22.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:22.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:22.216 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:22.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:22.217 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.209+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:22.222 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.217+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:22.230 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.225+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:22.240 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:22.260 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.257+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:22.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:22.261 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.257+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:22.403 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:22.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.397+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:22.406 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.401+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:22.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:22.478 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:22.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:22.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.497+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:22.517 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:22.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.513+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:22.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:22.519 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.513+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:22.575 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.569+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:22.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:22.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.577+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:22.586 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:22.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.609+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:22.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.617+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:22.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.633+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:22.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.633+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:22.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:22.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.649+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:22.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:22.653 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.649+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:22.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:22.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:22.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.781+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:22.805 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:22.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.817+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:22.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:22.820 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.817+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:22.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.825+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:22.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.825+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:22.837 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:22.833+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:23.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:23.641+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:23.654 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:23.649+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:23.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:23.733+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:23.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:23.745+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:23.748 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:23.745+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:23.757 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:23.753+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:23.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:23.769+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:23.778 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:23.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:23.779 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:23.769+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:25.722 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:25.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:25.723 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:25.717+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:25.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:25.737+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:25.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:25.737+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:25.770 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:25.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:25.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:25.757+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:25.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:25.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:25.771 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:25.757+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:26.189 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.185+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:26.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.189+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:26.210 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:26.211 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.205+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:26.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:26.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:26.241 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.233+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:26.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:26.242 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.233+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:26.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:26.576 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.573+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:26.608 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:26.609 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.597+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:26.618 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:26.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.625+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:26.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:26.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:26.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.625+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:26.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:26.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:26.625+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:27.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:27.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:27.178 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:27.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:27.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:27.173+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:27.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:27.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:27.196 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:27.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:27.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:27.213+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:27.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:27.229+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:27.234 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:27.229+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:27.247 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:27.237+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:27.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:27.245+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:27.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:27.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:27.249 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:27.245+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:28.464 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:38:29.186 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:38:29.187 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:38:29.253 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3125,"stamp":"2023-10-14T01:38:27.968708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30904181203,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2682438,"num_read_kb":10461704,"num_write":2642086,"num_write_kb":10566879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80610,"ondisk_log_size":80610,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25591260,"kb_used_data":21077700,"kb_used_omap":3182,"kb_used_meta":4510353,"kb_avail":257524260,"statfs":{"total":289910292480,"available":263704842240,"internally_reserved":0,"allocated":21583564800,"data_stored":34122915948,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3258389,"internal_metadata":4618602475},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,7,4,8,14,12,25],"upper_bound":256},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11833344,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3934,"num_read_kb":15720,"num_write":4078,"num_write_kb":16312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010683"},"pg_stats":[{"pgid":"2.7","version":"176'339499","reported_seq":664711,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:23.508860+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:38:23.508860+0000","last_peered":"2023-10-14T01:38:23.508860+0000","last_clean":"2023-10-14T01:38:23.508860+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:38:23.508860+0000","last_undegraded":"2023-10-14T01:38:23.508860+0000","last_fullsized":"2023-10-14T01:38:23.508860+0000","mapping_epoch":13,"log_start":"174'329417","ondisk_log_start":"174'329417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10082,"log_dups_size":0,"ondisk_log_size":10082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3761590808,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":326515,"num_read_kb":1272800,"num_write":320373,"num_write_kb":1281145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"176'358489","reported_seq":704659,"reported_epoch":176,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:38:23.510549+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:38:23.510549+0000","last_peered":"2023-10-14T01:38:23.510549+0000","last_clean":"2023-10-14T01:38:23.510549+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:38:23.510549+0000","last_undegraded":"2023-10-14T01:38:23.510549+0000","last_fullsized":"2023-10-14T01:38:23.510549+0000","mapping_epoch":13,"log_start":"174'348420","ondisk_log_start":"174'348420","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2262,"log_size":10069,"log_dups_size":0,"ondisk_log_size":10069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 849s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3979264218,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":348932,"num_read_kb":1351328,"num_write":339423,"num_write_kb":1357221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"176'333250","reported_seq":655329,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:23.513704+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:38:23.513704+0000","last_peered":"2023-10-14T01:38:23.513704+0000","last_clean":"2023-10-14T01:38:23.513704+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:38:23.513704+0000","last_undegraded":"2023-10-14T01:38:23.513704+0000","last_fullsized":"2023-10-14T01:38:23.513704+0000","mapping_epoch":13,"log_start":"174'323227","ondisk_log_start":"174'323227","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3734528704,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":323457,"num_read_kb":1264695,"num_write":319309,"num_write_kb":1276926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"176'330318","reported_seq":653375,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:23.475172+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:38:23.475172+0000","last_peered":"2023-10-14T01:38:23.475172+0000","last_clean":"2023-10-14T01:38:23.475172+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:38:23.475172+0000","last_undegraded":"2023-10-14T01:38:23.475172+0000","last_fullsized":"2023-10-14T01:38:23.475172+0000","mapping_epoch":13,"log_start":"174'320222","ondisk_log_start":"174'320222","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10096,"log_dups_size":0,"ondisk_log_size":10096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3751166634,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":324426,"num_read_kb":1271968,"num_write":321573,"num_write_kb":1286041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"176'333547","reported_seq":664809,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:25.599637+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:38:25.599637+0000","last_peered":"2023-10-14T01:38:25.599637+0000","last_clean":"2023-10-14T01:38:25.599637+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:38:25.599637+0000","last_undegraded":"2023-10-14T01:38:25.599637+0000","last_fullsized":"2023-10-14T01:38:25.599637+0000","mapping_epoch":13,"log_start":"174'323523","ondisk_log_start":"174'323523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10024,"log_dups_size":0,"ondisk_log_size":10024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3823477257,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":332730,"num_read_kb":1292342,"num_write":326825,"num_write_kb":1306821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"176'336956","reported_seq":667607,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:23.509886+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:38:23.509886+0000","last_peered":"2023-10-14T01:38:23.509886+0000","last_clean":"2023-10-14T01:38:23.509886+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:38:23.509886+0000","last_undegraded":"2023-10-14T01:38:23.509886+0000","last_fullsized":"2023-10-14T01:38:23.509886+0000","mapping_epoch":13,"log_start":"174'326912","ondisk_log_start":"174'326912","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3873321278,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":331983,"num_read_kb":1304666,"num_write":331277,"num_write_kb":1324947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"176'338996","reported_seq":672768,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:23.577236+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:38:23.577236+0000","last_peered":"2023-10-14T01:38:23.577236+0000","last_clean":"2023-10-14T01:38:23.577236+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:38:23.577236+0000","last_undegraded":"2023-10-14T01:38:23.577236+0000","last_fullsized":"2023-10-14T01:38:23.577236+0000","mapping_epoch":13,"log_start":"174'328916","ondisk_log_start":"174'328916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3909759527,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":334900,"num_read_kb":1317644,"num_write":333271,"num_write_kb":1332947,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"176'384209","reported_seq":742303,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:23.470092+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:38:23.470092+0000","last_peered":"2023-10-14T01:38:23.470092+0000","last_clean":"2023-10-14T01:38:23.470092+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:38:23.470092+0000","last_undegraded":"2023-10-14T01:38:23.470092+0000","last_fullsized":"2023-10-14T01:38:23.470092+0000","mapping_epoch":13,"log_start":"174'374116","ondisk_log_start":"174'374116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10093,"log_dups_size":0,"ondisk_log_size":10093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4070482409,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":359389,"num_read_kb":1386170,"num_write":349898,"num_write_kb":1398937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":363,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-14T01:36:25.443859+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:36:25.443859+0000","last_peered":"2023-10-14T01:36:25.443859+0000","last_clean":"2023-10-14T01:36:25.443859+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:36:25.443859+0000","last_undegraded":"2023-10-14T01:36:25.443859+0000","last_fullsized":"2023-10-14T01:36:25.443859+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30903590835,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2682332,"num_read_kb":10461613,"num_write":2641949,"num_write_kb":10564985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21580599296,"data_stored":34121244518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80511,"ondisk_log_size":80511,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739546,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5767880,"kb_used_data":4047296,"kb_used_omap":727,"kb_used_meta":1719848,"kb_avail":88603960,"statfs":{"total":96636764160,"available":90730455040,"internally_reserved":0,"allocated":4144431104,"data_stored":6528440720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":745236,"internal_metadata":1761124588},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,0,0,3,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.90600000000000003,"15min":0.73799999999999999},"min":{"1min":0.21199999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":5.819,"5min":6.9279999999999999,"15min":8.0719999999999992},"last":1.8260000000000001},{"interface":"front","average":{"1min":1.083,"5min":0.94699999999999995,"15min":0.79000000000000004},"min":{"1min":0.28599999999999998,"5min":0.26000000000000001,"15min":0.251},"max":{"1min":5.8540000000000001,"5min":6.9669999999999996,"15min":8.0999999999999996},"last":1.863}]},{"osd":1,"last update":"Sat Oct 14 01:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.90600000000000003,"15min":0.877},"min":{"1min":0.216,"5min":0.19,"15min":0.19},"max":{"1min":1.7809999999999999,"5min":7.5910000000000002,"15min":11.846},"last":0.221},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.57299999999999995,"15min":0.626},"min":{"1min":0.255,"5min":0.222,"15min":0.222},"max":{"1min":2.3900000000000001,"5min":6.593,"15min":8.0229999999999997},"last":0.254}]}]},{"osd":1,"up_from":8,"seq":34359739524,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11922468,"kb_used_data":10537052,"kb_used_omap":1230,"kb_used_meta":1384177,"kb_avail":82449372,"statfs":{"total":96636764160,"available":84428156928,"internally_reserved":0,"allocated":10789941248,"data_stored":17060292117,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1259961,"internal_metadata":1417397831},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,4,3,5,4,6,25],"upper_bound":256},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":0.79200000000000004,"15min":0.77200000000000002},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":11.257999999999999,"5min":11.257999999999999,"15min":11.257999999999999},"last":0.28499999999999998},{"interface":"front","average":{"1min":1.3939999999999999,"5min":0.83599999999999997,"15min":0.77000000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.185},"max":{"1min":11.233000000000001,"5min":11.233000000000001,"15min":11.233000000000001},"last":0.26900000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:38:09 2023","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":1.8899999999999999,"15min":1.677},"min":{"1min":0.214,"5min":0.186,"15min":0.186},"max":{"1min":23.280000000000001,"5min":23.280000000000001,"15min":23.280000000000001},"last":4.5499999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.81699999999999995,"15min":0.873},"min":{"1min":0.217,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.9060000000000001,"5min":15.897,"15min":18.399999999999999},"last":0.24299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359739546,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7900912,"kb_used_data":6493352,"kb_used_omap":1223,"kb_used_meta":1406328,"kb_avail":86470928,"statfs":{"total":96636764160,"available":88546230272,"internally_reserved":0,"allocated":6649192448,"data_stored":10534183111,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1253192,"internal_metadata":1440080056},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1,3,7,4],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.89900000000000002,"15min":0.96399999999999997},"min":{"1min":0.23100000000000001,"5min":0.19700000000000001,"15min":0.158},"max":{"1min":4.1980000000000004,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.373},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.76900000000000002,"15min":0.81999999999999995},"min":{"1min":0.25700000000000001,"5min":0.221,"15min":0.21199999999999999},"max":{"1min":3.077,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":0.27800000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.1100000000000001,"15min":0.88500000000000001},"min":{"1min":0.26900000000000002,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":5.4950000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":1.083,"5min":1.01,"15min":1.0649999999999999},"min":{"1min":0.29199999999999998,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":5.4749999999999996,"5min":10.375999999999999,"15min":10.375999999999999},"last":0.34799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6647902208,"data_stored":10533198437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10789482496,"data_stored":17059970995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4143214592,"data_stored":6528075086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:38:29.255 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:38:29.256 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:38:29.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:29.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:29.568 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:29.565+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:29.590 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:29.581+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:29.601 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:29.593+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:29.616 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:29.613+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:29.617 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:29.613+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:29.630 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:29.621+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:29.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:29.641+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:29.646 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:29.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:29.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:29.641+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:30.050 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:30.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:30.051 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:30.045+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:30.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:30.069+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:30.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:30.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:30.114 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:30.109+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:30.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:30.129+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:30.132 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:30.129+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:30.165 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:30.161+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:30.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:30.173+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:30.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:30.173+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:30.176 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:30.173+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:31.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:31.199 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.193+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:31.200 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.193+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:31.203 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.197+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:31.212 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.209+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:31.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:31.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:31.213 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.209+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:31.344 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:31.345 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.341+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:31.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:31.358 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:31.363 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.357+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:31.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.369+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:31.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:31.375 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:31.369+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:32.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:32.144 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:32.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:32.145 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.137+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:32.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.157+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:32.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:32.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:32.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.157+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:32.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:32.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.157+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:32.371 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:32.372 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.365+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:32.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.373+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:32.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.389+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:32.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:32.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:32.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:32.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.425+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:32.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:32.432 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:32.425+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:35.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:35.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:35.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:35.953+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:35.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:35.965+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:36.012 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:36.009+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:36.013 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:36.009+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:36.020 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:36.017+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:36.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:36.021+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:36.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:36.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:36.032 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:36.021+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:37.754 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:37.749+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:37.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:37.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:37.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:37.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:37.756 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:37.753+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:37.791 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:37.785+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:37.804 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:37.801+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:37.841 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:37.837+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:37.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:37.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:37.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:37.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:37.842 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:37.837+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:37.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:37.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:37.843 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:37.837+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:38.038 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:38:38.033+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:38:38.039 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:38:38.033+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:38:38.782 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:38.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:38.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:38.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:38.783 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:38.777+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:38.799 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:38.793+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:38.838 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:38.833+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:38.846 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:38.841+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:38.847 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:38.841+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:38.851 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:38.845+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:39.220 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:38:39.209+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:38:40.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:40.308 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:40.311 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.305+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:40.330 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.325+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:40.334 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.329+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:40.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.353+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:40.359 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.353+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:40.376 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.373+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:40.380 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.377+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:40.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.377+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:40.381 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.377+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:40.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.405+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:38:40.435 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.429+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:38:40.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.441+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:38:40.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.469+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:40.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.477+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:40.494 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.485+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:40.499 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.497+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:40.524 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.521+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:40.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.545+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:40.548 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.545+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:40.583 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.577+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:40.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.601+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:40.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:40.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:40.601+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:42.354 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.349+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:38:42.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.381+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:38:42.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.425+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:42.450 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:42.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:42.451 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.445+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:42.471 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.465+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:42.490 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.473+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:42.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:42.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.496+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:42.529 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:42.535 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.528+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:42.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:42.536 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:42.528+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:46.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:46.588+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:38:46.606 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:46.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:46.607 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:46.600+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:46.611 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:46.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:46.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:46.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:46.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:46.636+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:46.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:46.636+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:46.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:46.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:46.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:46.640+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:46.644 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:46.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:46.645 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:46.640+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:48.806 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:38:48.800+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:38:49.257 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:38:49.902 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:38:49.903 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:38:49.950 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3136,"stamp":"2023-10-14T01:38:47.972062+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30926627283,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2690393,"num_read_kb":10493476,"num_write":2650200,"num_write_kb":10599335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80506,"ondisk_log_size":80506,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":25962576,"kb_used_data":21125292,"kb_used_omap":3182,"kb_used_meta":4834065,"kb_avail":257152944,"statfs":{"total":289910292480,"available":263324614656,"internally_reserved":0,"allocated":21632299008,"data_stored":34161747361,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3258389,"internal_metadata":4950083563},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,4,5,7,13,17,11,10],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":11382784,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4098,"num_read_kb":16376,"num_write":4140,"num_write_kb":16560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002030"},"pg_stats":[{"pgid":"2.7","version":"177'340490","reported_seq":666664,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:38:44.268325+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:38:44.268325+0000","last_peered":"2023-10-14T01:38:44.268325+0000","last_clean":"2023-10-14T01:38:44.268325+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:38:44.268325+0000","last_undegraded":"2023-10-14T01:38:44.268325+0000","last_fullsized":"2023-10-14T01:38:44.268325+0000","mapping_epoch":13,"log_start":"174'330417","ondisk_log_start":"174'330417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10073,"log_dups_size":0,"ondisk_log_size":10073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3764236824,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":327461,"num_read_kb":1276584,"num_write":321314,"num_write_kb":1284909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"177'359662","reported_seq":706888,"reported_epoch":177,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:38:44.259700+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:38:44.259700+0000","last_peered":"2023-10-14T01:38:44.259700+0000","last_clean":"2023-10-14T01:38:44.259700+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:38:44.259700+0000","last_undegraded":"2023-10-14T01:38:44.259700+0000","last_fullsized":"2023-10-14T01:38:44.259700+0000","mapping_epoch":13,"log_start":"174'349620","ondisk_log_start":"174'349620","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2286,"log_size":10042,"log_dups_size":0,"ondisk_log_size":10042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 869s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3982213338,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":349970,"num_read_kb":1355476,"num_write":340531,"num_write_kb":1361653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"177'334271","reported_seq":657322,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:38:44.289320+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:38:44.289320+0000","last_peered":"2023-10-14T01:38:44.289320+0000","last_clean":"2023-10-14T01:38:44.289320+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:38:44.289320+0000","last_undegraded":"2023-10-14T01:38:44.289320+0000","last_fullsized":"2023-10-14T01:38:44.289320+0000","mapping_epoch":13,"log_start":"174'324227","ondisk_log_start":"174'324227","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10044,"log_dups_size":0,"ondisk_log_size":10044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3737236160,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":324417,"num_read_kb":1268519,"num_write":320296,"num_write_kb":1280874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"177'331358","reported_seq":655395,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:38:44.271277+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:38:44.271277+0000","last_peered":"2023-10-14T01:38:44.271277+0000","last_clean":"2023-10-14T01:38:44.271277+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:38:44.271277+0000","last_undegraded":"2023-10-14T01:38:44.271277+0000","last_fullsized":"2023-10-14T01:38:44.271277+0000","mapping_epoch":13,"log_start":"174'321322","ondisk_log_start":"174'321322","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10036,"log_dups_size":0,"ondisk_log_size":10036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3754091178,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":325399,"num_read_kb":1275852,"num_write":322596,"num_write_kb":1290133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"177'334568","reported_seq":666865,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:38:45.814311+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:38:45.814311+0000","last_peered":"2023-10-14T01:38:45.814311+0000","last_clean":"2023-10-14T01:38:45.814311+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:38:45.814311+0000","last_undegraded":"2023-10-14T01:38:45.814311+0000","last_fullsized":"2023-10-14T01:38:45.814311+0000","mapping_epoch":13,"log_start":"174'324523","ondisk_log_start":"174'324523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10045,"log_dups_size":0,"ondisk_log_size":10045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3826258441,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":333751,"num_read_kb":1296426,"num_write":327843,"num_write_kb":1310893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"177'337873","reported_seq":669431,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:38:43.801734+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:38:43.801734+0000","last_peered":"2023-10-14T01:38:43.801734+0000","last_clean":"2023-10-14T01:38:43.801734+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:38:43.801734+0000","last_undegraded":"2023-10-14T01:38:43.801734+0000","last_fullsized":"2023-10-14T01:38:43.801734+0000","mapping_epoch":13,"log_start":"174'327812","ondisk_log_start":"174'327812","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10061,"log_dups_size":0,"ondisk_log_size":10061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3875803454,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":332885,"num_read_kb":1308270,"num_write":332189,"num_write_kb":1328595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"177'339979","reported_seq":674762,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:38:43.788596+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:38:43.788596+0000","last_peered":"2023-10-14T01:38:43.788596+0000","last_clean":"2023-10-14T01:38:43.788596+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:38:43.788596+0000","last_undegraded":"2023-10-14T01:38:43.788596+0000","last_fullsized":"2023-10-14T01:38:43.788596+0000","mapping_epoch":13,"log_start":"174'329916","ondisk_log_start":"174'329916","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10063,"log_dups_size":0,"ondisk_log_size":10063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3912479271,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":335907,"num_read_kb":1321668,"num_write":334249,"num_write_kb":1336859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"177'385459","reported_seq":744685,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:38:44.280216+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:38:44.280216+0000","last_peered":"2023-10-14T01:38:44.280216+0000","last_clean":"2023-10-14T01:38:44.280216+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:38:44.280216+0000","last_undegraded":"2023-10-14T01:38:44.280216+0000","last_fullsized":"2023-10-14T01:38:44.280216+0000","mapping_epoch":13,"log_start":"174'375416","ondisk_log_start":"174'375416","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10043,"log_dups_size":0,"ondisk_log_size":10043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4073718249,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":360497,"num_read_kb":1390590,"num_write":351045,"num_write_kb":1403525,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":365,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:28.606026+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:38:28.606026+0000","last_peered":"2023-10-14T01:38:28.606026+0000","last_clean":"2023-10-14T01:38:28.606026+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:38:28.606026+0000","last_undegraded":"2023-10-14T01:38:28.606026+0000","last_fullsized":"2023-10-14T01:38:28.606026+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30926036915,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2690287,"num_read_kb":10493385,"num_write":2650063,"num_write_kb":10597441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21628432384,"data_stored":34159345510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80407,"ondisk_log_size":80407,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739550,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5832544,"kb_used_data":4055960,"kb_used_omap":727,"kb_used_meta":1775848,"kb_avail":88539296,"statfs":{"total":96636764160,"available":90664239104,"internally_reserved":0,"allocated":4153303040,"data_stored":6535579127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":745236,"internal_metadata":1818468588},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,3,4,5,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":0.90200000000000002,"15min":0.79900000000000004},"min":{"1min":0.22,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":7.0599999999999996,"5min":7.0599999999999996,"15min":8.0719999999999992},"last":0.38600000000000001},{"interface":"front","average":{"1min":1.4910000000000001,"5min":0.94199999999999995,"15min":0.84699999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":7.0110000000000001,"5min":7.0110000000000001,"15min":8.0999999999999996},"last":0.55700000000000005}]},{"osd":1,"last update":"Sat Oct 14 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.80800000000000005,"15min":0.88800000000000001},"min":{"1min":0.19700000000000001,"5min":0.19,"15min":0.19},"max":{"1min":3.7629999999999999,"5min":7.5910000000000002,"15min":11.846},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.61099999999999999,"15min":0.65300000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":5.1200000000000001,"5min":6.593,"15min":8.0229999999999997},"last":0.41999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739528,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12130036,"kb_used_data":10561824,"kb_used_omap":1230,"kb_used_meta":1566961,"kb_avail":82241804,"statfs":{"total":96636764160,"available":84215607296,"internally_reserved":0,"allocated":10815307776,"data_stored":17080492668,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1259961,"internal_metadata":1604568647},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,3,3,4,6,7,4,10],"upper_bound":512},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":0.79200000000000004,"15min":0.77200000000000002},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":11.257999999999999,"5min":11.257999999999999,"15min":11.257999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":1.3939999999999999,"5min":0.83599999999999997,"15min":0.77000000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.185},"max":{"1min":11.233000000000001,"5min":11.233000000000001,"15min":11.233000000000001},"last":0.27300000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:38:09 2023","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":1.8899999999999999,"15min":1.677},"min":{"1min":0.214,"5min":0.186,"15min":0.186},"max":{"1min":23.280000000000001,"5min":23.280000000000001,"15min":23.280000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.81699999999999995,"15min":0.873},"min":{"1min":0.217,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.9060000000000001,"5min":15.897,"15min":18.399999999999999},"last":0.46300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359739550,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7999996,"kb_used_data":6507508,"kb_used_omap":1223,"kb_used_meta":1491256,"kb_avail":86371844,"statfs":{"total":96636764160,"available":88444768256,"internally_reserved":0,"allocated":6663688192,"data_stored":10545675566,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1253192,"internal_metadata":1527046328},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,0,3,5,6],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.89900000000000002,"15min":0.96399999999999997},"min":{"1min":0.23100000000000001,"5min":0.19700000000000001,"15min":0.158},"max":{"1min":4.1980000000000004,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.76900000000000002,"15min":0.81999999999999995},"min":{"1min":0.25700000000000001,"5min":0.221,"15min":0.21199999999999999},"max":{"1min":3.077,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":4.4329999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.1100000000000001,"15min":0.88500000000000001},"min":{"1min":0.26900000000000002,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":5.4950000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.083,"5min":1.01,"15min":1.0649999999999999},"min":{"1min":0.29199999999999998,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":5.4749999999999996,"5min":10.375999999999999,"15min":10.375999999999999},"last":4.6040000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6662561792,"data_stored":10544826981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10813800448,"data_stored":17079332787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4152070144,"data_stored":6535185742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:38:49.951 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:38:49.952 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-10-14T01:38:50.224 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:50.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:50.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:50.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:50.225 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:50.220+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:50.237 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:50.232+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:50.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:50.260+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:50.276 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:50.272+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:50.304 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:50.296+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:50.305 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:50.296+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:50.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:50.316+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:50.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:50.356+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:50.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:50.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:50.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:50.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:50.633 INFO:teuthology.orchestra.run.smithi191.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-10-14T01:38:50.678 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:38:53.903 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:53.896+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:38:53.928 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:53.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:38:53.957 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:53.958 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:53.948+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:53.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:53.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:53.964 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:53.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:53.979 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:53.972+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:53.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:53.980+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:53.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:53.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:53.986 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:53.980+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:54.011 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:54.004+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:54.014 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:54.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:54.015 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:54.004+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:55.332 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:55.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:55.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:55.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:55.333 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:55.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:55.356 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:55.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:55.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:55.368+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:55.370 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:55.368+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:55.388 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:55.388+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:55.394 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:55.392+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:55.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:55.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:55.395 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:55.392+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:56.031 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.024+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:56.036 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.032+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:56.046 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.044+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:56.052 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.052+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:38:56.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:56.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:56.685 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:56.686 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:56.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:38:56.703 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:56.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:56.704 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.700+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:56.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.712+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:56.715 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:56.716 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:56.712+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:58.326 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:38:58.327 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:58.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.360+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:58.378 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.376+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:58.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:58.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:58.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:58.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.412+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:58.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:58.415 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.412+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:38:58.487 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.484+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:38:58.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:38:58.500 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:38:58.501 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:38:58.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.524+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:38:58.527 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:38:58.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:38:58.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.524+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:38:58.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:38:58.528 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:38:58.524+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:00.638 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:39:00.636+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:39:03.561 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:03.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:03.562 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:03.560+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:03.584 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:03.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:03.587 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:03.584+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:03.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:03.612+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:03.613 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:03.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:03.631 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:03.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:03.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:03.632+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:03.638 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:03.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:03.639 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:03.632+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:05.574 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:05.568+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:05.592 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:05.592+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:05.603 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:05.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:05.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:05.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:05.642 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:05.616+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:05.652 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:05.648+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:05.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:05.740+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:05.743 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:05.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:05.744 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:05.740+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:07.701 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:07.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:07.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:07.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:07.702 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:07.700+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:07.708 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:07.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:07.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:07.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:07.762 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:07.756+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:07.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:07.760+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:07.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:07.760+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:07.764 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:07.760+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:07.765 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:07.760+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:07.784 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:07.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:08.924 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:08.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:08.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:08.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:08.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:08.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:08.926 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:08.924+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:08.965 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:08.960+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:08.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:08.968+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:08.970 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:08.968+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:08.976 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:08.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:08.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:08.976+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:08.977 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:08.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:08.978 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:08.976+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:09.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:09.348 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:09.349 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.348+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:09.398 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.396+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:09.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.428+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:09.431 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.428+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:09.464 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.456+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:09.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.472+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:09.479 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:09.480 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.472+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:09.496 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.496+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:39:09.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:39:09.502 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.500+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:39:09.503 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:09.504 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:09.507 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.504+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:09.526 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.520+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:09.551 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.548+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:09.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:09.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:09.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.868+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:09.938 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.936+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:09.961 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.956+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:09.966 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.964+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:09.967 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.964+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:09.974 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.972+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:09.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.984+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:09.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:09.985 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:09.984+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:10.122 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:39:10.120+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:39:10.648 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:39:10.676 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:39:10.679 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:39:10.687 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.684+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:10.691 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.692+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:10.719 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.716+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:10.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:10.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:10.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:10.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.724+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:10.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:10.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:10.848 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.848+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:39:10.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:10.863 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.860+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:10.920 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.920+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:10.946 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.944+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:10.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:10.947 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.944+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:10.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.952+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:10.955 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.952+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:10.956 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:10.952+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:11.160 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:11.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:11.161 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:11.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:11.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:11.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:11.163 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:11.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:11.179 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:11.176+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:11.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:11.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:11.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:11.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:11.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:11.176+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:11.181 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:11.176+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:11.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:11.216+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:11.490 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:39:11.491 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:39:11.528 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3147,"stamp":"2023-10-14T01:39:09.984859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30950629843,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2698852,"num_read_kb":10527272,"num_write":2658757,"num_write_kb":10633563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80402,"ondisk_log_size":80402,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":26364176,"kb_used_data":21174388,"kb_used_omap":3182,"kb_used_meta":5186577,"kb_avail":256751344,"statfs":{"total":289910292480,"available":262913376256,"internally_reserved":0,"allocated":21682573312,"data_stored":34201908641,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3258389,"internal_metadata":5311055851},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,6,7,21,14,20,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12894208,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4546,"num_read_kb":18164,"num_write":4606,"num_write_kb":18424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006510"},"pg_stats":[{"pgid":"2.7","version":"177'341473","reported_seq":668627,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:04.950102+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:39:04.950102+0000","last_peered":"2023-10-14T01:39:04.950102+0000","last_clean":"2023-10-14T01:39:04.950102+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:39:04.950102+0000","last_undegraded":"2023-10-14T01:39:04.950102+0000","last_fullsized":"2023-10-14T01:39:04.950102+0000","mapping_epoch":13,"log_start":"174'331417","ondisk_log_start":"174'331417","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10056,"log_dups_size":0,"ondisk_log_size":10056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3766968856,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":328425,"num_read_kb":1280436,"num_write":322269,"num_write_kb":1288729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"177'360795","reported_seq":709032,"reported_epoch":177,"state":"active+clean+scrubbing+deep","last_fresh":"2023-10-14T01:39:04.935438+0000","last_change":"2023-10-14T01:24:14.397979+0000","last_active":"2023-10-14T01:39:04.935438+0000","last_peered":"2023-10-14T01:39:04.935438+0000","last_clean":"2023-10-14T01:39:04.935438+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:39:04.935438+0000","last_undegraded":"2023-10-14T01:39:04.935438+0000","last_fullsized":"2023-10-14T01:39:04.935438+0000","mapping_epoch":13,"log_start":"175'350720","ondisk_log_start":"175'350720","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T00:00:09.141884+0000","last_clean_scrub_stamp":"2023-10-14T00:00:09.141884+0000","objects_scrubbed":2370,"log_size":10075,"log_dups_size":0,"ondisk_log_size":10075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 890s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3985076442,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":350960,"num_read_kb":1359432,"num_write":341571,"num_write_kb":1365813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"177'335329","reported_seq":659484,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:04.906270+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:39:04.906270+0000","last_peered":"2023-10-14T01:39:04.906270+0000","last_clean":"2023-10-14T01:39:04.906270+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:39:04.906270+0000","last_undegraded":"2023-10-14T01:39:04.906270+0000","last_fullsized":"2023-10-14T01:39:04.906270+0000","mapping_epoch":13,"log_start":"174'325327","ondisk_log_start":"174'325327","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10002,"log_dups_size":0,"ondisk_log_size":10002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3740000960,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":325512,"num_read_kb":1272895,"num_write":321336,"num_write_kb":1285034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"177'332359","reported_seq":657338,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:04.914837+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:39:04.914837+0000","last_peered":"2023-10-14T01:39:04.914837+0000","last_clean":"2023-10-14T01:39:04.914837+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:39:04.914837+0000","last_undegraded":"2023-10-14T01:39:04.914837+0000","last_fullsized":"2023-10-14T01:39:04.914837+0000","mapping_epoch":13,"log_start":"174'322322","ondisk_log_start":"174'322322","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10037,"log_dups_size":0,"ondisk_log_size":10037,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3756909226,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":326337,"num_read_kb":1279600,"num_write":323588,"num_write_kb":1294101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"177'335541","reported_seq":668825,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:06.027272+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:39:06.027272+0000","last_peered":"2023-10-14T01:39:06.027272+0000","last_clean":"2023-10-14T01:39:06.027272+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:39:06.027272+0000","last_undegraded":"2023-10-14T01:39:06.027272+0000","last_fullsized":"2023-10-14T01:39:06.027272+0000","mapping_epoch":13,"log_start":"174'325523","ondisk_log_start":"174'325523","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10018,"log_dups_size":0,"ondisk_log_size":10018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3829019145,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":334728,"num_read_kb":1300326,"num_write":328801,"num_write_kb":1314725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"177'339109","reported_seq":671854,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:08.938507+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:39:08.938507+0000","last_peered":"2023-10-14T01:39:08.938507+0000","last_clean":"2023-10-14T01:39:08.938507+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:39:08.938507+0000","last_undegraded":"2023-10-14T01:39:08.938507+0000","last_fullsized":"2023-10-14T01:39:08.938507+0000","mapping_epoch":13,"log_start":"174'329012","ondisk_log_start":"174'329012","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10097,"log_dups_size":0,"ondisk_log_size":10097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3879268670,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":334072,"num_read_kb":1313010,"num_write":333413,"num_write_kb":1333491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"177'341230","reported_seq":677225,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:08.945991+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:39:08.945991+0000","last_peered":"2023-10-14T01:39:08.945991+0000","last_clean":"2023-10-14T01:39:08.945991+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:39:08.945991+0000","last_undegraded":"2023-10-14T01:39:08.945991+0000","last_fullsized":"2023-10-14T01:39:08.945991+0000","mapping_epoch":13,"log_start":"174'331216","ondisk_log_start":"174'331216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10014,"log_dups_size":0,"ondisk_log_size":10014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3915956775,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":337113,"num_read_kb":1326492,"num_write":335490,"num_write_kb":1341823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"177'386620","reported_seq":746979,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:04.904651+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:39:04.904651+0000","last_peered":"2023-10-14T01:39:04.904651+0000","last_clean":"2023-10-14T01:39:04.904651+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:39:04.904651+0000","last_undegraded":"2023-10-14T01:39:04.904651+0000","last_fullsized":"2023-10-14T01:39:04.904651+0000","mapping_epoch":13,"log_start":"175'376616","ondisk_log_start":"175'376616","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10004,"log_dups_size":0,"ondisk_log_size":10004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4076839401,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":361599,"num_read_kb":1394990,"num_write":352152,"num_write_kb":1407953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":365,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:28.606026+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:38:28.606026+0000","last_peered":"2023-10-14T01:38:28.606026+0000","last_clean":"2023-10-14T01:38:28.606026+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:38:28.606026+0000","last_undegraded":"2023-10-14T01:38:28.606026+0000","last_fullsized":"2023-10-14T01:38:28.606026+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30950039475,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2698746,"num_read_kb":10527181,"num_write":2658620,"num_write_kb":10631669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16814,"num_omap_keys":259,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21678649344,"data_stored":34199469926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80303,"ondisk_log_size":80303,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739555,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5922052,"kb_used_data":4067004,"kb_used_omap":727,"kb_used_meta":1854312,"kb_avail":88449788,"statfs":{"total":96636764160,"available":90572582912,"internally_reserved":0,"allocated":4164612096,"data_stored":6544672247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":745236,"internal_metadata":1898815724},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,0,0,0,8,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":0.90200000000000002,"15min":0.79900000000000004},"min":{"1min":0.22,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":7.0599999999999996,"5min":7.0599999999999996,"15min":8.0719999999999992},"last":1.8819999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":0.94199999999999995,"15min":0.84699999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.251},"max":{"1min":7.0110000000000001,"5min":7.0110000000000001,"15min":8.0999999999999996},"last":1.9910000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.80800000000000005,"15min":0.88800000000000001},"min":{"1min":0.19700000000000001,"5min":0.19,"15min":0.19},"max":{"1min":3.7629999999999999,"5min":7.5910000000000002,"15min":11.846},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.61099999999999999,"15min":0.65300000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":5.1200000000000001,"5min":6.593,"15min":8.0229999999999997},"last":0.28199999999999997}]}]},{"osd":1,"up_from":8,"seq":34359739532,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12328128,"kb_used_data":10585140,"kb_used_omap":1230,"kb_used_meta":1741745,"kb_avail":82043712,"statfs":{"total":96636764160,"available":84012761088,"internally_reserved":0,"allocated":10839183360,"data_stored":17099592316,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1259961,"internal_metadata":1783547463},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,6,3,10,10,18,3],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:38:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":0.79200000000000004,"15min":0.77200000000000002},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":11.257999999999999,"5min":11.257999999999999,"15min":11.257999999999999},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":0.83599999999999997,"15min":0.77000000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.185},"max":{"1min":11.233000000000001,"5min":11.233000000000001,"15min":11.233000000000001},"last":0.89400000000000002}]},{"osd":2,"last update":"Sat Oct 14 01:38:09 2023","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":1.8899999999999999,"15min":1.677},"min":{"1min":0.214,"5min":0.186,"15min":0.186},"max":{"1min":23.280000000000001,"5min":23.280000000000001,"15min":23.280000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.81699999999999995,"15min":0.873},"min":{"1min":0.217,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.9060000000000001,"5min":15.897,"15min":18.399999999999999},"last":1.198}]}]},{"osd":0,"up_from":8,"seq":34359739554,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8113996,"kb_used_data":6522244,"kb_used_omap":1223,"kb_used_meta":1590520,"kb_avail":86257844,"statfs":{"total":96636764160,"available":88328032256,"internally_reserved":0,"allocated":6678777856,"data_stored":10557644078,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1253192,"internal_metadata":1628692664},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,4,3,2,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.89900000000000002,"15min":0.96399999999999997},"min":{"1min":0.23100000000000001,"5min":0.19700000000000001,"15min":0.158},"max":{"1min":4.1980000000000004,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.376},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.76900000000000002,"15min":0.81999999999999995},"min":{"1min":0.25700000000000001,"5min":0.221,"15min":0.21199999999999999},"max":{"1min":3.077,"5min":9.5510000000000002,"15min":9.5510000000000002},"last":0.35099999999999998}]},{"osd":2,"last update":"Sat Oct 14 01:38:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.1100000000000001,"15min":0.88500000000000001},"min":{"1min":0.26900000000000002,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":5.4950000000000001,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":1.083,"5min":1.01,"15min":1.0649999999999999},"min":{"1min":0.29199999999999998,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":5.4749999999999996,"5min":10.375999999999999,"15min":10.375999999999999},"last":0.53900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6677164032,"data_stored":10556402277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10838044672,"data_stored":17098731443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4163440640,"data_stored":6544336206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:39:11.529 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-14T00:00:09.141884+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=0, tm_min=0, tm_sec=9, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=1, tm_min=5, tm_sec=48, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T01:39:11.530 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T01:39:13.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:13.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:13.828 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:13.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:13.829 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:13.828+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:13.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:13.856+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:13.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:13.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:13.862 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:13.856+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:13.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:13.864+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:13.867 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:13.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:13.873 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:13.864+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:14.895 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:39:14.892+0000 7fa656dc4640 -1 reset not still connected to 0x559e21686ea0 2023-10-14T01:39:15.627 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:15.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:15.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:15.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:15.628 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:15.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:15.643 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:15.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:15.651 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:15.648+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:15.664 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:15.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:15.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:15.660+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:15.672 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:15.668+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:15.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:15.672+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:15.674 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:15.672+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:16.711 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:16.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:39:16.749 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:16.748+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:39:16.769 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:16.768+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:16.796 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:16.792+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:16.807 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:16.800+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:16.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:16.808+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:16.860 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:16.860+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:16.874 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:16.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:16.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:16.872+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:16.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:16.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:16.875 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:16.872+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:18.139 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:18.136+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:39:18.155 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:18.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:18.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:18.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:18.171 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:18.168+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:18.188 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:18.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:18.190 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:18.188+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:18.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:18.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:18.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:18.188+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:18.191 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:18.188+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:19.309 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.308+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:39:19.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:19.328 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:19.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:19.341 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.332+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:19.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.356+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:19.361 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:19.362 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.356+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:19.367 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.364+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:19.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:19.385 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.384+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:19.566 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:39:19.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:19.567 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.564+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:19.581 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:19.582 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.580+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:19.600 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.596+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:19.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:19.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:23.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:23.152 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.152+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:23.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:23.164 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.160+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:23.180 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.180+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:23.185 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:23.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:23.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:23.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.184+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:23.186 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:23.187 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:23.647 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.640+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:39:23.665 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.664+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fabb790 2023-10-14T01:39:23.671 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.668+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:39:23.682 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.680+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:39:23.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:23.688 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.688+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:23.698 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.696+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:23.741 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.732+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:23.742 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.740+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:23.752 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.752+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:23.753 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.752+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:23.785 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.784+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:23.810 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.808+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:23.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:23.811 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:23.808+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:27.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:27.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:27.661 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:27.660+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:27.677 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:27.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:27.678 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:27.676+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:27.710 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:27.708+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:27.727 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:27.724+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:27.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:27.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:27.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:27.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:27.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:27.724+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:27.728 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:27.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:27.729 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:27.724+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:28.325 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:28.324+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:39:28.340 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:28.340+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:28.387 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:28.344+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:28.411 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:28.412+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:28.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:28.424+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:28.428 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:28.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:28.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:28.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:28.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:28.424+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:28.429 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:28.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:28.430 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:28.424+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:29.044 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.044+0000 7f3f36fa4640 -1 reset not still connected to 0x55886f2c9040 2023-10-14T01:39:29.072 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.068+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe90000 2023-10-14T01:39:29.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fe9a820 2023-10-14T01:39:29.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fea3ad0 2023-10-14T01:39:29.095 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.092+0000 7f3f36fa4640 -1 reset not still connected to 0x55886feb9a00 2023-10-14T01:39:29.153 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.144+0000 7f3f36fa4640 -1 reset not still connected to 0x55886fec4ea0 2023-10-14T01:39:29.172 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.164+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a410 2023-10-14T01:39:29.192 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068a5b0 2023-10-14T01:39:29.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.184+0000 7f3f36fa4640 -1 reset not still connected to 0x55887068bc70 2023-10-14T01:39:29.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870910410 2023-10-14T01:39:29.193 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558870911520 2023-10-14T01:39:29.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.184+0000 7f3f36fa4640 -1 reset not still connected to 0x5588712851e0 2023-10-14T01:39:29.194 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558871b08680 2023-10-14T01:39:29.195 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:29.184+0000 7f3f36fa4640 -1 reset not still connected to 0x558871defba0 2023-10-14T01:39:31.433 INFO:tasks.ceph.osd.2.smithi191.stderr:2023-10-14T01:39:31.432+0000 7fa656dc4640 -1 reset not still connected to 0x559e20e6cea0 2023-10-14T01:39:31.531 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T01:39:32.356 INFO:teuthology.orchestra.run.smithi191.stdout: 2023-10-14T01:39:32.357 INFO:teuthology.orchestra.run.smithi191.stderr:dumped all 2023-10-14T01:39:32.420 INFO:teuthology.orchestra.run.smithi191.stdout:{"pg_ready":true,"pg_map":{"version":3158,"stamp":"2023-10-14T01:39:31.992887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30976500179,"num_objects":18807,"num_object_clones":13568,"num_object_copies":37614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18807,"num_whiteouts":0,"num_read":2708417,"num_read_kb":10565492,"num_write":2668440,"num_write_kb":10672295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20615,"num_omap_keys":336,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80426,"ondisk_log_size":80426,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":26811528,"kb_used_data":21227888,"kb_used_omap":3182,"kb_used_meta":5580433,"kb_avail":256303992,"statfs":{"total":289910292480,"available":262455287808,"internally_reserved":0,"allocated":21737357312,"data_stored":34245072289,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":3258389,"internal_metadata":5714364395},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,2,7,8,14,21,11,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15360000,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5665,"num_read_kb":22636,"num_write":5726,"num_write_kb":22904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3801,"num_omap_keys":77,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003066"},"pg_stats":[{"pgid":"2.7","version":"177'342797","reported_seq":671111,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:30.541316+0000","last_change":"2023-10-14T01:24:13.268319+0000","last_active":"2023-10-14T01:39:30.541316+0000","last_peered":"2023-10-14T01:39:30.541316+0000","last_clean":"2023-10-14T01:39:30.541316+0000","last_became_active":"2023-10-14T00:00:10.161049+0000","last_became_peered":"2023-10-14T00:00:10.161049+0000","last_unstale":"2023-10-14T01:39:30.541316+0000","last_undegraded":"2023-10-14T01:39:30.541316+0000","last_fullsized":"2023-10-14T01:39:30.541316+0000","mapping_epoch":13,"log_start":"175'332717","ondisk_log_start":"175'332717","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'295836","last_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_deep_scrub":"161'295836","last_deep_scrub_stamp":"2023-10-14T01:24:13.268144+0000","last_clean_scrub_stamp":"2023-10-14T01:24:13.268144+0000","objects_scrubbed":2299,"log_size":10080,"log_dups_size":0,"ondisk_log_size":10080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":607,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:03:17.121809+0000","scrub_duration":606.86230042800003,"objects_trimmed":0,"snaptrim_duration":0.60579484800000005,"stat_sum":{"num_bytes":3770327576,"num_objects":2299,"num_object_clones":1663,"num_object_copies":4598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2299,"num_whiteouts":0,"num_read":329573,"num_read_kb":1285024,"num_write":323533,"num_write_kb":1293785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2391,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"177'362168","reported_seq":711848,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:30.520365+0000","last_change":"2023-10-14T01:39:17.618683+0000","last_active":"2023-10-14T01:39:30.520365+0000","last_peered":"2023-10-14T01:39:30.520365+0000","last_clean":"2023-10-14T01:39:30.520365+0000","last_became_active":"2023-10-14T00:00:10.162811+0000","last_became_peered":"2023-10-14T00:00:10.162811+0000","last_unstale":"2023-10-14T01:39:30.520365+0000","last_undegraded":"2023-10-14T01:39:30.520365+0000","last_fullsized":"2023-10-14T01:39:30.520365+0000","mapping_epoch":13,"log_start":"175'352120","ondisk_log_start":"175'352120","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"177'361497","last_scrub_stamp":"2023-10-14T01:39:17.618453+0000","last_deep_scrub":"177'361497","last_deep_scrub_stamp":"2023-10-14T01:39:17.618453+0000","last_clean_scrub_stamp":"2023-10-14T01:39:17.618453+0000","objects_scrubbed":2406,"log_size":10048,"log_dups_size":0,"ondisk_log_size":10048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":904,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T09:40:49.982392+0000","scrub_duration":903.17564941600006,"objects_trimmed":0,"snaptrim_duration":0.60634582000000004,"stat_sum":{"num_bytes":3988529370,"num_objects":2406,"num_object_clones":1738,"num_object_copies":4812,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2406,"num_whiteouts":0,"num_read":352375,"num_read_kb":1365088,"num_write":342856,"num_write_kb":1370953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3801,"num_omap_keys":77,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"177'336550","reported_seq":661914,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:30.527867+0000","last_change":"2023-10-14T01:34:23.762434+0000","last_active":"2023-10-14T01:39:30.527867+0000","last_peered":"2023-10-14T01:39:30.527867+0000","last_clean":"2023-10-14T01:39:30.527867+0000","last_became_active":"2023-10-14T00:00:10.160631+0000","last_became_peered":"2023-10-14T00:00:10.160631+0000","last_unstale":"2023-10-14T01:39:30.527867+0000","last_undegraded":"2023-10-14T01:39:30.527867+0000","last_fullsized":"2023-10-14T01:39:30.527867+0000","mapping_epoch":13,"log_start":"175'326527","ondisk_log_start":"175'326527","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"172'320177","last_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_deep_scrub":"172'320177","last_deep_scrub_stamp":"2023-10-14T01:34:23.762245+0000","last_clean_scrub_stamp":"2023-10-14T01:34:23.762245+0000","objects_scrubbed":2262,"log_size":10023,"log_dups_size":0,"ondisk_log_size":10023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":599,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:42:04.235390+0000","scrub_duration":598.32181020999997,"objects_trimmed":0,"snaptrim_duration":0.60458445800000005,"stat_sum":{"num_bytes":3743212224,"num_objects":2262,"num_object_clones":1625,"num_object_copies":4524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2262,"num_whiteouts":0,"num_read":326713,"num_read_kb":1277699,"num_write":322518,"num_write_kb":1289762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1884,"num_omap_keys":24,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"177'333629","reported_seq":659791,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:30.511208+0000","last_change":"2023-10-14T01:24:22.432223+0000","last_active":"2023-10-14T01:39:30.511208+0000","last_peered":"2023-10-14T01:39:30.511208+0000","last_clean":"2023-10-14T01:39:30.511208+0000","last_became_active":"2023-10-14T00:00:10.161926+0000","last_became_peered":"2023-10-14T00:00:10.161926+0000","last_unstale":"2023-10-14T01:39:30.511208+0000","last_undegraded":"2023-10-14T01:39:30.511208+0000","last_fullsized":"2023-10-14T01:39:30.511208+0000","mapping_epoch":13,"log_start":"175'323622","ondisk_log_start":"175'323622","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"161'288437","last_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_deep_scrub":"161'288437","last_deep_scrub_stamp":"2023-10-14T01:24:22.432048+0000","last_clean_scrub_stamp":"2023-10-14T01:24:22.432048+0000","objects_scrubbed":2326,"log_size":10007,"log_dups_size":0,"ondisk_log_size":10007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":566,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:22:53.157014+0000","scrub_duration":565.42620814400004,"objects_trimmed":0,"snaptrim_duration":0.60615154699999996,"stat_sum":{"num_bytes":3760177834,"num_objects":2326,"num_object_clones":1684,"num_object_copies":4652,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2326,"num_whiteouts":0,"num_read":327514,"num_read_kb":1284308,"num_write":324838,"num_write_kb":1299101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1687,"num_omap_keys":53,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"177'336736","reported_seq":671280,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:31.292047+0000","last_change":"2023-10-14T01:14:49.467818+0000","last_active":"2023-10-14T01:39:31.292047+0000","last_peered":"2023-10-14T01:39:31.292047+0000","last_clean":"2023-10-14T01:39:31.292047+0000","last_became_active":"2023-10-14T00:00:10.160522+0000","last_became_peered":"2023-10-14T00:00:10.160522+0000","last_unstale":"2023-10-14T01:39:31.292047+0000","last_undegraded":"2023-10-14T01:39:31.292047+0000","last_fullsized":"2023-10-14T01:39:31.292047+0000","mapping_epoch":13,"log_start":"174'326723","ondisk_log_start":"174'326723","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"153'264446","last_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_deep_scrub":"153'264446","last_deep_scrub_stamp":"2023-10-14T01:14:49.467676+0000","last_clean_scrub_stamp":"2023-10-14T01:14:49.467676+0000","objects_scrubbed":2345,"log_size":10013,"log_dups_size":0,"ondisk_log_size":10013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":535,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T03:23:11.667966+0000","scrub_duration":534.87886934100004,"objects_trimmed":0,"snaptrim_duration":0.033827872000000002,"stat_sum":{"num_bytes":3832226313,"num_objects":2345,"num_object_clones":1695,"num_object_copies":4690,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2345,"num_whiteouts":0,"num_read":335973,"num_read_kb":1305294,"num_write":329990,"num_write_kb":1319481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4185,"num_omap_keys":56,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"177'340162","reported_seq":673919,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:29.142444+0000","last_change":"2023-10-14T01:14:06.856101+0000","last_active":"2023-10-14T01:39:29.142444+0000","last_peered":"2023-10-14T01:39:29.142444+0000","last_clean":"2023-10-14T01:39:29.142444+0000","last_became_active":"2023-10-14T00:00:10.163055+0000","last_became_peered":"2023-10-14T00:00:10.163055+0000","last_unstale":"2023-10-14T01:39:29.142444+0000","last_undegraded":"2023-10-14T01:39:29.142444+0000","last_fullsized":"2023-10-14T01:39:29.142444+0000","mapping_epoch":13,"log_start":"175'330112","ondisk_log_start":"175'330112","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'264072","last_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_deep_scrub":"152'264072","last_deep_scrub_stamp":"2023-10-14T01:14:06.855944+0000","last_clean_scrub_stamp":"2023-10-14T01:14:06.855944+0000","objects_scrubbed":2336,"log_size":10050,"log_dups_size":0,"ondisk_log_size":10050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":492,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T07:26:32.215440+0000","scrub_duration":491.36945072899999,"objects_trimmed":0,"snaptrim_duration":0.022788040999999998,"stat_sum":{"num_bytes":3882012990,"num_objects":2336,"num_object_clones":1687,"num_object_copies":4672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2336,"num_whiteouts":0,"num_read":335075,"num_read_kb":1317022,"num_write":334459,"num_write_kb":1337675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1159,"num_omap_keys":13,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"177'342284","reported_seq":679320,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:29.138182+0000","last_change":"2023-10-14T01:14:04.622708+0000","last_active":"2023-10-14T01:39:29.138182+0000","last_peered":"2023-10-14T01:39:29.138182+0000","last_clean":"2023-10-14T01:39:29.138182+0000","last_became_active":"2023-10-14T00:00:10.162400+0000","last_became_peered":"2023-10-14T00:00:10.162400+0000","last_unstale":"2023-10-14T01:39:29.138182+0000","last_undegraded":"2023-10-14T01:39:29.138182+0000","last_fullsized":"2023-10-14T01:39:29.138182+0000","mapping_epoch":13,"log_start":"175'332216","ondisk_log_start":"175'332216","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'265219","last_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_deep_scrub":"152'265219","last_deep_scrub_stamp":"2023-10-14T01:14:04.622529+0000","last_clean_scrub_stamp":"2023-10-14T01:14:04.622529+0000","objects_scrubbed":2369,"log_size":10068,"log_dups_size":0,"ondisk_log_size":10068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":490,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T11:49:31.517434+0000","scrub_duration":489.98941671300003,"objects_trimmed":0,"snaptrim_duration":0.062775709999999998,"stat_sum":{"num_bytes":3918791207,"num_objects":2369,"num_object_clones":1709,"num_object_copies":4738,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2369,"num_whiteouts":0,"num_read":338150,"num_read_kb":1330628,"num_write":336537,"num_write_kb":1346011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":725,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"177'388154","reported_seq":749874,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-14T01:39:30.516734+0000","last_change":"2023-10-14T01:31:35.644417+0000","last_active":"2023-10-14T01:39:30.516734+0000","last_peered":"2023-10-14T01:39:30.516734+0000","last_clean":"2023-10-14T01:39:30.516734+0000","last_became_active":"2023-10-14T00:00:10.162117+0000","last_became_peered":"2023-10-14T00:00:10.162117+0000","last_unstale":"2023-10-14T01:39:30.516734+0000","last_undegraded":"2023-10-14T01:39:30.516734+0000","last_fullsized":"2023-10-14T01:39:30.516734+0000","mapping_epoch":13,"log_start":"175'378116","ondisk_log_start":"175'378116","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'360061","last_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_deep_scrub":"170'360061","last_deep_scrub_stamp":"2023-10-14T01:31:35.644221+0000","last_clean_scrub_stamp":"2023-10-14T01:31:35.644221+0000","objects_scrubbed":2462,"log_size":10038,"log_dups_size":0,"ondisk_log_size":10038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1045,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:20:32.389058+0000","scrub_duration":1044.9700917130001,"objects_trimmed":0,"snaptrim_duration":0.70780131899999998,"stat_sum":{"num_bytes":4080632297,"num_objects":2462,"num_object_clones":1767,"num_object_copies":4924,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2462,"num_whiteouts":0,"num_read":362938,"num_read_kb":1400338,"num_write":353572,"num_write_kb":1413633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4783,"num_omap_keys":68,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"152'99","reported_seq":365,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-14T01:38:28.606026+0000","last_change":"2023-10-14T01:14:05.448968+0000","last_active":"2023-10-14T01:38:28.606026+0000","last_peered":"2023-10-14T01:38:28.606026+0000","last_clean":"2023-10-14T01:38:28.606026+0000","last_became_active":"2023-10-14T00:00:05.351880+0000","last_became_peered":"2023-10-14T00:00:05.351880+0000","last_unstale":"2023-10-14T01:38:28.606026+0000","last_undegraded":"2023-10-14T01:38:28.606026+0000","last_fullsized":"2023-10-14T01:38:28.606026+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"152'99","last_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_deep_scrub":"152'99","last_deep_scrub_stamp":"2023-10-14T01:14:05.448741+0000","last_clean_scrub_stamp":"2023-10-14T01:14:05.448741+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T10:14:18.721768+0000","scrub_duration":0.031110454999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":30975909811,"num_objects":18805,"num_object_clones":13568,"num_object_copies":37610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18805,"num_whiteouts":0,"num_read":2708311,"num_read_kb":10565401,"num_write":2668303,"num_write_kb":10670401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20615,"num_omap_keys":336,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21733896192,"data_stored":34242948966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49833,"internal_metadata":0},"log_size":80327,"ondisk_log_size":80327,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":12484,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359739559,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5979620,"kb_used_data":4076380,"kb_used_omap":727,"kb_used_meta":1902504,"kb_avail":88392220,"statfs":{"total":96636764160,"available":90513633280,"internally_reserved":0,"allocated":4174213120,"data_stored":6552442359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":745236,"internal_metadata":1948164332},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,3,4,11,2,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:39:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.111,"15min":0.86399999999999999},"min":{"1min":0.20499999999999999,"5min":0.19800000000000001,"15min":0.17699999999999999},"max":{"1min":6.1900000000000004,"5min":7.0599999999999996,"15min":8.0719999999999992},"last":0.30499999999999999},{"interface":"front","average":{"1min":1.454,"5min":1.131,"15min":0.90500000000000003},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":8.8249999999999993,"5min":8.8249999999999993,"15min":8.8249999999999993},"last":0.51000000000000001}]},{"osd":1,"last update":"Sat Oct 14 01:39:27 2023","interfaces":[{"interface":"back","average":{"1min":1.7549999999999999,"5min":1.0229999999999999,"15min":0.95199999999999996},"min":{"1min":0.223,"5min":0.19,"15min":0.19},"max":{"1min":10.266,"5min":10.266,"15min":11.846},"last":0.23599999999999999},{"interface":"front","average":{"1min":1.048,"5min":0.747,"15min":0.68899999999999995},"min":{"1min":0.27200000000000002,"5min":0.222,"15min":0.222},"max":{"1min":5.827,"5min":6.593,"15min":8.0229999999999997},"last":0.59899999999999998}]}]},{"osd":1,"up_from":8,"seq":34359739537,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12585188,"kb_used_data":10613148,"kb_used_omap":1230,"kb_used_meta":1970801,"kb_avail":81786652,"statfs":{"total":96636764160,"available":83749531648,"internally_reserved":0,"allocated":10867863552,"data_stored":17122185852,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1259961,"internal_metadata":2018100807},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,4,0,4,3,7,7,9,2],"upper_bound":512},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 01:39:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":0.93000000000000005,"15min":0.83199999999999996},"min":{"1min":0.221,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":4.7160000000000002,"5min":11.257999999999999,"15min":11.257999999999999},"last":6.7690000000000001},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.008,"15min":0.82399999999999995},"min":{"1min":0.26900000000000002,"5min":0.23000000000000001,"15min":0.185},"max":{"1min":4.907,"5min":11.233000000000001,"15min":11.233000000000001},"last":2.794}]},{"osd":2,"last update":"Sat Oct 14 01:39:14 2023","interfaces":[{"interface":"back","average":{"1min":1.8799999999999999,"5min":1.944,"15min":1.6699999999999999},"min":{"1min":0.216,"5min":0.20999999999999999,"15min":0.186},"max":{"1min":11.140000000000001,"5min":23.280000000000001,"15min":23.280000000000001},"last":3.9209999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66300000000000003,"15min":0.84299999999999997},"min":{"1min":0.23999999999999999,"5min":0.217,"15min":0.20699999999999999},"max":{"1min":3.3889999999999998,"5min":5.141,"15min":18.399999999999999},"last":4.29}]}]},{"osd":0,"up_from":8,"seq":34359739559,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8246720,"kb_used_data":6538360,"kb_used_omap":1223,"kb_used_meta":1707128,"kb_avail":86125120,"statfs":{"total":96636764160,"available":88192122880,"internally_reserved":0,"allocated":6695280640,"data_stored":10570444078,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1253192,"internal_metadata":1748099256},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,1,2,3,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 01:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.77000000000000002,"15min":0.91300000000000003},"min":{"1min":0.26500000000000001,"5min":0.19700000000000001,"15min":0.158},"max":{"1min":1.321,"5min":6.1070000000000002,"15min":9.5030000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":1.246,"5min":0.78400000000000003,"15min":0.84099999999999997},"min":{"1min":0.24199999999999999,"5min":0.221,"15min":0.21199999999999999},"max":{"1min":6.4340000000000002,"5min":7.0720000000000001,"15min":9.5510000000000002},"last":0.316}]},{"osd":2,"last update":"Sat Oct 14 01:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":1.1699999999999999,"15min":0.88600000000000001},"min":{"1min":0.25,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":4.8719999999999999,"5min":10.576000000000001,"15min":10.576000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.141,"15min":1.0589999999999999},"min":{"1min":0.28100000000000003,"5min":0.22600000000000001,"15min":0.187},"max":{"1min":6.4960000000000004,"5min":10.375999999999999,"15min":10.375999999999999},"last":0.42399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6242,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6694256640,"data_stored":10569640549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17328,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10866966528,"data_stored":17121497011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22168,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4172673024,"data_stored":6551811406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10337,"internal_metadata":0}]}} 2023-10-14T01:39:32.422 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-14T01:39:33.346 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T01:39:33.346 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T01:39:33.347 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T01:39:33.347 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T01:39:36.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:36.056+0000 7f3f36fa4640 -1 reset not still connected to 0x5588918b45b0 2023-10-14T01:39:36.060 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:36.056+0000 7f3f36fa4640 -1 reset not still connected to 0x558897948dd0 2023-10-14T01:39:36.068 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:36.060+0000 7f3f36fa4640 -1 reset not still connected to 0x55889ed2f520 2023-10-14T01:39:36.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-14T01:39:37.604 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:37.604+0000 7f3f36fa4640 -1 reset not still connected to 0x55887812ba00 2023-10-14T01:39:37.612 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:37.612+0000 7f3f36fa4640 -1 reset not still connected to 0x558879cefa00 2023-10-14T01:39:37.619 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:37.616+0000 7f3f36fa4640 -1 reset not still connected to 0x55887beb2340 2023-10-14T01:39:37.620 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:37.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55887f8b3ad0 2023-10-14T01:39:37.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:37.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558885c16d00 2023-10-14T01:39:37.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:37.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558890862dd0 2023-10-14T01:39:37.621 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:37.620+0000 7f3f36fa4640 -1 reset not still connected to 0x5588918b45b0 2023-10-14T01:39:37.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:37.620+0000 7f3f36fa4640 -1 reset not still connected to 0x558897948dd0 2023-10-14T01:39:37.622 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:37.620+0000 7f3f36fa4640 -1 reset not still connected to 0x55889ed2f520 2023-10-14T01:39:39.219 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.215+0000 7f3f36fa4640 -1 reset not still connected to 0x55887812ba00 2023-10-14T01:39:39.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.227+0000 7f3f36fa4640 -1 reset not still connected to 0x558879cefa00 2023-10-14T01:39:39.228 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.227+0000 7f3f36fa4640 -1 reset not still connected to 0x55887beb2340 2023-10-14T01:39:39.264 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.255+0000 7f3f36fa4640 -1 reset not still connected to 0x55887f8b3ad0 2023-10-14T01:39:39.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558885c16d00 2023-10-14T01:39:39.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558890862dd0 2023-10-14T01:39:39.265 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.255+0000 7f3f36fa4640 -1 reset not still connected to 0x5588918b45b0 2023-10-14T01:39:39.266 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.255+0000 7f3f36fa4640 -1 reset not still connected to 0x558897948dd0 2023-10-14T01:39:39.267 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.263+0000 7f3f36fa4640 -1 reset not still connected to 0x55889ed2f520 2023-10-14T01:39:39.271 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.267+0000 7f3f36fa4640 -1 reset not still connected to 0x5588a2076d00 2023-10-14T01:39:39.405 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.403+0000 7f3f36fa4640 -1 reset not still connected to 0x55887812ba00 2023-10-14T01:39:39.407 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.403+0000 7f3f36fa4640 -1 reset not still connected to 0x558879cefa00 2023-10-14T01:39:39.410 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.407+0000 7f3f36fa4640 -1 reset not still connected to 0x55887beb2340 2023-10-14T01:39:39.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.411+0000 7f3f36fa4640 -1 reset not still connected to 0x55887f8b3ad0 2023-10-14T01:39:39.412 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558885c16d00 2023-10-14T01:39:39.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558890862dd0 2023-10-14T01:39:39.413 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.411+0000 7f3f36fa4640 -1 reset not still connected to 0x5588918b45b0 2023-10-14T01:39:39.414 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.411+0000 7f3f36fa4640 -1 reset not still connected to 0x558897948dd0 2023-10-14T01:39:39.419 INFO:tasks.ceph.osd.1.smithi191.stderr:2023-10-14T01:39:39.419+0000 7f3f36fa4640 -1 reset not still connected to 0x55889ed2f520 2023-10-14T01:39:39.450 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T01:39:39.451 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T01:39:39.451 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T01:39:41.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-14T01:39:41.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-14T01:39:45.553 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T01:39:45.555 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T01:39:45.556 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T01:39:46.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-14T01:39:46.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-14T01:39:51.658 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T01:39:51.659 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T01:39:51.660 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T01:39:51.660 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T01:39:51.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-14T01:39:56.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-10-14T01:39:57.762 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T01:39:57.762 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T01:39:57.763 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T01:39:57.763 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T01:40:01.965 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-14T01:40:01.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-10-14T01:40:03.865 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T01:40:03.866 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T01:40:03.867 DEBUG:teuthology.orchestra.run.smithi191:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2023-10-14T01:40:03.950 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-14T01:40:03.951 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T01:40:04.776 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-14T01:40:04.777 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T01:40:05.654 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi191.front.sepia.ceph.com 2023-10-14T01:40:05.654 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T01:40:06.073 INFO:tasks.ceph:Archiving mon data... 2023-10-14T01:40:06.074 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi/7427261/data/mon.a.tgz 2023-10-14T01:40:06.075 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2023-10-14T01:40:06.092 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.NBNrPjFfBW 2023-10-14T01:40:06.093 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.NBNrPjFfBW 2023-10-14T01:40:06.278 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.NBNrPjFfBW 2023-10-14T01:40:06.370 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.NBNrPjFfBW is 655KB 2023-10-14T01:40:06.434 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.NBNrPjFfBW 2023-10-14T01:40:06.441 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T01:40:06.441 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T01:40:06.547 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T01:40:06.547 DEBUG:teuthology.orchestra.run.smithi191:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T01:40:06.598 INFO:teuthology.orchestra.run.smithi191.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T01:40:06.601 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T01:40:06.604 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/crash to /home/teuthworker/archive/dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi/7427261/remote/smithi191/crash 2023-10-14T01:40:06.605 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T01:40:06.616 INFO:tasks.ceph:Compressing logs... 2023-10-14T01:40:06.617 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T01:40:06.677 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49474.log 2023-10-14T01:40:06.679 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50722.log 2023-10-14T01:40:06.679 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54946.log 2023-10-14T01:40:06.680 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43887.log 2023-10-14T01:40:06.680 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40554.log 2023-10-14T01:40:06.680 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54946.log.gz 2023-10-14T01:40:06.681 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46169.log 2023-10-14T01:40:06.681 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50722.log.gz 2023-10-14T01:40:06.681 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52700.log 2023-10-14T01:40:06.927 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50292.log 2023-10-14T01:40:06.927 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52700.log.gz 2023-10-14T01:40:06.927 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48348.log 2023-10-14T01:40:06.928 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44604.log 2023-10-14T01:40:06.928 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50292.log: /var/log/ceph/ceph-client.admin.48348.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30867.log 2023-10-14T01:40:06.928 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38950.log 2023-10-14T01:40:06.929 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose/var/log/ceph/ceph.tmp-client.admin.30867.log: -- /var/log/ceph/ceph-client.admin.45618.log 2023-10-14T01:40:06.929 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38950.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30867.log.gz 2023-10-14T01:40:06.929 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50904.log 2023-10-14T01:40:06.930 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53118.log 2023-10-14T01:40:06.930 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49717.log 2023-10-14T01:40:06.931 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50904.log.gz 2023-10-14T01:40:06.931 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53118.log.gz 2023-10-14T01:40:06.931 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38663.log 2023-10-14T01:40:06.931 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50812.log 2023-10-14T01:40:06.932 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52153.log 2023-10-14T01:40:06.932 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42944.log 2023-10-14T01:40:06.932 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50812.log.gz 2023-10-14T01:40:06.933 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37655.log 2023-10-14T01:40:06.933 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52153.log.gz 2023-10-14T01:40:06.933 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39803.log 2023-10-14T01:40:06.934 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39311.log 2023-10-14T01:40:06.934 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37655.log.gz 2023-10-14T01:40:06.934 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51420.log 2023-10-14T01:40:06.934 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52263.log 2023-10-14T01:40:06.935 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2023-10-14T01:40:06.935 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51420.log.gz 2023-10-14T01:40:06.935 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47435.log 2023-10-14T01:40:06.936 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52263.log.gz 2023-10-14T01:40:06.936 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55691.log 2023-10-14T01:40:06.936 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39220.log 2023-10-14T01:40:06.936 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45618.log.gz -- replaced with /var/log/ceph/ceph-client.admin.39311.log.gz -- replaced with /var/log/ceph/ceph-client.admin.38950.log.gz 2023-10-14T01:40:06.937 INFO:teuthology.orchestra.run.smithi191.stderr: 2023-10-14T01:40:06.937 INFO:teuthology.orchestra.run.smithi191.stderr: 2023-10-14T01:40:06.937 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40554.log.gz 2023-10-14T01:40:06.938 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38663.log.gz 2023-10-14T01:40:06.938 INFO:teuthology.orchestra.run.smithi191.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43887.log.gz 2023-10-14T01:40:06.938 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44604.log.gz 2023-10-14T01:40:06.938 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50292.log.gz 2023-10-14T01:40:06.939 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2023-10-14T01:40:06.939 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46169.log.gz 2023-10-14T01:40:06.939 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42944.log.gz 2023-10-14T01:40:06.939 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39803.log.gz 0.0% 2023-10-14T01:40:06.940 INFO:teuthology.orchestra.run.smithi191.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47435.log.gz 2023-10-14T01:40:06.940 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49717.log.gz 2023-10-14T01:40:06.940 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55691.log.gz 2023-10-14T01:40:06.941 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48348.log.gz 2023-10-14T01:40:06.941 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53066.log 2023-10-14T01:40:06.941 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49474.log.gz 2023-10-14T01:40:06.941 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39220.log.gz 2023-10-14T01:40:06.942 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53855.log 2023-10-14T01:40:06.942 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53066.log.gz 2023-10-14T01:40:06.942 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41778.log 2023-10-14T01:40:06.943 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54343.log 2023-10-14T01:40:06.943 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53855.log.gz 2023-10-14T01:40:06.943 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41778.log.gz 2023-10-14T01:40:06.944 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51603.log 2023-10-14T01:40:06.944 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51450.log 2023-10-14T01:40:06.944 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54343.log.gz 2023-10-14T01:40:06.944 INFO:teuthology.orchestra.run.smithi191.stderr:gzip/var/log/ceph/ceph-client.admin.51603.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53567.log 2023-10-14T01:40:06.945 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51603.log.gz 2023-10-14T01:40:06.945 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39877.log 2023-10-14T01:40:06.945 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51450.log.gz 2023-10-14T01:40:06.946 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51785.log 2023-10-14T01:40:06.946 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53567.log.gz 2023-10-14T01:40:06.946 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54655.log 2023-10-14T01:40:06.947 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39877.log.gz 2023-10-14T01:40:06.947 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39149.log 2023-10-14T01:40:06.947 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51785.log.gz 2023-10-14T01:40:06.948 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38461.log 2023-10-14T01:40:06.948 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54655.log.gz 2023-10-14T01:40:06.948 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56272.log 2023-10-14T01:40:06.949 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39149.log.gz 2023-10-14T01:40:06.949 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49168.log 2023-10-14T01:40:06.949 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38461.log.gz 2023-10-14T01:40:06.950 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45341.log 2023-10-14T01:40:06.950 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56272.log.gz 2023-10-14T01:40:06.950 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41158.log 2023-10-14T01:40:06.951 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49168.log.gz 2023-10-14T01:40:06.951 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43246.log 2023-10-14T01:40:06.951 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45341.log.gz 2023-10-14T01:40:06.952 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38680.log 2023-10-14T01:40:06.952 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41158.log.gz 2023-10-14T01:40:06.952 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53621.log 2023-10-14T01:40:06.953 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43246.log.gz 2023-10-14T01:40:06.953 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41846.log 2023-10-14T01:40:06.953 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38680.log.gz 2023-10-14T01:40:06.954 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52226.log 2023-10-14T01:40:06.954 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53621.log.gz 2023-10-14T01:40:06.954 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39527.log 2023-10-14T01:40:06.955 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41846.log.gz 2023-10-14T01:40:06.955 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.52226.log: /var/log/ceph/ceph-client.admin.56087.log 2023-10-14T01:40:06.955 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52226.log.gz 2023-10-14T01:40:06.956 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47407.log 2023-10-14T01:40:06.956 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39527.log.gz 2023-10-14T01:40:06.956 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49566.log 2023-10-14T01:40:06.957 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56087.log.gz 2023-10-14T01:40:06.957 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53514.log 2023-10-14T01:40:06.957 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47407.log.gz 2023-10-14T01:40:06.958 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38555.log 2023-10-14T01:40:06.958 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49566.log.gz 2023-10-14T01:40:06.958 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.53514.log: /var/log/ceph/ceph-client.admin.45955.log 2023-10-14T01:40:06.959 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53514.log.gz 2023-10-14T01:40:06.959 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38555.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38555.log.gz -5 2023-10-14T01:40:06.959 INFO:teuthology.orchestra.run.smithi191.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44879.log 2023-10-14T01:40:06.960 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50050.log 2023-10-14T01:40:06.960 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45955.log.gz 2023-10-14T01:40:06.960 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44331.log 2023-10-14T01:40:06.961 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39657.log 2023-10-14T01:40:06.961 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44879.log: /var/log/ceph/ceph-client.admin.50050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44879.log.gz 2023-10-14T01:40:06.961 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50050.log.gz 2023-10-14T01:40:06.961 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49443.log 2023-10-14T01:40:06.962 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44331.log.gz 2023-10-14T01:40:06.962 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56009.log 2023-10-14T01:40:06.962 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39657.log.gz 2023-10-14T01:40:06.962 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56673.log 2023-10-14T01:40:06.963 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49443.log.gz 2023-10-14T01:40:06.963 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38751.log 2023-10-14T01:40:06.963 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56009.log.gz 2023-10-14T01:40:06.964 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45289.log 2023-10-14T01:40:06.964 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56673.log.gz 2023-10-14T01:40:06.964 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38751.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T01:40:06.964 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38751.log.gz 2023-10-14T01:40:06.965 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45289.log.gz 2023-10-14T01:40:06.965 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48470.log 2023-10-14T01:40:06.965 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55534.log 2023-10-14T01:40:06.966 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43749.log 2023-10-14T01:40:06.966 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48470.log.gz 2023-10-14T01:40:06.966 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50172.log 2023-10-14T01:40:06.966 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55534.log.gz 2023-10-14T01:40:06.967 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42818.log 2023-10-14T01:40:06.967 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43749.log.gz 2023-10-14T01:40:06.967 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47367.log 2023-10-14T01:40:06.968 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50172.log.gz 2023-10-14T01:40:06.968 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52451.log 2023-10-14T01:40:06.968 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42818.log.gz 2023-10-14T01:40:06.968 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47367.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47367.log.gz /var/log/ceph/ceph-client.admin.39328.log 2023-10-14T01:40:06.969 INFO:teuthology.orchestra.run.smithi191.stderr: 2023-10-14T01:40:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46090.log 2023-10-14T01:40:06.969 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52451.log.gz 2023-10-14T01:40:06.969 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39328.log.gz 2023-10-14T01:40:06.970 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40455.log 2023-10-14T01:40:06.970 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50629.log 2023-10-14T01:40:06.970 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46090.log.gz 2023-10-14T01:40:06.971 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42051.log 2023-10-14T01:40:06.971 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40455.log.gz 2023-10-14T01:40:06.971 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54629.log 2023-10-14T01:40:06.971 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50629.log.gz 2023-10-14T01:40:06.972 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40725.log 2023-10-14T01:40:06.972 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42051.log.gz 2023-10-14T01:40:06.972 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53332.log 2023-10-14T01:40:06.973 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54629.log.gz 2023-10-14T01:40:06.973 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43915.log 2023-10-14T01:40:06.973 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40725.log.gz 2023-10-14T01:40:06.974 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40878.log 2023-10-14T01:40:06.974 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53332.log.gz 2023-10-14T01:40:06.974 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41535.log 2023-10-14T01:40:06.977 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43915.log.gz 2023-10-14T01:40:06.978 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45368.log 2023-10-14T01:40:06.978 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40878.log.gz 2023-10-14T01:40:06.978 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44574.log 2023-10-14T01:40:06.979 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41535.log.gz 2023-10-14T01:40:06.979 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42400.log 2023-10-14T01:40:06.979 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45368.log.gz 2023-10-14T01:40:06.980 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44574.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.44574.log.gz 2023-10-14T01:40:06.980 INFO:teuthology.orchestra.run.smithi191.stderr: /var/log/ceph/ceph-client.admin.48237.log 2023-10-14T01:40:06.980 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49929.log 2023-10-14T01:40:06.981 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42400.log.gz 2023-10-14T01:40:06.981 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48237.log.gz 2023-10-14T01:40:06.981 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50476.log 2023-10-14T01:40:06.982 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47501.log 2023-10-14T01:40:06.982 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49929.log.gz 2023-10-14T01:40:06.982 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53251.log 2023-10-14T01:40:06.983 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50476.log.gz 2023-10-14T01:40:06.983 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47501.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.47501.log.gz 2023-10-14T01:40:06.983 INFO:teuthology.orchestra.run.smithi191.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41262.log 2023-10-14T01:40:06.984 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52099.log 2023-10-14T01:40:06.984 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53251.log.gz 2023-10-14T01:40:06.984 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41688.log 2023-10-14T01:40:06.985 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41262.log.gz 2023-10-14T01:40:06.985 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38427.log 2023-10-14T01:40:06.985 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52099.log.gz 2023-10-14T01:40:06.986 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37571.log 2023-10-14T01:40:06.986 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41688.log.gz 2023-10-14T01:40:06.986 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53436.log 2023-10-14T01:40:06.987 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38427.log.gz 2023-10-14T01:40:06.987 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37571.log.gz 2023-10-14T01:40:06.987 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44517.log 2023-10-14T01:40:06.988 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50322.log 2023-10-14T01:40:06.988 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53436.log.gz 2023-10-14T01:40:06.988 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41043.log 2023-10-14T01:40:06.989 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44517.log.gz 2023-10-14T01:40:06.989 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50322.log.gz 2023-10-14T01:40:06.989 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52858.log 2023-10-14T01:40:06.990 INFO:teuthology.orchestra.run.smithi191.stderr:gzip/var/log/ceph/ceph-client.admin.41043.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48562.log 2023-10-14T01:40:06.990 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41043.log.gz 2023-10-14T01:40:06.990 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52858.log.gz 2023-10-14T01:40:06.991 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45463.log 2023-10-14T01:40:06.991 INFO:teuthology.orchestra.run.smithi191.stderr:gzip/var/log/ceph/ceph-client.admin.48562.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50020.log 2023-10-14T01:40:06.991 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48562.log.gz 2023-10-14T01:40:06.992 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45006.log 2023-10-14T01:40:06.992 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45463.log.gz 2023-10-14T01:40:06.992 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50020.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50020.log.gz -5 2023-10-14T01:40:06.993 INFO:teuthology.orchestra.run.smithi191.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38913.log 2023-10-14T01:40:06.993 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.45006.log: -- /var/log/ceph/ceph-client.admin.54868.log 2023-10-14T01:40:06.993 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45006.log.gz 2023-10-14T01:40:06.993 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38913.log.gz 2023-10-14T01:40:06.994 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50202.log 2023-10-14T01:40:06.994 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46576.log 2023-10-14T01:40:06.994 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54868.log.gz 2023-10-14T01:40:06.995 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38444.log 2023-10-14T01:40:06.995 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50202.log.gz 2023-10-14T01:40:06.995 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46576.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.42184.log -- replaced with /var/log/ceph/ceph-client.admin.46576.log.gz 2023-10-14T01:40:06.995 INFO:teuthology.orchestra.run.smithi191.stderr: 2023-10-14T01:40:06.996 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38444.log: /var/log/ceph/ceph-client.admin.45495.log 2023-10-14T01:40:06.996 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38444.log.gz 2023-10-14T01:40:06.996 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48267.log 2023-10-14T01:40:06.997 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42184.log.gz 2023-10-14T01:40:06.997 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45495.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45495.log.gz 2023-10-14T01:40:06.997 INFO:teuthology.orchestra.run.smithi191.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45648.log 2023-10-14T01:40:06.997 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53777.log 2023-10-14T01:40:06.998 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48267.log.gz 2023-10-14T01:40:06.998 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45648.log.gz 2023-10-14T01:40:06.998 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48897.log 2023-10-14T01:40:06.999 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40265.log 2023-10-14T01:40:06.999 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53777.log.gz 2023-10-14T01:40:06.999 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43996.log 2023-10-14T01:40:06.999 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48897.log.gz 2023-10-14T01:40:07.000 INFO:teuthology.orchestra.run.smithi191.stderr:gzip/var/log/ceph/ceph-client.admin.40265.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55027.log 2023-10-14T01:40:07.000 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40265.log.gz 2023-10-14T01:40:07.000 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54499.log 2023-10-14T01:40:07.001 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43996.log.gz 2023-10-14T01:40:07.001 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37597.log 2023-10-14T01:40:07.001 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55027.log.gz 2023-10-14T01:40:07.002 INFO:teuthology.orchestra.run.smithi191.stderr:gzip/var/log/ceph/ceph-client.admin.54499.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38572.log 2023-10-14T01:40:07.002 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54499.log.gz 2023-10-14T01:40:07.002 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52962.log 2023-10-14T01:40:07.003 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37597.log.gz 2023-10-14T01:40:07.003 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50997.log 2023-10-14T01:40:07.003 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38572.log.gz 2023-10-14T01:40:07.003 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55743.log 2023-10-14T01:40:07.004 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52962.log.gz 2023-10-14T01:40:07.004 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51027.log 2023-10-14T01:40:07.004 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50997.log.gz 2023-10-14T01:40:07.005 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55743.log.gz 2023-10-14T01:40:07.005 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49078.log 2023-10-14T01:40:07.005 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46749.log 2023-10-14T01:40:07.005 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51027.log.gz 2023-10-14T01:40:07.006 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49078.log.gz 2023-10-14T01:40:07.006 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37727.log 2023-10-14T01:40:07.006 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43659.log 2023-10-14T01:40:07.007 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46749.log.gz 2023-10-14T01:40:07.007 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40349.log 2023-10-14T01:40:07.007 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37727.log.gz 2023-10-14T01:40:07.007 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55507.log 2023-10-14T01:40:07.008 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43659.log.gz 2023-10-14T01:40:07.008 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40349.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.40349.log.gz --verbose 2023-10-14T01:40:07.008 INFO:teuthology.orchestra.run.smithi191.stderr: -- /var/log/ceph/ceph-client.admin.54235.log 2023-10-14T01:40:07.009 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50692.log 2023-10-14T01:40:07.009 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55507.log.gz 2023-10-14T01:40:07.009 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52622.log 2023-10-14T01:40:07.009 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54235.log.gz 2023-10-14T01:40:07.010 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50692.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T01:40:07.010 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50692.log.gz 2023-10-14T01:40:07.011 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49320.log 2023-10-14T01:40:07.011 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52622.log.gz 2023-10-14T01:40:07.011 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54447.log 2023-10-14T01:40:07.012 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49320.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.54317.log -- replaced with /var/log/ceph/ceph-client.admin.49320.log.gz 2023-10-14T01:40:07.012 INFO:teuthology.orchestra.run.smithi191.stderr: 2023-10-14T01:40:07.012 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54447.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54447.log.gz -5 2023-10-14T01:40:07.013 INFO:teuthology.orchestra.run.smithi191.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42971.log 2023-10-14T01:40:07.013 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5/var/log/ceph/ceph-client.admin.54317.log: --verbose -- /var/log/ceph/ceph-client.admin.44849.log 2023-10-14T01:40:07.013 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54317.log.gz 2023-10-14T01:40:07.014 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47859.log 2023-10-14T01:40:07.014 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2023-10-14T01:40:07.014 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49353.log 2023-10-14T01:40:07.015 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44849.log.gz 2023-10-14T01:40:07.015 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44709.log 2023-10-14T01:40:07.015 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47859.log.gz 2023-10-14T01:40:07.016 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38478.log 2023-10-14T01:40:07.016 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49353.log.gz 2023-10-14T01:40:07.016 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44709.log.gz 2023-10-14T01:40:07.017 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49657.log 2023-10-14T01:40:07.017 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51390.log 2023-10-14T01:40:07.017 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38478.log.gz 2023-10-14T01:40:07.018 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49657.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.49657.log.gz --verbose 2023-10-14T01:40:07.018 INFO:teuthology.orchestra.run.smithi191.stderr: -- /var/log/ceph/ceph-client.admin.55982.log 2023-10-14T01:40:07.018 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39707.log 2023-10-14T01:40:07.019 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51390.log.gz 2023-10-14T01:40:07.019 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44421.log 2023-10-14T01:40:07.019 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55982.log.gz 2023-10-14T01:40:07.020 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39707.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.43464.log -- replaced with /var/log/ceph/ceph-client.admin.39707.log.gz 2023-10-14T01:40:07.020 INFO:teuthology.orchestra.run.smithi191.stderr: 2023-10-14T01:40:07.020 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39473.log 2023-10-14T01:40:07.021 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44421.log.gz 2023-10-14T01:40:07.021 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55080.log 2023-10-14T01:40:07.021 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43464.log.gz 2023-10-14T01:40:07.021 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39166.log 2023-10-14T01:40:07.022 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39473.log.gz 2023-10-14T01:40:07.022 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34425.log 2023-10-14T01:40:07.023 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55080.log.gz 2023-10-14T01:40:07.023 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47241.log 2023-10-14T01:40:07.023 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39166.log.gz 2023-10-14T01:40:07.023 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40605.log 2023-10-14T01:40:07.024 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34425.log.gz 2023-10-14T01:40:07.024 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43631.log 2023-10-14T01:40:07.024 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47241.log.gz 2023-10-14T01:40:07.025 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50416.log 2023-10-14T01:40:07.025 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40605.log.gz 2023-10-14T01:40:07.025 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43631.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T01:40:07.025 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43631.log.gz 2023-10-14T01:40:07.026 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50416.log.gz 2023-10-14T01:40:07.026 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56542.log 2023-10-14T01:40:07.026 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49687.log 2023-10-14T01:40:07.027 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55847.log 2023-10-14T01:40:07.027 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56542.log.gz 2023-10-14T01:40:07.027 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39961.log 2023-10-14T01:40:07.027 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49687.log.gz 2023-10-14T01:40:07.028 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39741.log 2023-10-14T01:40:07.028 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55847.log.gz 2023-10-14T01:40:07.028 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39961.log.gz 2023-10-14T01:40:07.028 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55401.log 2023-10-14T01:40:07.029 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42728.log 2023-10-14T01:40:07.029 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39741.log.gz 2023-10-14T01:40:07.029 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55401.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.55401.log.gz -5 2023-10-14T01:40:07.030 INFO:teuthology.orchestra.run.smithi191.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55317.log 2023-10-14T01:40:07.030 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46536.log 2023-10-14T01:40:07.030 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42728.log.gz 2023-10-14T01:40:07.031 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50232.log 2023-10-14T01:40:07.031 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55317.log.gz 2023-10-14T01:40:07.031 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46536.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.46536.log.gz --verbose 2023-10-14T01:40:07.032 INFO:teuthology.orchestra.run.smithi191.stderr: -- /var/log/ceph/ceph-client.admin.55343.log 2023-10-14T01:40:07.032 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39237.log 2023-10-14T01:40:07.032 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50232.log.gz 2023-10-14T01:40:07.033 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44950.log 2023-10-14T01:40:07.033 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55343.log.gz 2023-10-14T01:40:07.033 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48835.log 2023-10-14T01:40:07.033 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39237.log.gz 2023-10-14T01:40:07.034 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47189.log 2023-10-14T01:40:07.034 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44950.log.gz 2023-10-14T01:40:07.034 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48835.log.gz 2023-10-14T01:40:07.035 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47304.log 2023-10-14T01:40:07.035 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42758.log 2023-10-14T01:40:07.035 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47189.log.gz 2023-10-14T01:40:07.035 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47470.log 2023-10-14T01:40:07.036 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47304.log.gz 2023-10-14T01:40:07.036 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38609.log 2023-10-14T01:40:07.036 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42758.log.gz 2023-10-14T01:40:07.037 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47829.log 2023-10-14T01:40:07.037 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47470.log.gz 2023-10-14T01:40:07.037 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50843.log 2023-10-14T01:40:07.038 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38609.log.gz 2023-10-14T01:40:07.038 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53384.log 2023-10-14T01:40:07.038 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47829.log.gz 2023-10-14T01:40:07.039 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51633.log 2023-10-14T01:40:07.039 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50843.log.gz 2023-10-14T01:40:07.039 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51906.log 2023-10-14T01:40:07.040 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53384.log.gz 2023-10-14T01:40:07.040 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42510.log 2023-10-14T01:40:07.040 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51633.log.gz 2023-10-14T01:40:07.041 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52244.log 2023-10-14T01:40:07.041 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51906.log.gz 2023-10-14T01:40:07.041 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53225.log 2023-10-14T01:40:07.042 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42510.log.gz 2023-10-14T01:40:07.042 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45678.log 2023-10-14T01:40:07.042 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52244.log.gz 2023-10-14T01:40:07.042 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42021.log 2023-10-14T01:40:07.043 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53225.log.gz 2023-10-14T01:40:07.043 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43526.log 2023-10-14T01:40:07.044 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45678.log.gz 2023-10-14T01:40:07.044 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41658.log 2023-10-14T01:40:07.044 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42021.log.gz 2023-10-14T01:40:07.044 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52317.log 2023-10-14T01:40:07.045 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43526.log.gz 2023-10-14T01:40:07.045 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44493.log 2023-10-14T01:40:07.045 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41658.log.gz 2023-10-14T01:40:07.046 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48318.log 2023-10-14T01:40:07.046 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52317.log.gz 2023-10-14T01:40:07.046 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39507.log 2023-10-14T01:40:07.047 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44493.log.gz 2023-10-14T01:40:07.047 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42571.log 2023-10-14T01:40:07.047 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48318.log.gz 2023-10-14T01:40:07.048 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39507.log.gz 2023-10-14T01:40:07.048 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52805.log 2023-10-14T01:40:07.048 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42540.log 2023-10-14T01:40:07.049 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42571.log.gz 2023-10-14T01:40:07.049 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56699.log 2023-10-14T01:40:07.049 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52805.log.gz 2023-10-14T01:40:07.050 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44982.log 2023-10-14T01:40:07.050 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42540.log.gz 2023-10-14T01:40:07.050 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48927.log 2023-10-14T01:40:07.050 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56699.log.gz 2023-10-14T01:40:07.051 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51725.log 2023-10-14T01:40:07.051 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44982.log.gz 2023-10-14T01:40:07.051 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48623.log 2023-10-14T01:40:07.051 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48927.log.gz 2023-10-14T01:40:07.052 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42701.log 2023-10-14T01:40:07.052 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51725.log.gz 2023-10-14T01:40:07.052 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46291.log 2023-10-14T01:40:07.053 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48623.log.gz 2023-10-14T01:40:07.053 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38933.log 2023-10-14T01:40:07.053 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42701.log.gz 2023-10-14T01:40:07.053 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46015.log 2023-10-14T01:40:07.054 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46291.log.gz 2023-10-14T01:40:07.054 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52570.log 2023-10-14T01:40:07.054 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38933.log.gz 2023-10-14T01:40:07.055 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55560.log 2023-10-14T01:40:07.055 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46015.log.gz 2023-10-14T01:40:07.055 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44762.log 2023-10-14T01:40:07.055 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52570.log.gz 2023-10-14T01:40:07.056 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48378.log 2023-10-14T01:40:07.056 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55560.log.gz 2023-10-14T01:40:07.056 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45846.log 2023-10-14T01:40:07.057 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44762.log.gz 2023-10-14T01:40:07.057 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48378.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.48378.log.gz -5 2023-10-14T01:40:07.057 INFO:teuthology.orchestra.run.smithi191.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40797.log 2023-10-14T01:40:07.057 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53541.log 2023-10-14T01:40:07.058 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45846.log.gz 2023-10-14T01:40:07.058 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39058.log 2023-10-14T01:40:07.058 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40797.log.gz 2023-10-14T01:40:07.059 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43216.log 2023-10-14T01:40:07.059 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53541.log.gz 2023-10-14T01:40:07.059 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46604.log 2023-10-14T01:40:07.060 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39058.log.gz 2023-10-14T01:40:07.060 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43165.log 2023-10-14T01:40:07.060 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43216.log.gz 2023-10-14T01:40:07.061 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53488.log 2023-10-14T01:40:07.061 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46604.log.gz 2023-10-14T01:40:07.061 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37883.log 2023-10-14T01:40:07.062 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43165.log.gz 2023-10-14T01:40:07.062 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55956.log 2023-10-14T01:40:07.062 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53488.log.gz 2023-10-14T01:40:07.063 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49838.log 2023-10-14T01:40:07.063 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37883.log.gz 2023-10-14T01:40:07.063 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56035.log 2023-10-14T01:40:07.064 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55956.log.gz 2023-10-14T01:40:07.064 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53647.log 2023-10-14T01:40:07.064 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49838.log.gz 2023-10-14T01:40:07.065 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56035.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.56035.log.gz -5 2023-10-14T01:40:07.065 INFO:teuthology.orchestra.run.smithi191.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41505.log 2023-10-14T01:40:07.065 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38805.log 2023-10-14T01:40:07.066 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53647.log.gz 2023-10-14T01:40:07.066 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55901.log 2023-10-14T01:40:07.066 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41505.log.gz 2023-10-14T01:40:07.067 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41128.log 2023-10-14T01:40:07.067 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38805.log.gz 2023-10-14T01:40:07.067 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43557.log 2023-10-14T01:40:07.068 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55901.log.gz 2023-10-14T01:40:07.068 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52831.log 2023-10-14T01:40:07.068 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41128.log.gz 2023-10-14T01:40:07.068 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43557.log.gz 2023-10-14T01:40:07.069 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43436.log 2023-10-14T01:40:07.069 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43189.log 2023-10-14T01:40:07.069 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52831.log.gz 2023-10-14T01:40:07.070 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52752.log 2023-10-14T01:40:07.070 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43436.log.gz 2023-10-14T01:40:07.070 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53935.log 2023-10-14T01:40:07.071 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43189.log.gz 2023-10-14T01:40:07.071 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55134.log 2023-10-14T01:40:07.071 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52752.log.gz 2023-10-14T01:40:07.072 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53935.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.39625.log 2023-10-14T01:40:07.072 INFO:teuthology.orchestra.run.smithi191.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53935.log.gz 2023-10-14T01:40:07.072 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48866.log 2023-10-14T01:40:07.073 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55134.log.gz 2023-10-14T01:40:07.073 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56139.log 2023-10-14T01:40:07.073 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39625.log.gz 2023-10-14T01:40:07.074 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56621.log 2023-10-14T01:40:07.074 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48866.log.gz 2023-10-14T01:40:07.074 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39835.log 2023-10-14T01:40:07.075 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56139.log.gz 2023-10-14T01:40:07.075 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52413.log 2023-10-14T01:40:07.075 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56621.log.gz 2023-10-14T01:40:07.076 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50597.log 2023-10-14T01:40:07.076 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39835.log.gz 2023-10-14T01:40:07.076 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56463.log 2023-10-14T01:40:07.077 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52413.log.gz 2023-10-14T01:40:07.077 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38967.log 2023-10-14T01:40:07.077 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50597.log.gz 2023-10-14T01:40:07.077 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47334.log 2023-10-14T01:40:07.078 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56463.log.gz 2023-10-14T01:40:07.078 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42326.log 2023-10-14T01:40:07.078 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38967.log.gz 2023-10-14T01:40:07.078 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47334.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47334.log.gz -5 2023-10-14T01:40:07.079 INFO:teuthology.orchestra.run.smithi191.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54015.log 2023-10-14T01:40:07.079 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43136.log 2023-10-14T01:40:07.079 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42326.log.gz 2023-10-14T01:40:07.080 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48439.log 2023-10-14T01:40:07.080 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54015.log.gz 2023-10-14T01:40:07.080 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43136.log.gz 2023-10-14T01:40:07.080 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39129.log 2023-10-14T01:40:07.081 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42788.log 2023-10-14T01:40:07.081 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48439.log.gz 2023-10-14T01:40:07.081 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39129.log.gz 2023-10-14T01:40:07.081 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45124.log 2023-10-14T01:40:07.082 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47614.log 2023-10-14T01:40:07.082 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42788.log.gz 2023-10-14T01:40:07.082 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54473.log 2023-10-14T01:40:07.082 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45124.log.gz 2023-10-14T01:40:07.083 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44058.log 2023-10-14T01:40:07.083 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47614.log.gz 2023-10-14T01:40:07.083 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50385.log 2023-10-14T01:40:07.084 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54473.log.gz 2023-10-14T01:40:07.084 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44058.log.gz 2023-10-14T01:40:07.084 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52354.log 2023-10-14T01:40:07.084 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52432.log 2023-10-14T01:40:07.084 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50385.log.gz 2023-10-14T01:40:07.085 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52518.log 2023-10-14T01:40:07.085 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52354.log.gz 2023-10-14T01:40:07.085 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44361.log 2023-10-14T01:40:07.086 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52432.log.gz 2023-10-14T01:40:07.086 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41094.log 2023-10-14T01:40:07.086 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52518.log.gz 2023-10-14T01:40:07.087 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53462.log 2023-10-14T01:40:07.087 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44361.log.gz 2023-10-14T01:40:07.087 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46969.log 2023-10-14T01:40:07.088 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41094.log.gz 2023-10-14T01:40:07.088 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45257.log 2023-10-14T01:40:07.088 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53462.log.gz 2023-10-14T01:40:07.089 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48684.log 2023-10-14T01:40:07.089 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46969.log.gz 2023-10-14T01:40:07.089 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45257.log.gz 2023-10-14T01:40:07.090 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43691.log 2023-10-14T01:40:07.090 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49504.log 2023-10-14T01:40:07.090 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48684.log.gz 2023-10-14T01:40:07.091 INFO:teuthology.orchestra.run.smithi191.stderr:gzip/var/log/ceph/ceph-client.admin.43691.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43031.log 2023-10-14T01:40:07.091 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43691.log.gz 2023-10-14T01:40:07.091 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44301.log 2023-10-14T01:40:07.092 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49504.log.gz 2023-10-14T01:40:07.092 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52172.log 2023-10-14T01:40:07.092 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43031.log.gz 2023-10-14T01:40:07.092 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42156.log 2023-10-14T01:40:07.093 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44301.log.gz 2023-10-14T01:40:07.093 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39593.log 2023-10-14T01:40:07.093 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52172.log.gz 2023-10-14T01:40:07.094 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55186.log 2023-10-14T01:40:07.094 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42156.log.gz 2023-10-14T01:40:07.094 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41011.log 2023-10-14T01:40:07.094 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39593.log.gz 2023-10-14T01:40:07.095 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55453.log 2023-10-14T01:40:07.095 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55186.log.gz 2023-10-14T01:40:07.095 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54261.log 2023-10-14T01:40:07.096 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41011.log.gz 2023-10-14T01:40:07.096 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39490.log 2023-10-14T01:40:07.096 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55453.log.gz 2023-10-14T01:40:07.097 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54261.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.54261.log.gz 2023-10-14T01:40:07.097 INFO:teuthology.orchestra.run.smithi191.stderr: /var/log/ceph/ceph-client.admin.48957.log 2023-10-14T01:40:07.097 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49047.log 2023-10-14T01:40:07.098 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39490.log.gz 2023-10-14T01:40:07.098 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54208.log 2023-10-14T01:40:07.098 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48957.log.gz 2023-10-14T01:40:07.099 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49413.log 2023-10-14T01:40:07.099 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49047.log.gz 2023-10-14T01:40:07.099 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53829.log 2023-10-14T01:40:07.100 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54208.log.gz 2023-10-14T01:40:07.100 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42892.log 2023-10-14T01:40:07.100 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49413.log.gz 2023-10-14T01:40:07.101 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50446.log 2023-10-14T01:40:07.101 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53829.log.gz 2023-10-14T01:40:07.101 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42892.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.46118.log -- replaced with /var/log/ceph/ceph-client.admin.42892.log.gz 2023-10-14T01:40:07.102 INFO:teuthology.orchestra.run.smithi191.stderr: 2023-10-14T01:40:07.102 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54998.log 2023-10-14T01:40:07.102 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50446.log.gz 2023-10-14T01:40:07.103 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49290.log 2023-10-14T01:40:07.103 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46118.log.gz 2023-10-14T01:40:07.103 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39436.log 2023-10-14T01:40:07.104 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43939.log 2023-10-14T01:40:07.104 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49290.log.gz 2023-10-14T01:40:07.104 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51845.log 2023-10-14T01:40:07.105 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39436.log.gz 2023-10-14T01:40:07.105 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54681.log 2023-10-14T01:40:07.105 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43939.log.gz 2023-10-14T01:40:07.106 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2023-10-14T01:40:07.106 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51845.log.gz 2023-10-14T01:40:07.106 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34543.log 2023-10-14T01:40:07.107 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54681.log.gz 2023-10-14T01:40:07.107 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56490.log 2023-10-14T01:40:07.107 INFO:teuthology.orchestra.run.smithi191.stderr: 29.3% -- replaced with /var/log/ceph/ceph-client.admin.54998.log.gz 2023-10-14T01:40:07.107 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2023-10-14T01:40:07.108 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49383.log 2023-10-14T01:40:07.108 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34543.log.gz 2023-10-14T01:40:07.108 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41475.log 2023-10-14T01:40:07.109 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56490.log.gz 2023-10-14T01:40:07.109 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49383.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49383.log.gz /var/log/ceph/ceph-client.admin.56516.log 2023-10-14T01:40:07.109 INFO:teuthology.orchestra.run.smithi191.stderr: 2023-10-14T01:40:07.109 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45708.log 2023-10-14T01:40:07.110 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41475.log.gz 2023-10-14T01:40:07.110 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56647.log 2023-10-14T01:40:07.110 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56516.log.gz 2023-10-14T01:40:07.110 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53092.log 2023-10-14T01:40:07.111 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45708.log.gz 2023-10-14T01:40:07.111 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51695.log 2023-10-14T01:40:07.111 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56647.log.gz 2023-10-14T01:40:07.112 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39382.log 2023-10-14T01:40:07.112 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53092.log.gz 2023-10-14T01:40:07.112 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39419.log 2023-10-14T01:40:07.112 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51695.log.gz 2023-10-14T01:40:07.113 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40181.log 2023-10-14T01:40:07.113 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39382.log.gz 2023-10-14T01:40:07.113 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43719.log 2023-10-14T01:40:07.114 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39419.log.gz 2023-10-14T01:40:07.114 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46841.log 2023-10-14T01:40:07.114 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40181.log.gz 2023-10-14T01:40:07.114 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50081.log 2023-10-14T01:40:07.115 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43719.log.gz 2023-10-14T01:40:07.115 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50934.log 2023-10-14T01:40:07.115 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46841.log.gz 2023-10-14T01:40:07.116 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38498.log 2023-10-14T01:40:07.116 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50081.log.gz 2023-10-14T01:40:07.116 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56725.log 2023-10-14T01:40:07.117 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50934.log.gz 2023-10-14T01:40:07.117 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39345.log 2023-10-14T01:40:07.117 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38498.log.gz 2023-10-14T01:40:07.118 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56725.log.gz 2023-10-14T01:40:07.118 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T01:40:07.118 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48409.log 2023-10-14T01:40:07.118 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39345.log.gz 2023-10-14T01:40:07.119 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53280.log 2023-10-14T01:40:07.119 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49017.log/var/log/ceph/ceph-client.admin.48409.log: 2023-10-14T01:40:07.119 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48409.log.gz 2023-10-14T01:40:07.120 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52648.log 2023-10-14T01:40:07.120 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53280.log.gz 2023-10-14T01:40:07.121 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52778.log 2023-10-14T01:40:07.121 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49017.log.gz 2023-10-14T01:40:07.121 INFO:teuthology.orchestra.run.smithi191.stderr:gzip/var/log/ceph/ceph-client.admin.52648.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37545.log 2023-10-14T01:40:07.122 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52648.log.gz 2023-10-14T01:40:07.122 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44250.log 2023-10-14T01:40:07.122 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52778.log.gz 2023-10-14T01:40:07.123 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37545.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37545.log.gz 2023-10-14T01:40:07.123 INFO:teuthology.orchestra.run.smithi191.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41939.log 2023-10-14T01:40:07.123 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38859.log 2023-10-14T01:40:07.124 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44250.log.gz 2023-10-14T01:40:07.124 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41939.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.41939.log.gz -- 2023-10-14T01:40:07.124 INFO:teuthology.orchestra.run.smithi191.stderr: /var/log/ceph/ceph-client.admin.46810.log 2023-10-14T01:40:07.125 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40821.log 2023-10-14T01:40:07.125 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38859.log.gz 2023-10-14T01:40:07.125 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55874.log 2023-10-14T01:40:07.126 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46810.log.gz 2023-10-14T01:40:07.126 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44544.log 2023-10-14T01:40:07.126 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40821.log.gz 2023-10-14T01:40:07.127 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45567.log 2023-10-14T01:40:07.127 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55874.log.gz 2023-10-14T01:40:07.127 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39919.log 2023-10-14T01:40:07.128 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44544.log.gz 2023-10-14T01:40:07.128 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54155.log 2023-10-14T01:40:07.128 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45567.log.gz 2023-10-14T01:40:07.129 INFO:teuthology.orchestra.run.smithi191.stderr:gzip/var/log/ceph/ceph-client.admin.39919.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48745.log 2023-10-14T01:40:07.129 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39919.log.gz 2023-10-14T01:40:07.129 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54155.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.54155.log.gz 2023-10-14T01:40:07.129 INFO:teuthology.orchestra.run.smithi191.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37812.log 2023-10-14T01:40:07.130 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48073.log 2023-10-14T01:40:07.130 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48745.log.gz 2023-10-14T01:40:07.130 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48164.log 2023-10-14T01:40:07.131 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37812.log.gz 2023-10-14T01:40:07.131 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38987.log 2023-10-14T01:40:07.131 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48073.log.gz 2023-10-14T01:40:07.132 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48164.log.gz 2023-10-14T01:40:07.132 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44028.log 2023-10-14T01:40:07.132 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45985.log 2023-10-14T01:40:07.133 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38987.log.gz 2023-10-14T01:40:07.133 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44028.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.54182.log 2023-10-14T01:40:07.133 INFO:teuthology.orchestra.run.smithi191.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44028.log.gz 2023-10-14T01:40:07.134 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2023-10-14T01:40:07.134 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45985.log.gz 2023-10-14T01:40:07.134 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45223.log 2023-10-14T01:40:07.135 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54182.log.gz 2023-10-14T01:40:07.135 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49959.log 2023-10-14T01:40:07.135 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2023-10-14T01:40:07.135 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38842.log 2023-10-14T01:40:07.136 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45223.log.gz 2023-10-14T01:40:07.136 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49777.log 2023-10-14T01:40:07.136 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49959.log.gz 2023-10-14T01:40:07.136 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52081.log 2023-10-14T01:40:07.137 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38842.log.gz 2023-10-14T01:40:07.137 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45776.log 2023-10-14T01:40:07.137 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49777.log.gz 2023-10-14T01:40:07.138 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52081.log.gz 2023-10-14T01:40:07.138 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38896.log 2023-10-14T01:40:07.138 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37735.log 2023-10-14T01:40:07.138 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45776.log.gz 2023-10-14T01:40:07.139 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38896.log.gz 2023-10-14T01:40:07.139 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49627.log 2023-10-14T01:40:07.139 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38697.log 2023-10-14T01:40:07.140 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37735.log.gz 2023-10-14T01:40:07.140 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44190.log 2023-10-14T01:40:07.140 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49627.log.gz 2023-10-14T01:40:07.140 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56830.log 2023-10-14T01:40:07.141 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38697.log.gz 2023-10-14T01:40:07.141 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54603.log 2023-10-14T01:40:07.141 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44190.log.gz 2023-10-14T01:40:07.142 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52492.log 2023-10-14T01:40:07.142 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56830.log.gz 2023-10-14T01:40:07.142 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52936.log 2023-10-14T01:40:07.142 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54603.log.gz 2023-10-14T01:40:07.143 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50111.log 2023-10-14T01:40:07.143 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52492.log.gz 2023-10-14T01:40:07.143 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46142.log 2023-10-14T01:40:07.144 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52936.log.gz 2023-10-14T01:40:07.144 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52544.log 2023-10-14T01:40:07.144 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50111.log.gz 2023-10-14T01:40:07.145 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51573.log 2023-10-14T01:40:07.145 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46142.log.gz 2023-10-14T01:40:07.145 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46506.log 2023-10-14T01:40:07.146 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52544.log.gz 2023-10-14T01:40:07.146 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40665.log 2023-10-14T01:40:07.146 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51573.log.gz 2023-10-14T01:40:07.147 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54788.log 2023-10-14T01:40:07.147 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46506.log.gz 2023-10-14T01:40:07.147 INFO:teuthology.orchestra.run.smithi191.stderr:gzip/var/log/ceph/ceph-client.admin.40665.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54920.log 2023-10-14T01:40:07.148 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40665.log.gz 2023-10-14T01:40:07.148 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40769.log 2023-10-14T01:40:07.149 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54788.log.gz 2023-10-14T01:40:07.149 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42848.log 2023-10-14T01:40:07.149 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54920.log.gz 2023-10-14T01:40:07.150 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44738.log 2023-10-14T01:40:07.150 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40769.log.gz 2023-10-14T01:40:07.150 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40097.log 2023-10-14T01:40:07.151 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42848.log.gz 2023-10-14T01:40:07.151 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46476.log 2023-10-14T01:40:07.151 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44738.log.gz 2023-10-14T01:40:07.152 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39257.log 2023-10-14T01:40:07.152 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40097.log.gz 2023-10-14T01:40:07.152 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43061.log 2023-10-14T01:40:07.153 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46476.log.gz 2023-10-14T01:40:07.153 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44128.log 2023-10-14T01:40:07.153 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39257.log.gz 2023-10-14T01:40:07.154 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51297.log 2023-10-14T01:40:07.154 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43061.log.gz 2023-10-14T01:40:07.154 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44128.log.gz 2023-10-14T01:40:07.155 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55265.log 2023-10-14T01:40:07.155 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51297.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T01:40:07.155 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51297.log.gz 2023-10-14T01:40:07.155 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56167.log 2023-10-14T01:40:07.156 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55265.log.gz 2023-10-14T01:40:07.156 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39203.log 2023-10-14T01:40:07.156 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56167.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56167.log.gz -5 2023-10-14T01:40:07.157 INFO:teuthology.orchestra.run.smithi191.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54842.log 2023-10-14T01:40:07.157 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55291.log 2023-10-14T01:40:07.157 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39203.log.gz 2023-10-14T01:40:07.158 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54842.log.gz 2023-10-14T01:40:07.158 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41394.log 2023-10-14T01:40:07.158 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48134.log 2023-10-14T01:40:07.159 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55291.log.gz 2023-10-14T01:40:07.159 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54894.log 2023-10-14T01:40:07.159 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41394.log.gz 2023-10-14T01:40:07.160 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51207.log 2023-10-14T01:40:07.160 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48134.log.gz 2023-10-14T01:40:07.160 INFO:teuthology.orchestra.run.smithi191.stderr:gzip/var/log/ceph/ceph-client.admin.54894.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56595.log 2023-10-14T01:40:07.161 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54894.log.gz 2023-10-14T01:40:07.161 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51207.log.gz 2023-10-14T01:40:07.161 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41991.log 2023-10-14T01:40:07.162 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47644.log 2023-10-14T01:40:07.162 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56595.log.gz 2023-10-14T01:40:07.162 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41991.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T01:40:07.163 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41991.log.gz 2023-10-14T01:40:07.163 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47161.log 2023-10-14T01:40:07.163 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47644.log.gz 2023-10-14T01:40:07.164 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47748.log 2023-10-14T01:40:07.164 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40908.log 2023-10-14T01:40:07.164 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47161.log.gz 2023-10-14T01:40:07.165 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37805.log 2023-10-14T01:40:07.165 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47748.log.gz 2023-10-14T01:40:07.165 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53172.log 2023-10-14T01:40:07.165 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40908.log.gz 2023-10-14T01:40:07.166 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40526.log 2023-10-14T01:40:07.166 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37805.log.gz 2023-10-14T01:40:07.166 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53014.log 2023-10-14T01:40:07.167 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53172.log.gz 2023-10-14T01:40:07.167 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41189.log 2023-10-14T01:40:07.167 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40526.log.gz 2023-10-14T01:40:07.167 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52596.log 2023-10-14T01:40:07.168 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53014.log.gz 2023-10-14T01:40:07.168 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41911.log 2023-10-14T01:40:07.168 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41189.log.gz 2023-10-14T01:40:07.168 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56569.log 2023-10-14T01:40:07.169 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52596.log.gz 2023-10-14T01:40:07.169 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41911.log.gz 2023-10-14T01:40:07.169 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52044.log 2023-10-14T01:40:07.170 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53961.log 2023-10-14T01:40:07.170 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56569.log.gz 2023-10-14T01:40:07.170 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52044.log.gz 2023-10-14T01:40:07.170 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47554.log 2023-10-14T01:40:07.171 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47584.log 2023-10-14T01:40:07.171 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53961.log.gz 2023-10-14T01:40:07.171 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47554.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.47554.log.gz --verbose 2023-10-14T01:40:07.172 INFO:teuthology.orchestra.run.smithi191.stderr: -- /var/log/ceph/ceph-client.admin.43340.log 2023-10-14T01:40:07.172 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41748.log 2023-10-14T01:40:07.172 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47584.log.gz 2023-10-14T01:40:07.172 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48805.log 2023-10-14T01:40:07.173 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43340.log.gz 2023-10-14T01:40:07.173 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48046.log 2023-10-14T01:40:07.173 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41748.log.gz 2023-10-14T01:40:07.173 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34602.log 2023-10-14T01:40:07.174 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48805.log.gz 2023-10-14T01:40:07.174 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48104.log 2023-10-14T01:40:07.174 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48046.log.gz 2023-10-14T01:40:07.175 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54525.log 2023-10-14T01:40:07.175 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34602.log.gz 2023-10-14T01:40:07.175 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45810.log 2023-10-14T01:40:07.175 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48104.log.gz 2023-10-14T01:40:07.176 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49108.log 2023-10-14T01:40:07.176 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54525.log.gz 2023-10-14T01:40:07.176 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45810.log.gz 2023-10-14T01:40:07.177 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53987.log 2023-10-14T01:40:07.177 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49108.log.gz 2023-10-14T01:40:07.177 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40848.log 2023-10-14T01:40:07.178 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45591.log 2023-10-14T01:40:07.178 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53987.log.gz 2023-10-14T01:40:07.178 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51147.log 2023-10-14T01:40:07.179 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40848.log.gz 2023-10-14T01:40:07.182 INFO:teuthology.orchestra.run.smithi191.stderr:gzip/var/log/ceph/ceph-client.admin.45591.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42265.log 2023-10-14T01:40:07.182 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45591.log.gz 2023-10-14T01:40:07.182 INFO:teuthology.orchestra.run.smithi191.stderr: 89.8% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T01:40:07.183 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53144.log 2023-10-14T01:40:07.183 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51147.log.gz 2023-10-14T01:40:07.183 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51087.log 2023-10-14T01:40:07.184 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42265.log.gz 2023-10-14T01:40:07.184 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52335.log 2023-10-14T01:40:07.184 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53144.log.gz 2023-10-14T01:40:07.185 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41222.log 2023-10-14T01:40:07.185 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51087.log.gz 2023-10-14T01:40:07.185 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54551.log 2023-10-14T01:40:07.186 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52335.log.gz 2023-10-14T01:40:07.186 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46722.log 2023-10-14T01:40:07.186 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41222.log.gz 2023-10-14T01:40:07.187 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54069.log 2023-10-14T01:40:07.187 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54551.log.gz 2023-10-14T01:40:07.187 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54972.log 2023-10-14T01:40:07.188 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46722.log.gz 2023-10-14T01:40:07.188 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39021.log 2023-10-14T01:40:07.188 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54069.log.gz 2023-10-14T01:40:07.188 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38825.log 2023-10-14T01:40:07.189 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54972.log.gz 2023-10-14T01:40:07.189 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39021.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.37935.log -- replaced with /var/log/ceph/ceph-client.admin.39021.log.gz 2023-10-14T01:40:07.189 INFO:teuthology.orchestra.run.smithi191.stderr: 2023-10-14T01:40:07.190 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54095.log 2023-10-14T01:40:07.190 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38825.log.gz 2023-10-14T01:40:07.190 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41575.log 2023-10-14T01:40:07.191 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37935.log.gz 2023-10-14T01:40:07.191 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54816.log 0.0% 2023-10-14T01:40:07.191 INFO:teuthology.orchestra.run.smithi191.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54095.log.gz 2023-10-14T01:40:07.192 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42356.log 2023-10-14T01:40:07.192 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41575.log.gz 2023-10-14T01:40:07.192 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2023-10-14T01:40:07.193 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54816.log.gz 2023-10-14T01:40:07.193 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39545.log 2023-10-14T01:40:07.193 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42356.log.gz 2023-10-14T01:40:07.194 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41964.log 2023-10-14T01:40:07.194 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2023-10-14T01:40:07.194 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49198.log 2023-10-14T01:40:07.195 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39545.log.gz 2023-10-14T01:40:07.195 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56220.log 2023-10-14T01:40:07.195 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41964.log.gz 2023-10-14T01:40:07.195 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47674.log 2023-10-14T01:40:07.196 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49198.log.gz 2023-10-14T01:40:07.196 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43495.log 2023-10-14T01:40:07.196 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56220.log.gz 2023-10-14T01:40:07.196 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55160.log 2023-10-14T01:40:07.197 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47674.log.gz 2023-10-14T01:40:07.197 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48017.log 2023-10-14T01:40:07.197 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43495.log.gz 2023-10-14T01:40:07.198 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54395.log 2023-10-14T01:40:07.198 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55160.log.gz 2023-10-14T01:40:07.198 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48017.log.gz 2023-10-14T01:40:07.198 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53751.log 2023-10-14T01:40:07.199 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51936.log 2023-10-14T01:40:07.199 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54395.log.gz 2023-10-14T01:40:07.199 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56777.log 2023-10-14T01:40:07.200 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53751.log.gz 2023-10-14T01:40:07.200 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51936.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.51936.log.gz 2023-10-14T01:40:07.200 INFO:teuthology.orchestra.run.smithi191.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39041.log 2023-10-14T01:40:07.200 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55769.log 2023-10-14T01:40:07.201 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56777.log.gz 2023-10-14T01:40:07.201 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44634.log 2023-10-14T01:40:07.201 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39041.log.gz 2023-10-14T01:40:07.201 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45539.log 2023-10-14T01:40:07.202 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55769.log.gz 2023-10-14T01:40:07.202 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52299.log 2023-10-14T01:40:07.202 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44634.log.gz 2023-10-14T01:40:07.203 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52726.log 2023-10-14T01:40:07.203 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45539.log.gz 2023-10-14T01:40:07.203 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50536.log 2023-10-14T01:40:07.203 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52299.log.gz 2023-10-14T01:40:07.204 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45748.log 2023-10-14T01:40:07.204 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52726.log.gz 2023-10-14T01:40:07.204 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47272.log 2023-10-14T01:40:07.205 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50536.log.gz 2023-10-14T01:40:07.205 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54421.log 2023-10-14T01:40:07.205 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45748.log.gz 2023-10-14T01:40:07.206 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38879.log 2023-10-14T01:40:07.206 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47272.log.gz 2023-10-14T01:40:07.206 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55427.log 2023-10-14T01:40:07.207 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54421.log.gz 2023-10-14T01:40:07.207 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50873.log 2023-10-14T01:40:07.207 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38879.log.gz 2023-10-14T01:40:07.208 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55372.log 2023-10-14T01:40:07.208 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55427.log.gz 2023-10-14T01:40:07.208 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40054.log 2023-10-14T01:40:07.209 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50873.log.gz 2023-10-14T01:40:07.209 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52674.log 2023-10-14T01:40:07.209 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55372.log.gz 2023-10-14T01:40:07.210 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37370.log 2023-10-14T01:40:07.210 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40054.log.gz 2023-10-14T01:40:07.210 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41880.log 2023-10-14T01:40:07.211 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52674.log.gz 2023-10-14T01:40:07.211 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34519.log 2023-10-14T01:40:07.211 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37370.log.gz 2023-10-14T01:40:07.211 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45925.log 2023-10-14T01:40:07.212 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41880.log.gz 2023-10-14T01:40:07.212 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56193.log 2023-10-14T01:40:07.212 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34519.log.gz 2023-10-14T01:40:07.213 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38788.log 2023-10-14T01:40:07.213 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45925.log.gz 2023-10-14T01:40:07.213 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52394.log 2023-10-14T01:40:07.214 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56193.log.gz 2023-10-14T01:40:07.214 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48501.log 2023-10-14T01:40:07.214 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38788.log.gz 2023-10-14T01:40:07.215 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44664.log 2023-10-14T01:40:07.215 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52394.log.gz 2023-10-14T01:40:07.215 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37657.log 2023-10-14T01:40:07.216 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48501.log.gz 2023-10-14T01:40:07.216 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55639.log 2023-10-14T01:40:07.216 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44664.log.gz 2023-10-14T01:40:07.216 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39399.log 2023-10-14T01:40:07.217 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37657.log.gz 2023-10-14T01:40:07.217 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49229.log 2023-10-14T01:40:07.217 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55639.log.gz 2023-10-14T01:40:07.218 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55612.log 2023-10-14T01:40:07.218 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39399.log.gz 2023-10-14T01:40:07.218 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54291.log 2023-10-14T01:40:07.219 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49229.log.gz 2023-10-14T01:40:07.219 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46416.log 2023-10-14T01:40:07.219 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55612.log.gz 2023-10-14T01:40:07.220 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54291.log.gz 2023-10-14T01:40:07.220 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40403.log 2023-10-14T01:40:07.220 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52372.log 2023-10-14T01:40:07.220 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46416.log.gz 2023-10-14T01:40:07.221 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47989.log 0.0% 2023-10-14T01:40:07.221 INFO:teuthology.orchestra.run.smithi191.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40403.log.gz 2023-10-14T01:40:07.222 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39365.log 2023-10-14T01:40:07.222 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52372.log.gz 2023-10-14T01:40:07.222 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38589.log 2023-10-14T01:40:07.222 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47989.log.gz 2023-10-14T01:40:07.223 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49535.log 2023-10-14T01:40:07.223 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39365.log.gz 2023-10-14T01:40:07.223 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38589.log.gz 2023-10-14T01:40:07.224 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39112.log 2023-10-14T01:40:07.224 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39183.log 2023-10-14T01:40:07.224 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49535.log.gz 2023-10-14T01:40:07.224 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39112.log.gz 2023-10-14T01:40:07.225 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55481.log 2023-10-14T01:40:07.225 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53410.log 2023-10-14T01:40:07.225 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39183.log.gz 2023-10-14T01:40:07.226 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49989.log 2023-10-14T01:40:07.226 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55481.log.gz 2023-10-14T01:40:07.226 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44789.log 2023-10-14T01:40:07.226 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53410.log.gz 2023-10-14T01:40:07.227 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49989.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T01:40:07.227 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49989.log.gz 2023-10-14T01:40:07.227 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48532.log 2023-10-14T01:40:07.227 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44789.log.gz 2023-10-14T01:40:07.228 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49597.log 2023-10-14T01:40:07.228 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47056.log 2023-10-14T01:40:07.228 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48532.log.gz 2023-10-14T01:40:07.229 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5/var/log/ceph/ceph-client.admin.49597.log: --verbose -- /var/log/ceph/ceph-client.admin.54577.log 2023-10-14T01:40:07.229 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49597.log.gz 2023-10-14T01:40:07.229 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45033.log 2023-10-14T01:40:07.229 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47056.log.gz 2023-10-14T01:40:07.230 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55239.log 2023-10-14T01:40:07.230 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54577.log.gz 2023-10-14T01:40:07.230 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53881.log 2023-10-14T01:40:07.231 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45033.log.gz 2023-10-14T01:40:07.231 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47704.log 2023-10-14T01:40:07.231 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55239.log.gz 2023-10-14T01:40:07.231 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53881.log.gz 2023-10-14T01:40:07.232 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38717.log 2023-10-14T01:40:07.232 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47704.log.gz 2023-10-14T01:40:07.232 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51057.log 2023-10-14T01:40:07.233 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56113.log 2023-10-14T01:40:07.233 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38717.log.gz 2023-10-14T01:40:07.233 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51057.log.gz 2023-10-14T01:40:07.233 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40213.log 2023-10-14T01:40:07.234 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41067.log 2023-10-14T01:40:07.234 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56113.log.gz 2023-10-14T01:40:07.234 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47802.log 2023-10-14T01:40:07.235 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40213.log.gz 2023-10-14T01:40:07.235 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51543.log 2023-10-14T01:40:07.235 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41067.log.gz 2023-10-14T01:40:07.236 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37656.log 2023-10-14T01:40:07.236 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47802.log.gz 2023-10-14T01:40:07.236 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50660.log 2023-10-14T01:40:07.236 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51543.log.gz 2023-10-14T01:40:07.237 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44909.log 2023-10-14T01:40:07.237 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37656.log.gz 2023-10-14T01:40:07.237 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52208.log 2023-10-14T01:40:07.238 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50660.log.gz 2023-10-14T01:40:07.238 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40137.log 2023-10-14T01:40:07.238 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44909.log.gz 2023-10-14T01:40:07.239 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54762.log 2023-10-14T01:40:07.239 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52208.log.gz 2023-10-14T01:40:07.240 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38535.log 2023-10-14T01:40:07.240 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40137.log.gz 2023-10-14T01:40:07.240 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46261.log 2023-10-14T01:40:07.241 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54762.log.gz 2023-10-14T01:40:07.241 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45401.log 2023-10-14T01:40:07.241 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38535.log.gz 2023-10-14T01:40:07.242 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50352.log 2023-10-14T01:40:07.242 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46261.log.gz 2023-10-14T01:40:07.242 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44819.log 2023-10-14T01:40:07.243 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45401.log.gz 2023-10-14T01:40:07.243 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43587.log 2023-10-14T01:40:07.243 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50352.log.gz 2023-10-14T01:40:07.244 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52884.log 2023-10-14T01:40:07.244 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44819.log.gz 2023-10-14T01:40:07.244 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46335.log 2023-10-14T01:40:07.245 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43587.log.gz 2023-10-14T01:40:07.245 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39453.log 2023-10-14T01:40:07.245 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52884.log.gz 2023-10-14T01:40:07.246 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49138.log 2023-10-14T01:40:07.246 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46335.log.gz 2023-10-14T01:40:07.246 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43309.log 2023-10-14T01:40:07.247 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39453.log.gz 2023-10-14T01:40:07.247 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40307.log 2023-10-14T01:40:07.247 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49138.log.gz 2023-10-14T01:40:07.247 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34567.log 2023-10-14T01:40:07.248 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43309.log.gz 2023-10-14T01:40:07.248 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46996.log 2023-10-14T01:40:07.248 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40307.log.gz 2023-10-14T01:40:07.249 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51967.log 2023-10-14T01:40:07.249 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34567.log.gz 2023-10-14T01:40:07.249 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42111.log 2023-10-14T01:40:07.249 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46996.log.gz 2023-10-14T01:40:07.250 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41418.log 2023-10-14T01:40:07.250 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51967.log.gz 2023-10-14T01:40:07.250 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37734.log 2023-10-14T01:40:07.251 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42111.log.gz 2023-10-14T01:40:07.251 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54369.log 2023-10-14T01:40:07.251 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41418.log.gz 2023-10-14T01:40:07.251 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37909.log 2023-10-14T01:40:07.252 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37734.log.gz 2023-10-14T01:40:07.252 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54369.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.42920.log 2023-10-14T01:40:07.252 INFO:teuthology.orchestra.run.smithi191.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54369.log.gz 2023-10-14T01:40:07.253 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.37909.log: /var/log/ceph/ceph-client.admin.42295.log 2023-10-14T01:40:07.253 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37909.log.gz 2023-10-14T01:40:07.253 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37623.log 2023-10-14T01:40:07.253 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42920.log.gz 2023-10-14T01:40:07.254 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52026.log 2023-10-14T01:40:07.254 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42295.log.gz 2023-10-14T01:40:07.254 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48195.log 2023-10-14T01:40:07.255 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37623.log.gz 2023-10-14T01:40:07.255 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44088.log 2023-10-14T01:40:07.255 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52026.log.gz 2023-10-14T01:40:07.256 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39291.log 2023-10-14T01:40:07.256 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48195.log.gz 2023-10-14T01:40:07.256 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51481.log 2023-10-14T01:40:07.256 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44088.log.gz 2023-10-14T01:40:07.257 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48654.log 2023-10-14T01:40:07.257 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39291.log.gz 2023-10-14T01:40:07.257 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45432.log 2023-10-14T01:40:07.258 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51481.log.gz 2023-10-14T01:40:07.258 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51117.log 2023-10-14T01:40:07.258 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48654.log.gz 2023-10-14T01:40:07.259 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46944.log 2023-10-14T01:40:07.259 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45432.log.gz 2023-10-14T01:40:07.259 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51117.log.gz 2023-10-14T01:40:07.260 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46388.log 2023-10-14T01:40:07.260 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38643.log 2023-10-14T01:40:07.260 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46944.log.gz 2023-10-14T01:40:07.261 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46388.log.gz 2023-10-14T01:40:07.261 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52988.log 2023-10-14T01:40:07.261 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38643.log.gz 2023-10-14T01:40:07.261 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37519.log 2023-10-14T01:40:07.262 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52988.log.gz 2023-10-14T01:40:07.262 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46698.log 2023-10-14T01:40:07.262 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47026.log 2023-10-14T01:40:07.263 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37519.log.gz 2023-10-14T01:40:07.263 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46698.log.gz 2023-10-14T01:40:07.263 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47889.log 2023-10-14T01:40:07.264 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51664.log 2023-10-14T01:40:07.264 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47026.log.gz 2023-10-14T01:40:07.264 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50967.log 2023-10-14T01:40:07.265 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47889.log.gz 2023-10-14T01:40:07.265 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50141.log 2023-10-14T01:40:07.265 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51664.log.gz 2023-10-14T01:40:07.266 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45094.log 2023-10-14T01:40:07.266 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50967.log.gz 2023-10-14T01:40:07.266 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50262.log 2023-10-14T01:40:07.267 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50141.log.gz 2023-10-14T01:40:07.267 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48775.log 2023-10-14T01:40:07.267 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45094.log.gz 2023-10-14T01:40:07.268 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52910.log 2023-10-14T01:40:07.268 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50262.log.gz 2023-10-14T01:40:07.268 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56299.log 2023-10-14T01:40:07.268 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48775.log.gz 2023-10-14T01:40:07.269 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43412.log 2023-10-14T01:40:07.269 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52910.log.gz 2023-10-14T01:40:07.269 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56299.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.56299.log.gz 2023-10-14T01:40:07.270 INFO:teuthology.orchestra.run.smithi191.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.56377.log 2023-10-14T01:40:07.270 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41631.log 2023-10-14T01:40:07.270 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43412.log.gz 2023-10-14T01:40:07.271 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47086.log 2023-10-14T01:40:07.271 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56377.log.gz 2023-10-14T01:40:07.271 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43001.log 2023-10-14T01:40:07.272 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41631.log.gz 2023-10-14T01:40:07.272 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46200.log 2023-10-14T01:40:07.272 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47086.log.gz 2023-10-14T01:40:07.273 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46045.log 2023-10-14T01:40:07.273 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43001.log.gz 2023-10-14T01:40:07.273 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53594.log 2023-10-14T01:40:07.274 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46200.log.gz 2023-10-14T01:40:07.274 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46916.log 2023-10-14T01:40:07.274 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46045.log.gz 2023-10-14T01:40:07.275 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53908.log 2023-10-14T01:40:07.275 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53594.log.gz 2023-10-14T01:40:07.275 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54707.log 2023-10-14T01:40:07.276 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46916.log.gz 2023-10-14T01:40:07.276 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44274.log 2023-10-14T01:40:07.276 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53908.log.gz 2023-10-14T01:40:07.277 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38626.log 2023-10-14T01:40:07.277 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54707.log.gz 2023-10-14T01:40:07.277 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40431.log 2023-10-14T01:40:07.278 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44274.log.gz 2023-10-14T01:40:07.278 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47213.log 2023-10-14T01:40:07.278 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38626.log.gz 2023-10-14T01:40:07.279 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37813.log 2023-10-14T01:40:07.279 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40431.log.gz 2023-10-14T01:40:07.279 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55212.log 2023-10-14T01:40:07.280 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47213.log.gz 2023-10-14T01:40:07.280 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.37813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46363.log 2023-10-14T01:40:07.280 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37813.log.gz 2023-10-14T01:40:07.280 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43810.log 2023-10-14T01:40:07.281 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55212.log.gz 2023-10-14T01:40:07.281 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43966.log 2023-10-14T01:40:07.281 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46363.log.gz 2023-10-14T01:40:07.282 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54734.log 2023-10-14T01:40:07.282 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43810.log.gz 2023-10-14T01:40:07.282 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46446.log 2023-10-14T01:40:07.282 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43966.log.gz 2023-10-14T01:40:07.283 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54734.log.gz 2023-10-14T01:40:07.283 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51815.log 2023-10-14T01:40:07.283 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49259.log 2023-10-14T01:40:07.284 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46446.log.gz 2023-10-14T01:40:07.284 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43279.log 2023-10-14T01:40:07.284 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51815.log.gz 2023-10-14T01:40:07.284 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41445.log 2023-10-14T01:40:07.285 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49259.log.gz 2023-10-14T01:40:07.285 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50566.log 2023-10-14T01:40:07.285 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43279.log.gz 2023-10-14T01:40:07.286 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55795.log 2023-10-14T01:40:07.286 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41445.log.gz 2023-10-14T01:40:07.286 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53040.log 2023-10-14T01:40:07.286 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50566.log.gz 2023-10-14T01:40:07.287 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2023-10-14T01:40:07.287 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55795.log.gz 2023-10-14T01:40:07.287 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56061.log 2023-10-14T01:40:07.288 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53040.log.gz 2023-10-14T01:40:07.288 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52117.log 2023-10-14T01:40:07.288 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2023-10-14T01:40:07.289 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45874.log 2023-10-14T01:40:07.289 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56061.log.gz 2023-10-14T01:40:07.289 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44391.log 2023-10-14T01:40:07.289 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52117.log.gz 2023-10-14T01:40:07.290 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51267.log 2023-10-14T01:40:07.290 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45874.log.gz 2023-10-14T01:40:07.290 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45898.log 2023-10-14T01:40:07.291 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44391.log.gz 2023-10-14T01:40:07.291 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45317.log 2023-10-14T01:40:07.291 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51267.log.gz 2023-10-14T01:40:07.291 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55106.log 2023-10-14T01:40:07.292 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45898.log.gz 2023-10-14T01:40:07.292 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51512.log 2023-10-14T01:40:07.292 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45317.log.gz 2023-10-14T01:40:07.293 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53306.log 2023-10-14T01:40:07.293 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55106.log.gz 2023-10-14T01:40:07.293 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44156.log 2023-10-14T01:40:07.294 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51512.log.gz 2023-10-14T01:40:07.294 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39075.log 2023-10-14T01:40:07.294 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53306.log.gz 2023-10-14T01:40:07.295 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41324.log 2023-10-14T01:40:07.295 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44156.log.gz 2023-10-14T01:40:07.295 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51360.log 2023-10-14T01:40:07.296 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39075.log.gz 2023-10-14T01:40:07.296 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49807.log 2023-10-14T01:40:07.296 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41324.log.gz 2023-10-14T01:40:07.297 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40578.log 2023-10-14T01:40:07.297 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51360.log.gz 2023-10-14T01:40:07.297 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43384.log 2023-10-14T01:40:07.298 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49807.log.gz 2023-10-14T01:40:07.298 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52469.log 2023-10-14T01:40:07.298 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40578.log.gz 2023-10-14T01:40:07.299 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51237.log 2023-10-14T01:40:07.299 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43384.log.gz 2023-10-14T01:40:07.299 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48291.log 2023-10-14T01:40:07.300 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52469.log.gz 2023-10-14T01:40:07.300 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50506.log 2023-10-14T01:40:07.300 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51237.log.gz 2023-10-14T01:40:07.301 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55054.log 2023-10-14T01:40:07.301 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48291.log.gz 2023-10-14T01:40:07.301 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44465.log 2023-10-14T01:40:07.302 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50506.log.gz 2023-10-14T01:40:07.302 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40013.log 2023-10-14T01:40:07.302 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55054.log.gz 2023-10-14T01:40:07.303 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49898.log 2023-10-14T01:40:07.303 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44465.log.gz 2023-10-14T01:40:07.303 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40938.log 2023-10-14T01:40:07.304 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40013.log.gz 2023-10-14T01:40:07.304 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41290.log 2023-10-14T01:40:07.304 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49898.log.gz 2023-10-14T01:40:07.304 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40938.log.gz 2023-10-14T01:40:07.305 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51177.log 2023-10-14T01:40:07.305 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34664.log 2023-10-14T01:40:07.305 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41290.log.gz 2023-10-14T01:40:07.306 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55821.log 2023-10-14T01:40:07.306 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51177.log.gz 2023-10-14T01:40:07.307 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.34664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34664.log.gz 2023-10-14T01:40:07.307 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41366.log 2023-10-14T01:40:07.307 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47949.log 2023-10-14T01:40:07.307 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55821.log.gz 2023-10-14T01:40:07.308 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42452.log 2023-10-14T01:40:07.308 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41366.log.gz 2023-10-14T01:40:07.309 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43092.log 2023-10-14T01:40:07.309 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47949.log.gz 2023-10-14T01:40:07.309 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40635.log 2023-10-14T01:40:07.310 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42452.log.gz 2023-10-14T01:40:07.310 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52135.log 2023-10-14T01:40:07.310 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43092.log.gz 2023-10-14T01:40:07.311 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47919.log 2023-10-14T01:40:07.311 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40635.log.gz 2023-10-14T01:40:07.311 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41603.log 2023-10-14T01:40:07.311 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52135.log.gz 2023-10-14T01:40:07.312 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51876.log 2023-10-14T01:40:07.312 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47919.log.gz 2023-10-14T01:40:07.312 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43842.log 2023-10-14T01:40:07.312 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41603.log.gz 2023-10-14T01:40:07.313 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49868.log 2023-10-14T01:40:07.313 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51876.log.gz 2023-10-14T01:40:07.313 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38518.log 2023-10-14T01:40:07.314 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43842.log.gz 2023-10-14T01:40:07.314 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38771.log 2023-10-14T01:40:07.314 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49868.log.gz 2023-10-14T01:40:07.314 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53673.log 2023-10-14T01:40:07.315 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38518.log.gz 2023-10-14T01:40:07.315 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46872.log 2023-10-14T01:40:07.315 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38771.log.gz 2023-10-14T01:40:07.315 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55586.log 2023-10-14T01:40:07.316 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53673.log.gz 2023-10-14T01:40:07.316 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46872.log.gz 2023-10-14T01:40:07.316 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46230.log 2023-10-14T01:40:07.317 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51998.log 2023-10-14T01:40:07.317 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55586.log.gz 2023-10-14T01:40:07.317 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53198.log 2023-10-14T01:40:07.317 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46230.log.gz 2023-10-14T01:40:07.318 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42677.log 2023-10-14T01:40:07.318 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51998.log.gz 2023-10-14T01:40:07.318 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42648.log 2023-10-14T01:40:07.319 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53198.log.gz 2023-10-14T01:40:07.319 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56434.log 2023-10-14T01:40:07.319 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42677.log.gz 2023-10-14T01:40:07.319 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45195.log 2023-10-14T01:40:07.320 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42648.log.gz 2023-10-14T01:40:07.320 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5/var/log/ceph/ceph-client.admin.56434.log: --verbose -- /var/log/ceph/ceph-client.admin.49747.log 2023-10-14T01:40:07.320 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56434.log.gz 2023-10-14T01:40:07.321 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52063.log 2023-10-14T01:40:07.321 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45195.log.gz 2023-10-14T01:40:07.321 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.49747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55665.log 2023-10-14T01:40:07.322 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49747.log.gz 2023-10-14T01:40:07.322 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52190.log 2023-10-14T01:40:07.322 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52063.log.gz 2023-10-14T01:40:07.322 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52281.log 2023-10-14T01:40:07.323 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55665.log.gz 2023-10-14T01:40:07.323 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53699.log 2023-10-14T01:40:07.323 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52190.log.gz 2023-10-14T01:40:07.324 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.52281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43779.log 2023-10-14T01:40:07.324 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52281.log.gz 2023-10-14T01:40:07.324 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46638.log 2023-10-14T01:40:07.325 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53699.log.gz 2023-10-14T01:40:07.325 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55930.log 2023-10-14T01:40:07.325 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.43779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43779.log.gz 2023-10-14T01:40:07.326 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40695.log 2023-10-14T01:40:07.326 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46638.log.gz 2023-10-14T01:40:07.326 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55930.log.gz 2023-10-14T01:40:07.327 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56325.log 2023-10-14T01:40:07.327 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47529.log 2023-10-14T01:40:07.327 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40695.log.gz 2023-10-14T01:40:07.328 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53803.log 2023-10-14T01:40:07.328 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56325.log.gz 2023-10-14T01:40:07.328 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48987.log 2023-10-14T01:40:07.329 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47529.log.gz 2023-10-14T01:40:07.329 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53725.log 2023-10-14T01:40:07.329 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53803.log.gz 2023-10-14T01:40:07.330 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51755.log 2023-10-14T01:40:07.330 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48987.log.gz 2023-10-14T01:40:07.330 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54041.log 2023-10-14T01:40:07.331 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53725.log.gz 2023-10-14T01:40:07.331 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48593.log 2023-10-14T01:40:07.331 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51755.log.gz 2023-10-14T01:40:07.331 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39274.log 2023-10-14T01:40:07.332 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54041.log.gz 2023-10-14T01:40:07.332 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.48593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55717.log 2023-10-14T01:40:07.332 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48593.log.gz 2023-10-14T01:40:07.333 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45063.log 2023-10-14T01:40:07.333 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39274.log.gz 2023-10-14T01:40:07.333 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.55717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47778.log 2023-10-14T01:40:07.334 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55717.log.gz 2023-10-14T01:40:07.334 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.45063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56351.log 2023-10-14T01:40:07.334 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45063.log.gz 2023-10-14T01:40:07.335 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42428.log 2023-10-14T01:40:07.335 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47778.log.gz 2023-10-14T01:40:07.335 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44222.log 2023-10-14T01:40:07.336 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56351.log.gz 2023-10-14T01:40:07.336 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40482.log 2023-10-14T01:40:07.336 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42428.log.gz 2023-10-14T01:40:07.337 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.44222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42480.log 2023-10-14T01:40:07.337 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44222.log.gz 2023-10-14T01:40:07.337 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54125.log 2023-10-14T01:40:07.338 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40482.log.gz 2023-10-14T01:40:07.338 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56803.log 2023-10-14T01:40:07.338 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42480.log.gz 2023-10-14T01:40:07.339 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.54125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56854.log 2023-10-14T01:40:07.339 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54125.log.gz 2023-10-14T01:40:07.339 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50752.log 2023-10-14T01:40:07.339 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56803.log.gz 2023-10-14T01:40:07.340 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56751.log 2023-10-14T01:40:07.340 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56854.log.gz 2023-10-14T01:40:07.340 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46670.log 2023-10-14T01:40:07.341 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50752.log.gz 2023-10-14T01:40:07.341 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50782.log 2023-10-14T01:40:07.341 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56751.log.gz 2023-10-14T01:40:07.341 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.46670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41718.log 2023-10-14T01:40:07.342 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46670.log.gz 2023-10-14T01:40:07.342 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.50782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39095.log 2023-10-14T01:40:07.342 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50782.log.gz 2023-10-14T01:40:07.343 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56404.log 2023-10-14T01:40:07.343 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41718.log.gz 2023-10-14T01:40:07.343 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40968.log 2023-10-14T01:40:07.343 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39095.log.gz 2023-10-14T01:40:07.344 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53358.log 2023-10-14T01:40:07.344 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56404.log.gz 2023-10-14T01:40:07.344 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.40968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38734.log 2023-10-14T01:40:07.344 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40968.log.gz 2023-10-14T01:40:07.345 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.53358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42081.log 2023-10-14T01:40:07.345 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53358.log.gz 2023-10-14T01:40:07.345 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.38734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51330.log 2023-10-14T01:40:07.346 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38734.log.gz 2023-10-14T01:40:07.346 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39004.log 2023-10-14T01:40:07.346 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42081.log.gz 2023-10-14T01:40:07.346 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.51330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47116.log 2023-10-14T01:40:07.347 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51330.log.gz 2023-10-14T01:40:07.347 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.39004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42235.log 2023-10-14T01:40:07.347 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39004.log.gz 2023-10-14T01:40:07.347 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.47116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56246.log 2023-10-14T01:40:07.348 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47116.log.gz 2023-10-14T01:40:07.348 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41808.log 2023-10-14T01:40:07.348 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42235.log.gz 2023-10-14T01:40:07.349 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.56246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42208.log 2023-10-14T01:40:07.349 INFO:teuthology.orchestra.run.smithi191.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56246.log.gz 2023-10-14T01:40:07.349 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.41808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41808.log.gz 2023-10-14T01:40:07.349 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/ceph-client.admin.42208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42208.log.gz 2023-10-14T01:40:07.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-14T01:40:07.383 INFO:teuthology.orchestra.run.smithi191.stderr: 90.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T01:40:19.393 INFO:teuthology.orchestra.run.smithi191.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T01:40:25.843 INFO:teuthology.orchestra.run.smithi191.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T02:25:20.965 INFO:teuthology.orchestra.run.smithi191.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T02:29:19.929 INFO:teuthology.orchestra.run.smithi191.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T02:37:33.573 INFO:teuthology.orchestra.run.smithi191.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T02:37:33.580 INFO:teuthology.orchestra.run.smithi191.stderr: 2023-10-14T02:37:33.581 INFO:teuthology.orchestra.run.smithi191.stderr:real 57m26.920s 2023-10-14T02:37:33.581 INFO:teuthology.orchestra.run.smithi191.stderr:user 45m11.139s 2023-10-14T02:37:33.581 INFO:teuthology.orchestra.run.smithi191.stderr:sys 2m17.692s 2023-10-14T02:37:33.583 INFO:tasks.ceph:Archiving logs... 2023-10-14T02:37:33.584 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi/7427261/remote/smithi191/log 2023-10-14T02:37:33.586 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-14T02:40:09.254 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-14T02:40:09.266 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-14T02:40:09.267 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-14T02:40:09.317 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-14T02:40:09.327 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-14T02:40:09.328 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T02:40:09.429 INFO:teuthology.orchestra.run.smithi191.stdout: remote refid st t when poll reach delay offset jitter 2023-10-14T02:40:09.429 INFO:teuthology.orchestra.run.smithi191.stdout:============================================================================== 2023-10-14T02:40:09.430 INFO:teuthology.orchestra.run.smithi191.stdout:*hv01.front.sepi 44.4.53.2 2 u 221 512 377 0.156 -0.994 0.606 2023-10-14T02:40:09.430 INFO:teuthology.orchestra.run.smithi191.stdout:+hv02.front.sepi 63.231.80.2 3 u 485 512 377 0.180 -1.991 0.963 2023-10-14T02:40:09.430 INFO:teuthology.orchestra.run.smithi191.stdout:+hv03.front.sepi 74.6.168.72 3 u 226 512 377 0.215 -1.044 0.525 2023-10-14T02:40:09.431 INFO:teuthology.orchestra.run.smithi191.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-10-14T02:40:09.432 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-14T02:40:09.445 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-14T02:40:09.445 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-14T02:40:09.462 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-14T02:40:09.474 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-14T02:40:09.489 INFO:teuthology.task.internal:Duration was 10204.360438 seconds 2023-10-14T02:40:09.490 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-14T02:40:09.505 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-14T02:40:09.505 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-14T02:40:09.801 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-14T02:40:09.801 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2023-10-14T02:40:09.802 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-14T02:40:09.845 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-14T02:40:09.845 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-14T02:40:10.044 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-14T02:40:10.044 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-14T02:40:10.491 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-14T02:40:10.556 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-14T02:40:10.557 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-14T02:40:10.637 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-14T02:40:10.687 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-14T02:40:10.719 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2023-10-14T02:40:10.753 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-14T02:40:10.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T02:40:10.806 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-14T02:40:11.034 INFO:teuthology.task.internal:Transferring archived files... 2023-10-14T02:40:11.246 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi/7427261/remote/smithi191 2023-10-14T02:40:11.247 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-14T02:40:11.623 INFO:teuthology.task.internal:Removing archive directory... 2023-10-14T02:40:11.624 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-14T02:40:11.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-14T02:40:11.643 INFO:teuthology.task.internal:Not uploading archives. 2023-10-14T02:40:11.644 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-14T02:40:11.657 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-14T02:40:11.658 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-14T02:40:11.708 INFO:teuthology.orchestra.run.smithi191.stdout: 658464 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 14 02:40 /home/ubuntu/cephtest 2023-10-14T02:40:11.709 INFO:teuthology.orchestra.run.smithi191.stdout: 672553 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Oct 14 00:00 /home/ubuntu/cephtest/mnt.0 2023-10-14T02:40:11.709 INFO:teuthology.orchestra.run.smithi191.stdout: 673329 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Oct 14 00:01 /home/ubuntu/cephtest/mnt.0/client.0 2023-10-14T02:40:11.709 INFO:teuthology.orchestra.run.smithi191.stdout: 687667 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 14 00:01 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-14T02:40:11.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T02:40:11.711 INFO:teuthology.orchestra.run.smithi191.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-14T02:40:11.711 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi191 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-14T02:40:11.719 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-14T02:40:11.733 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-14T02:40:11.759 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi191 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-14T02:40:11.759 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T02:40:11.801 DEBUG:teuthology.nuke:shortname: smithi191 2023-10-14T02:40:11.801 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T02:40:11.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-10-13_23:35:38-rbd-wip-dis-testing-distro-default-smithi/7427261', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-13 23:41:16.555677', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDTJq5pXYPXVKv8Nn2/FrTO6TzhVPDH1QVWF6NYsuEQy0i/oqu7ud7tCXtWBWffCbWG//LTv2bp/u1KekRrIZaE='} 2023-10-14T02:40:11.882 INFO:teuthology.orchestra.console.smithi191:Power off 2023-10-14T02:40:11.883 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T02:40:11.906 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-10-14T02:40:11.907 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T02:40:11.933 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-10-14T02:40:15.935 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T02:40:16.045 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-10-14T02:40:20.048 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T02:40:20.159 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-10-14T02:40:24.161 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T02:40:24.272 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-14T02:40:24.373 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-10-14T02:40:24.483 INFO:teuthology.run:Summary data: description: rbd/cli/{base/install clusters/{fixed-1 openstack} conf/{disable-pool-app} data-pool/none features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd_support_module_recovery} duration: 10204.360438346863 failure_reason: 'Command failed (workunit test rbd/rbd_support_module_recovery.sh) on smithi191 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=735f68d7bf91d643813a8420fc2b11441f4bd8c4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_support_module_recovery.sh''' flavor: default owner: scheduled_dis@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9c1878e8b80a48598997d1721abb1bf2 status: fail success: false 2023-10-14T02:40:24.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T02:40:24.572 INFO:teuthology.run:FAIL